QNAP NAS update: Moving 1.5 MILLION images from the old Drobo!

I am interrupting my Costa Rica blog posts to bring to you a long awaited post about my data storage transition. Way back in February of this year I wrote a blog post telling you all that I was making a huge transition from the Drobo NAS system (now out of business) to the newer and far superior QNAP system. Back then I had just installed the two new NAS systems, but had not moved any data. 

I had many people (most of whom were using Drobo) write to me and ask how the QNAP transition was going. I told them that it was too early to tell, and that I had a lot of work to do before I could give them a fair and honest answer. 

Here I am about 6 months later and I have been using the system non-stop. I apologize for taking so long to write this follow-up review, but there was a lot to do in between then and now. Some had to do with the data transition and some was just the back-to-back photo tours. No more excuses! Let me tell you what I have found, both the good and the bad.  

Initial Setup

Let me start with the install of the boxes. I had two NAS systems to set up, one of which would be my main storage and one which would be my offsite destination. I had a whole bunch of the Seagate IronWolf 20TB hard drives to install, and I also purchased a couple of M2 SSD drives to increase the overall speed of the drive access.  Installing the drives was simple enough, and powering up the QNAP boxes was a piece of cake. I did have to make some phone calls to the support team when I got stuck, and they were very helpful getting me up and running. 

My goal was to transition all 1.5 million photos (and other data) from the Drobo NAS to the new QNAP TVS-h874 NAS. This process took a REALLY long time. I would transfer one year of data at a time and I think it took me the better part of two weeks to complete the process. 

An Issue

Once I got everything moved over, everything appeared to be perfect, with one hiccup. When I attempted to search for a folder on the drive (using my Mac Studio), the folders could not be found. It turns out that the NAS was not indexed. The crazy thing is...there is no easy way to re-index a drive from a Mac, so I had to research a way to make that happen. Once I figured out how to make that happen, it took another 5 days! And this problem has not been completely resolved. There are still times when the indexing goes haywire (where I search for a folder, it shows the folder, I click on it, and it opens a completely different folder) and I have to force a re-index. This process generally takes a couple of days (in the background), which is a real nuisance since it slows the drive to a crawl. I have searched the Internet for answers and this seems to be an issue with the Mac and many NAS drives. I am hoping that someone at Apple can help me resolve this.

How I Work On My Files

Originally I had thought that I would use the QNAP NAS as my main working drive, but I have decided to use the new 4TB Crucial x10 SSD drive as my main drive. I chose to make this change for two reasons:

* The Crucial SSD is incredibly fast, much faster than accessing the QNAP drive over Ethernet.

* In case the indexing problem happens again, I can still work with the SSD without any delays while I re-index the NAS.

Setting Up Remote Synchronization

In the previous blog post, I showed the two QNAP units side by side. My next step was to copy all of the data from the QNAP TVS-h874 NAS (primary drive) to the QNAP TS-832PX NAS drive (which would be my offsite drive). The QNAP support people helped me connect the two boxes together and start the synchronization. I knew that the synchronization had to first be done locally (on the same network), because trying to sync up 1.5 million images to a remote location over the Internet would take forever. 

That process took another 3 or 4 days, but I did not have to do anything. We started the sync and I let it run.

At that point I needed to drive the second box to my remote location, which is a couple of hundred miles away at my brother's home. Once I got the second box powered up at my brothers, I once again leaned on the QNAP support people to help me with the remote sync settings. This process was so simple and painless. I was amazed! With the old Drobo unit (using their Drobo DR software), the user interface was terrible, the process was painstaking and it failed all the time. I have been dying for a reliable system for keeping my data safe in more than one location. Now I have it.  

The User Interface and Features

The user interface for the QNAP is all browser based and is very straight-forward. I have not used most of the icons you see above, mostly using the HBS 3 Hybrid Backup Sync app for the remote synchronization. I do use the File Station application at times, but mainly use the Mac Finder to find what I am looking for.

This is what the File Station interface looks like. A simple interface for viewing the files and folders stored on the NAS drive.

There are numerous applications which can be installed on the QNAP NAS drive. I have installed a couple of apps (for the backup and remote access). I have been tempted to install the media streaming app (just for fun), but have not done so at this time.

The Control Panel is where I set all my settings for the NAS unit, with me generally using the "General Settings" more than anything else. 

Within the General Settings, I can check the status of all the drives. In this screen shot, you can see the status of the two internal SSDs and all the Seagate IronWolf 20TB hard drives. 

As I mentioned earlier, I am using the the HBS 3 Hybrid Backup Sync app (no additional charge for this) for my remote synchronization. I have this application running on both boxes and performing a synchronization every morning at 1am. It has been running for the last 6 months without any issues or failures. This means that I have all 1.5 million images in both places for extra security, and it stays up-to-date constantly. This is a huge peace of mind for me (and my clients).

When I was using the Drobo DR software, I would constantly bug the development team at Drobo to give me some sort of interface to show the progress of the synchronization. With the Drobo, there was almost no way to see if the synchronization was successful or how much data was transferred. They never fixed that issue, creating times when the sync process was broken for months without my knowledge. With the QNAP Sync log, I have an easy way to check the status of my sync to make sure they are happening.

If I click on one of the items in the Sync log, I can see more details of that particular process. In the example above, I can see that on Aug 28th, 54GB of data was sent from my TVS-h874 NAS drive to the TS-832PX NAS drive hundreds of miles away. It took about an hour to synchronize the 4914 files.

 

Since we are on the subject of remote data, I have to talk about one of my favorite things about the QNAP NAS drives, and one of the biggest differences between the old Drobo system and these new units. I am talking about the ability to easily access ANY of my files from ANYWHERE in the world. Drobo did have the ability to access their NAS drive from a remote location using a web browser, but it was painfully slow. There are many times when I am traveling and need to access images for a client. When searching for a file on the old Drobo NAS, it would literally take me 15 to 20 minutes to locate a file since the interface was brutally slow. With the QNAP drives, I can now find that same file in less than a minute and I LOVE that! Not only can I check files on my local drive, but I can access the remote drive as well. 

Oh, one more thing. There is another feature of the QNAP NAS that is not critical but which I really love.  That is the auto backup of my camera roll from my phone any time I get in range of my WiFi network. This means that I do not have to do this manually, and I don't have to rely on iCloud or other services to backup my photos and videos from my iPhone. 

Conclusion

When Drobo started showing signs of their pending demise, I was in a panic. I had ALL my data on their boxes and both the company and the units were failing. I literally lost sleep worrying about this problem. I pride myself on having every digital image I have ever taken (the keepers), and having them in two locations. I even tell my clients about this setup so that they know I will have their images safe for years to come. 

I can tell you now that the panic is gone and I am really happy with the new QNAP solution. I have not only replicated what I was doing with the Drobo units, I have surpassed the functionality and usability by far! It is not an inexpensive solution, but it is something that is vital to my business. As a professional photographer, our data is everything, and keeping those images safe is critical. I am now sleeping better at night.

__________________________________________________________

Subscribe to the Jeff Cable Photography Blog by clicking HERE!
_________________________________________________________________
If you are interested in purchasing ANY equipment, please click here to go to B&H Photo, as I get a referral from them if you enter this way. It does not change the cost to you in any way, but it helps me keep this blog up and running.
_________________________________________________________________
Check out my upcoming photo tours to amazing places around the world. I have photo tours to Africa Costa Rica and more. And Canon will loan you any gear you want for FREE for any of my tours. 

_________________________________________________________________