Drobo S

I’ve been meaning to pick up a Drobo for our house for quite some time — thanks to Aneel I finally got one last week — and, as I share below, I really, really like it. They’ve done a great job, and it should be a great storage and backup solution for us for a long time to come.

[quick disclosure: Greylock Partners, where I work, is an investor in Drobo.]

First off: Drobo is essentially a big box of hard disks that acts like a single disk. It uses a non-RAID technology called BeyondRAID to spread out data in a way that if 1 disk fails, you can still get to all your data. (There’s also a setting so that you can make it robust to 2 simultaneous drive failures, but that’s not the default, or what I’ve set mine on.)

It also has an extremely nice characteristic that you can always hot swap any drive for a replacement or a bigger drive if you run out of space. (Just another step towards robots being in control — when the Drobo needs more space, it blinks a yellow light at you, effectively saying, “Human, I require more disk — please run down to Fry’s and deposit the new disk beside my blinky light. That is all.” I, for one, welcome our new robot overlords.)

Anyway, back to the Drobo. I chose the Drobo S, which is a 5 bay unit that’s direct attached to a machine via eSATA, Firewire 800 or USB3. I dithered back and forth on whether to choose that one or the Drobo FS, which runs everything over Gigabit Ethernet as a networked file server. I chose the direct attached because we have an iMac that’s pretty much always on, and the vast majority of the data we want to store on the Drobo is from the iMac — and I figured this would be a simpler configuration. I’m still on the fence — I think I would have been just as happy with the FS.

The out of box experience with the Drobo is exceptionally good. The packaging is more like a consumer device, with easy-to-follow 1-2-3 steps on top, clearly marked, and the Drobo itself wrapped in a protective cloth. Essentially, here’s the process:

  1. insert the disks into the Drobo (in my case, 5 1TB Quantums)
  2. install the Drobo software onto the host computer
  3. plug it in
  4. run the Drobo dashboard to specify how you want the partitioning scheme to work, etc

Altogether, took about 10 minutes, and the Drobo was happily running, showing to my iMac as a 16 TB volume (even though I’ve got 5 TB of physical space and more like 3.7 TB of logical space once you factor in the redundancy).

That was really it — it couldn’t have been simpler. No complicated decisions, no significant forward looking capacity planning, no nothing. When the yellow blinky light comes on, I’ll feed it more disk.

To my mind, this is really the only solution there is that’s simple, performant, stable, expandable, redundant, and not incredibly industrial and expensive. It’s quiet (much quieter than I expected for 5 drives running) and doesn’t get hot, and so far has been pretty good about spinning down after disuse. (It could be more aggressive there, but might be pilot error on my part — need to look into it.)

Anyway, I like it a bunch.

Using it for backup with Time Machine

It’s worth talking about my use case here, since there is a minor wrinkle. The reason that I’m so excited & interested in home storage is that our family’s data needs are growing, quickly. We’ve got about 40k digital photos that are getting increasingly large per picture. We’re taking more and more HD video with our Canon 7D. Most everything we watch for SPL that isn’t streamed is ripped from other sources and stored. In fact, in the year or so since we got our iMac with what I thought was a pretty reasonably sized 2 TB disk, we’ve gone from about 600 GB of stuff to 1.3 TB.

It’s harder than you might think to regularly and reliably back up 1.3 TB in your house.

We had a 2 TB external drive that was doing it for a while, but that’s not really big enough once your main data set is over a terabyte, especially with Apple’s Time Machine, since it’s pretty aggressive about making deltas every hour, day, week, etc. So we needed something bigger than that, but the 3 TB drives aren’t too available yet, and I wasn’t really all that keen on replacing that one again in a year or so as our data grew.

Which is why the Drobo is perfect. Just add disks as I want backup to scale.

There is a small problem though, in the interaction between the design of the Drobo and the design of Time Machine. The Drobo just wants to be the biggest disk it can be — up to (at least) 16 TB, so it tells the iMac to just keep giving it data, letting it (and you, human with a car and a credit card) take care of the physical details.

Time Machine is designed to find an external disk (that you select), start putting files on it and then putting new (or changed) files on it again and again and again until it fills up the disk. So that’s a virtue if you’ve got a dedicated disk that’s backing your data up, to a point.

But since the Drobo advertises to the iMac that it’s a 16 TB disk, and Time Machine hasn’t really learned limits yet, Time Machine will happily fill up your physical space, which will cause your yellow Drobo light to come on, which will cause you to install a new disk (and repeat, and repeat), all the way up to the 16 TB that’s the maximum.

So that’s not great. What you really want to be able to do is to tell Time Machine to just use a certain amount of space and then start rewriting over older copies. There’s no way to do that at present in the Time Machine settings (which I feel is silly — with big disks like Drobo, it’s an easy thing to add), so you have to instead make Time Machine think it’s got a smaller disk than it does.

2 ways to do that: (1) partition the Drobo into a logical Time Machine volume, or (2) use sparse bundles. I didn’t want to do the first one, because in the future I might want to expand the Time Machine volume, which would mean repartitioning the Drobo, and losing my data in the process.

But sparse bundles (or, more precisely, sparse images), which I also use to encrypt my work and personal directories on my laptop, do the trick perfectly. With a sparse image, you can set up something that looks like a disk to your Mac, with an optional maximum size that you set, but that only takes up the space that it’s actually using.

So I set up a 3.5 TB sparse image that Time Machine backs up to — as it gets to full, it’ll do the right thing, keep the total backup space used under 3.5 TB, no problem. And I can resize the sparse image at any time in the future from the Terminal.

And that’s working perfectly at this point.

I used an Automator script called Time Tamer to do things pretty automatically for me. And there’s a good discussion of some of this stuff on a couple of blogs — this one was most helpful to me.

Bottom line: the Drobo S is going to be perfect for us, and I couldn’t be happier to have it. I know it’s decidedly nerdy to get excited about a storage solution, but there you have it. :-)

Tags:

11 comments

  1. I’ve always had mixed feelings about the Drobo.

    On one hand, it looks super cool, handy and easy. “Set it and forget it” in a sense. It also looks pretty cool and the auto resizing is very handy.

    On the other hand, it’s quite expensive for a somewhat slow RAID device. I’ve yet to actually go the Drobo route for that reason. I like the idea, I like the implementation (minus the performance which I feel is lacking). I just can’t quite justify the cost.

    Also on the fence regarding USB/Firewire vs. Gig E. I guess either would really be workable now that I think about it.

    • My experience so far is that it’s easily fast enough for backups and normal workloads, and I really like the resizing capability.

  2. Very useful post–thanks. One question I have is how well it plays with online backup services (I use Mozy). Any experience here? I’ve had issues with eSATA being a pretty flaky interface (e.g. Mozy gets thrown off if you boot your computer without the eSATA drive attached, and Lightroom freaks out if my Win7 computer hibernates and wakes up). What interface are you using to connect it?

    My instinct is to go with the FS since I have multiple computers to deal with, but I have a related set of worries there.

    Also, how loud is it?

    • Hey Stephen — I’m using FW800 at the moment, and haven’t yet done something like Mozy. For now, I’m just taking manual snapshots every few months and keeping that backup offsite at work.

      If you’re running a wired LAN at all at home, I would think the FS would be what you want.

      On noise, it’s sort of subjective. We’ve got ours sitting under our desk — during the day, can’t really hear it. When things are quiet at night, can definitely hear the fan noise, although it’s a relatively big fan, so pretty low frequency. Can’t hear too much disk chirping. But you know, with noise, your mileage may vary.

  3. As I understand it, there’s a gotcha with sparse images—or, sparse bundles, rather. That’s usually what gets used on networked Time Machine shares not on an official Time Capsule.

    The data gets stored in “bands” backed by individual files in one bit directory, and after awhile there are just too many files in one directory for some part of the stack, and things fail mysteriously.

    I’ve never had this happen to me personally, but this might be of interest:

    http://arzur.net/2010/08/31/time-machine-on-a-network-drive-you-will-need-to-increase-the-band-size/

  4. Oh also, since I was belaboring over a Drobo, the one thing I couldn’t figure out was offsite backups.

    I eventually ended up with this setup in my makeshift household IT closet:

    http://www.flickr.com/photos/deusx/5015507828/

    We have 3 x 1.5TB drives. One goes in the NAS, one goes in an external drive dock, and one goes to my inlaws’ house. The first mirrors to the second every night, and they all rotate every few weeks.

    I know the drives are swappable in the Drobo, but does it accommodate anything like this scenario?

    • Nope, I don’t think it can do that type of thing right now. Maybe one of the DroboApps, but doesn’t feel like how they design, honestly.

  5. I bought a Netgear (formerly Irfant) ReadyNAS NV+ a few years ago and I’ve been pretty happy with it. I looked at the Drobo at the time, but they didn’t have a NAS then, I don’t think, and I really didn’t want to tie my storage to one computer, since we’re up to 4 computers now.

    The ReadyNAS also does the intelligent RAID expansion, which is one of the things that really attracted me to it. I’ve got 3x500GB in there now, and once we run out of space I’ll probably start swapping in 1TB or 2TB drives. (I’ve got a free drive slot as well as a spare drive hanging around, haven’t really needed it yet.)

    Time Machine setup was a bit of a pain, since at the time it didn’t support non-Time Capsule network shares without fiddling some hidden settings, and I had to manually create the sparse disk image as well. It works reliably AFAICT, I’ve used it a few times to recover files I deleted, and once to restore all of my wife’s files when I had to reinstall OS X on her MacBook.

    Are you storing your data on the iMac and just using the Drobo for backup? I use the ReadyNAS for backup, but also for media storage since I generally want to be able to get at my photos/movies from any machine in the house (also works well with streaming them to the Xbox).

  6. Quantum!?

    I love the idea of the Drobo, but when I realistically look at my storage needs, simple 2×2 TB RAID1 will serve my needs for a long, long time and costs less than a Drobo box without disks.