Arq version 2.3 is now available!
This update includes support for the new “us-west-2″ (Oregon) S3 region.
It’s a free update for all Arq users.
As always, full release notes for all Arq versions are on the release notes page.
Arq version 2.3 is now available!
This update includes support for the new “us-west-2″ (Oregon) S3 region.
It’s a free update for all Arq users.
As always, full release notes for all Arq versions are on the release notes page.
The other day I reinstalled OS X. My computer had become extremely sluggish and I wanted to see if the performance would improve if I reformatted my hard disk and started over. Along the way I learned a few lessons about restoring using Arq. Here’s what I did:
Before I went through with it, I made sure I had all my data backed up. Arq had backed up the following:
I inserted the Snow Leopard installation disk, shut down the computer, and then started it holding down the Option key. I clicked on the DVD and the computer booted from it. I formatted the disk and installed OS X. I created a user with the same name as I was using before.
Next I downloaded and installed Arq. I launched Arq and entered the same S3 keys and encryption password I was using before.
Finally it was time to restore using Arq.
Instead of waiting for absolutely everything to be restored from S3, I restored files in several steps.
The first step was to restore ~/Library from my “other computer” (the previous incarnation of my computer). I opened the triangle next to “Other Computers”, found my old computer, opened the triangle next to “Library” and selected the latest backup:

Then I clicked “Restore…” and Arq restored the Library folder to ~/Restored by Arq/Library (because a Library folder already existed).
When that restore was done, I closed all open applications, deleted the contents of ~/Library, and dragged everything from ~/Restored by Arq/Library to ~/Library.
At that point I could use Mail, iCal and Address Book. I selected a few applications in Applications backup folder and restored them as well.
I also wanted to sync my calendars with my iPhone, so I plugged it in and it sync’d. Later I’ll delete the iTunes files in ~/Music and replace them with the backed-up files.
Now that the computer felt “back to normal”, I restored my “src” folder (where all my work files are). Then I got back to work, restoring the really large folders (Documents, Music and Pictures) at my leisure over the next few days.
The multi-step restore approach was a big time-saver and got me up and running fairly quickly. The Library folder was relatively small (really small in fact, with the exception of Mail).
I learned that reformatting the hard drive helped a little with sluggishness, but the long-term fix is likely the purchase of an Optibay and an SSD.
I also learned that restoring this way is fairly complicated. So I’m thinking about how to make a product that would restore more seamlessly while also allowing people to get back to work before absolutely everything is restored. There’ll be more to come on that.
If you’ve transferred your work to a new computer and don’t need the old computer’s backups in your S3 account anymore, you’ll need to delete them. Arq does not currently provide a mechanism for deleting those backups, but you can delete them through the AWS Management Console. Here’s how to do that:
First, open the AWS Management Console (https://console.aws.amazon.com/s3/home).
Next, select the bucket that Arq uses for its backups (named “.com.haystacksoftware.arq”).
Now you’ll have to determine the computer UUID that you want to delete. To do this, look at the computerinfo file within each one:
computerinfo and pick “Download”Here’s an example “computerinfo” file:
<plist version="1.0">
<dict>
<key>userName</key>
<string>stefan</string>
<key>computerName</key>
<string>Stefan Reitshamer’s MacBook Pro</string>
</dict>
</plist>
In that example, the computer name is “Stefan Reitshamer’s MacBook Pro”.
Now that you’ve found the right computer UUID to delete, go back and select the bucket itself to see all the computer UUIDs again. Then control-click on the computer UUID you want to delete, and pick “Delete” from the pop-up menu. AWS Management Console will delete all the objects for that computer UUID.
WARNING: This delete cannot be undone! Please be careful when deleting.
Apple has excellent instructions for backing up and restoring
Here’s the link: http://support.apple.com/kb/ht2980
To back up your Safari bookmarks etc, make sure Arq is backing up these items:
To back up your Address Book, make sure Arq is backing up these items:
To back up your iCal calendars, make sure Arq is backing up these items:
To back up your Keychains, make sure Arq is backing up this folder:
To back up your Mail, make sure Arq is backing up these items:
To restore, follow the instructions in the Apple support article linked above.
When I started developing Arq it was partly because I couldn’t find an existing online backup offering that gave me enough control. I wanted to control exactly which files would be backed up, and I didn’t want to be constrained by rules that many of the “unlimited backup” offerings had like excluding network drives, excluding applications, etc.
So Arq lets you back up anything you want. But then the question is, what should you back up? The following is my suggestion for a basic backup of your files on your Mac.
When you first install and launch Arq, it asks your for your Amazon S3 “keys” and a few other things. Then it asks if you’d like to choose your own files for backup, or back up your home folder minus a few unnecessary items:

If you picked “I’ll manually add folders to back up” and you’ve changed your mind, here’s how to set up Arq to back up your home folder minus the unnecessary items:
Click the + button at the bottom left of the Arq main window.

Pick your home folder (/Users/<yourname>) and click OK.

Click the “Edit Excludes…” button.

Add 3 excludes.

Make sure the first 2 are set to “relative path” instead of “name”.
Click OK.
If you want to back up your applications, add the Applications folder.

Many applications put some of their support files in /Library/Application Support, so add that too.

If you prefer, you pick and choose specific folders to back up instead of backing up your entire home directory.
WARNING: If you choose to do this and you later create a new folder in your home directory and start putting important files in there, you’ll have to remember to add this new folder to Arq or else it won’t be backed up!
I back up the following folders as separate items in Arq:
Time Machine and Arq are complementary. Backing up using Time Machine to another disk is cheap and fast. If you’re backing up to a Time Capsule via Wifi it’s very convenient because it just happens; there’s nothing to plug in. If you’re backing up to a USB drive, you’ll have to remember to plug in the USB drive periodically. Restoring is fast because you’re reading from a USB disk physically connected to your Mac, or from a Time Capsule over Wifi.
But Time Machine doesn’t cover all cases. If someone breaks in and steals your computer, they may steal your Time Capsule or USB drive as well, and then your files are gone forever. If fire, flood, or lightning strikes, you may lose both your computer and your backups; files gone forever. And if you travel often, you’ll have to bring along your USB drive or Time Capsule, or backups won’t happen until you get home and stay home long enough for a backup to complete.
Arq covers those cases that Time Machine doesn’t. The backups are off site at Amazon’s servers, safe from your theif and your natural disasters. They’re even safe from disaster at an Amazon site because Amazon replicates your data at several sites. And Arq works whenever there’s an Internet connection, so backups still happen when you’re on the road.
I’m really excited to ship Arq 1.5!
It includes scheduling options like once-per-day backups and manual-only (one of the most requested features) as well as Pause/Resume and Back Up Now functions. It also includes a whole bunch of refinements and bug fixes.
To get it, pick “Check for Updates” from the menu in Arq, or download it from the product page.
Here are the details:
Enjoy! If you have any feedback or questions I’d love to hear from you! Just email support@haystacksoftware.com. Thanks!
- Stefan
This release fixes a bug that causes high CPU usage after Arq Agent has been running for many hours and there are backup errors (e.g. folder to be backed up isn’t available).
Pick “Check for Updates” from the Arq menu to automatically update to 1.4.4. Or download Arq here.
This release fixes a few bugs:
Pick “Check for Updates” from the Arq menu to automatically update to 1.4.2. Or download Arq here.
Great news!
Amazon just announced “Reduced Redundancy Storage” (RRS) for S3. Objects stored with the RRS “storage class” are “99.99% durable over a given year,” whereas “standard” storage is 99.999999999% durable (overkill for backup for most people). Objects stored with RRS are only $.10/GB per month ($.11 in the Northern California region — see pricing) — a 33% savings!
Arq 1.4 is out with support for RRS! Pick “Check for Updates” in the Arq menu to automatically update, or download it from the Arq product page.
For new users of Arq the default is to use RRS. For current users Arq continues to use Standard storage (I didn’t want to assume everyone would want to make the switch).
If you’re a current user, just install the update as described above, then go to the Budget tab of Preferences and check ”Use Reduced Redundancy storage class for new objects”:


Click “Convert” to migrate:

Enjoy the savings!
- Stefan