Legacy Arq Forum

This forum has been superseded. Please to go support.haystacksoftware.com

This legacy forum is read-only. Please use the new Arq forum.

1. 

   robotspacer
   Member

   I recently got back from a vacation, and added a lot of photos to iPhoto. Arq seems to be having some problems uploading the latest files from my iPhoto Library backup.

   If I open Arq I can see the progress bar filling up for a while, and it says it has around 13GB to back up. That 13GB number seems accurate based on my own estimates. The problem is, the progress bar fills up, it disappears, and the count of how much data has uploaded just keeps on going. Right now it's at 25GB. I've had a couple of times where I needed to restart my computer, and this whole process seems to start over again when I do that.

   My entire iPhoto Library is about 50GB, and only 14GB has changed in the past few weeks. But Comcast says I've blown through 71GB of data in just two days. I haven't been doing anything else that would use a huge amount of data like this.

   I have no idea what to do here—I don't want to stop doing my online backups but I can't just let it keep going forever. Is there anyway I can see exactly what it's backing up, or get an accurate estimate of how much it needs to back up total? Or is it likely something is seriously wrong and I need to start my backups over from scratch?

   Earlier today I noticed I still had an older version of the app (2.6.5) but I've updated to 2.6.8 and the problem hasn't changed.

   Posted 1 year ago #
2. 

   robotspacer
   Member

   I turned on debug logging, and it seems to be backing up some very old data. For example, one file that hasn't been modified (or moved) since 12/24/2012. I have backups that go back to August 2011 so I'm not sure why it would be re-uploading files older than that. (And regardless, shouldn't those files be included in the estimate?)

   Posted 1 year ago #
3. 

   optolythic
   Member

   This has been a problem other people are having too. It seems not everyone is affected, but Stefan still hasn't confirmed if this is a bug or anything.

   Also see this topic where people are talking about it http://www.haystacksoftware.com/support/arqforum/topic.php?id=562#post-1500

   Posted 1 year ago #
4. 

   stefan
   Key Master

   The extra uploading is because of a bug that was in 2.6.3. I tried to explain it as honestly and in as much detail as I could in a blog post here.

   Posted 1 year ago #
5. 

   robotspacer
   Member

   Okay—I wasn't sure if that was the same problem since I didn't see any mention of it going beyond the progress bar and continuing to upload. Though now that I look again it sounds like optolythic is describing the same thing.

   That said, Stefan, you say "Arq 2.6.5 (and later) ignores all backups made after March 7 by an Arq version older than 2.6.5." But, I'm looking at the "Detail" logs and there are other files being uploaded. Just to pick one example: I have a file from June 1st, 2011—long before March 7th of this year. That file is present in my oldest backups on Amazon, from August 13th, 2011, also long before March. I downloaded the file from Arq, and it's identical to the current version on my computer—same number of bytes, same modification date, same md5 checksum. So it seems to be re-uploading files that do not match your description.

   One thing I've noticed is that it's not actually uploading as much data as it says. I assume that after a restart it processes all the files again, and counts them in the total number of gigabytes, but realizes it already uploaded them and doesn't need to do that again. So that's a relief.

   I don't mind that it has to re-upload some things—even if it has to re-upload everything I'd rather it do that to ensure I have a good backup. I just wish I knew exactly how much it's going to upload. I also think it would have been a good idea to mention the need for re-uploading in the release notes, along with a link to your detailed explantion. Or at least mention it on the arqbackup Twitter account.

   Posted 1 year ago #
6. 

   robotspacer
   Member

   Just wanted to add that it did eventually finish, uploading around 40GB in total (according to Arq). I'm guessing the other 40GB or so that Comcast says I've used in the past couple days was a result of Arq on my other Mac going through the same process.

   I think I'm all back to normal here, but if you think what I described may be a bug, let me know if there's anything I can do to help figure out what happened.

   Posted 1 year ago #
7. 

   garybernhardt
   Member

   Stefan, I'm seeing what robotspacer is: Arq is re-uploading most or all of my data, including stuff that hasn't changed since long before that bug was introduced. For example, I'm looking at the logs right now, and it's uploading a video of a talk recorded in June, 2011 whose timestamp hasn't changed since then. I haven't even looked at that file since then, actually.

   This, combined with reports in other threads of Arq removing all backups (due to budget enforcement), worries me an awful lot. I've read the blog post and at least scanned all of the relevant threads (I think), but I haven't seen any comments from you about Arq re-uploading old data, or about it removing large numbers of pre-March-7 backups via budget enforcement.

   I realize that this may be because you're more focused right now on invalid data than losing some old backups, which I think would be reasonable. But a comment here about whether this seems like a different bug would be welcome.

   Posted 1 year ago #

RSS feed for this topic