Legacy Arq Forum

This forum has been superseded. Please to go support.haystacksoftware.com

This legacy forum is read-only. Please use the new Arq forum.

1. 

   Jacob
   Member

   Hi,

   I'm testing Arq as an alternative to Jungle Disk (their failure to get their act in gear to support Lion is telling and worrying). The software looks nice and it's great to see so much activity on the forum.

   Unfortunately, I am currently underwhelmed by Arq's upload speed. Jungle Disk will report upload speeds of 400-700 kbps on my connection, with Activity Monitor.app showing ~800kbps upload activity. Arq on the other hand maxes out at ~110 kbps in Activity Monitor. This is based on a quick comparison using a ~90 MB backup set (mp3 files), no bandwidth limiting, with both Arq and Jungle Disk backing up to an S3 EU bucket. Am I doing something wrong? Should I maybe tweak my DSL router settings?

   I did some searches on the forum but I did not come across this issue. Help would be appreciated!

   Cheers, Jacob

   Posted 1 year ago #
2. 

   stefan
   Key Master

   Not sure. Arq will max out my upload speed (15 megabits/sec, or 1.5 megabytes/sec).

   If Arq is backing up a lot of small files it'll be slower because it packs them into "pack files" and then uploads the pack files.

   If you upload a file to your EU bucket using AWS Management Console, what speed does it upload at?

   Posted 1 year ago #
3. 

   Jacob
   Member

   Hi Stefan,

   Thank you for responding so quickly!

   I tried uploading a single 7 MB file via AWS Management Console, and I am indeed seeing the same numbers in Activity Monitor.app as Arq is getting (~110kbps upload). So it seems the problem is my connection with Amazon.

   That still puzzles me: I made a fresh Jungle Disk Network Drive and copied the same file onto it; I got a reported upload rate of 500 kbps, and network upstream north of 800 kbps in Activity Monitor.

   Posted 1 year ago #
4. 

   Jacob
   Member

   I have a speculative answer for some of the observed difference in upload speed. It seems that the 'Upload speed' number reported by Activity Monitor.app includes local network traffic, i.e. from one local process to another. Seeing 800 kbps of uploading going on when Jungle DIsk is running thus doesn't mean all that much.

   I am going to try a larger (22GB) backup set with Arq now; the predicted upload time seems reasonable.

   By the way, I am looking forward to version 2 having binary diffs!

   Cheers, Jacob

   Posted 1 year ago #
5. 

   jbsnyder
   Member

   > Not sure. Arq will max out my upload speed (15 megabits/sec, or 1.5 megabytes/sec).

   In my limited experience with it using it at home and on a high bandwidth connection, it doesn't seem to go much faster than this for me, even with the "maximum" bandwidth setting enabled. From testing I've done previously with S3, I have noticed that doing one upload at a time, serially does max out around 1-2MB/s, but I believe it's also possible to do multithreaded uploads and get pretty good scaling: http://improve.dk/archive/2011/11/07/pushing-the-limits-of-amazon-s3-upload-performance.aspx

   Tools like s3funnel (https://github.com/sstoiana/s3funnel) also use this technique.

   Posted 1 year ago #

RSS feed for this topic