download free 30 days trial version buy bucket explorer
Documentation  Download  Purchase  Support  FAQs   Forum   ScreenShots & Demos

How to use all available bandwidth for Amazon S3 Uploads?

Bucket Explorer allows multiple parallel uploads. If you have the bandwidth, you can run Bucket Explorer even in 100 or more threads to take full advantage of that bandwidth.
With the default setting of Bucket Explorer, you can upload a maximum of 100 MB of file(s) and run 5 threads at a time. If you want to use all available bandwidth for S3 uploads, then you can customize the value of maximum threads & maximum allowed size for upload.

Suppose we have some files(with different sizes) running in queue. If the sum of the first two files is more than the predefined size in configuration xml; then Bucket Explorer will process only a single file. Now we process the queue for the second and third file if the sum of these files again exceeds the predefined size in the configuration xml. Bucket Explorer will process the second file only and the process will follow for all the remaining files.

Use All Available Bandwidth for Amazon S3 Upload

Use all available bandwidth for Amazon S3 upload:

If you want to use all available bandwidth while uploading data on Amazon S3, you need to specify the maximum allowed size and number of threads for upload operation.
Suppose you have 30 files of 20 MB each and you want to use all available bandwidth, you just need to set the value of the maximum number of threads and maximum allowed size for upload. In this case, the maximum number of threads is 30 and the maximum allowed size for upload is 600 MB.
Now all 30 files will be uploaded in a single queue at once.

What is the advantage of using this feature?

User can set the limit of the maximum upload size for parallel queue. This will reduce the time for running big processes one by one in queue.

If you are uploading a number of files of small size at a time and you don’t increase the maximum threads and maximum allowed size, you will have to wait for 5 processes which are to be run one by one. And if you increase the maximum limit to 1000, then you can run 5 processes at once in parallel queue.

How to customize upload size and number of threads:

Follow the given step-by-step processes to set the maximum allowed size and number of threads for uploading data:

  1. Run Bucket Explore UI
  2. Click Tools - > Preferences - >Advance or Tools - > Advance Preferences .
  3. Change the value of the  maximum threads to desired value.
  4. Change the value of the  maximum allowed size to desired value.
  5. Click on OK Button.
  6. Now whenever you run upload, Bucket Explorer will upload files with the specified "maximum allowed size" & "maximum threads" in queue at a time.

Advance Preferences to Use All Available Bandwidth

Related Topics:


 

Give us your feedback