download free 30 days trial version buy bucket explorer
Documentation  Download  Purchase  Support  FAQs   Forum   ScreenShots & Demos

How to use all available bandwidth for Amazon S3 Uploads?

Bucket Explorer allows multiple parallel uploads. If you have the bandwidth, you can run Bucket Explorer in even 100 or more threads to take full advantage of that bandwidth.
With default setting of Bucket Explorer you can upload maximum 100 MB of file(s) and run 5 threads at a time. If you want to use all available bandwidth for S3 uploads then you can customize the value of maximum threads & maximum allowed size for upload.

Suppose we have some files(with different sizes) running in queue, Now if sum of first two files is more than predefined size in configuration xml, then Bucket Explorer will process only single file. Now we process the queue for second and third file, if the sum of these files again exceeds then predefined size in configuration xml, then Bucket Explorer will process the second file only and the process will be followed for all remaining file.

Use All Available Bandwidth for Amazon S3 Upload

Use all available bandwidth for Amazon s3 upload :

If you want to use all available bandwidth while uploading data on Amazon S3 ,you need to specify maximium allowed size and number of threads for upload operation.
Suppose you have 30 files of 20 MB each. If you want to use all availble bandwith then you just need to set the value of maximum number of threads and maximum allowed size for upload.In this case your maximun number of threads will be 30 & maximum allowed size for upload will be 600 MB.
Now all 30 files will be uploaded in a sigle queue at a time.

What is the advantage of using this feature?

User can set the limit of maximum upload size for parallel queue ,this will reduce the time for running big processes one by one in queue.

If you are uploading number of file of small size at a time and you don’t increase the maximum threads and maximum allowed size then you will have to wait for 5 processes which are supposed to be run one by one, and if you increase the maximum limit to 1000 then you can run 5 processes at once in parallel queue.

How to customize upload size and number of threads:

Follow the given step-by-step process to set maximum allowed size and number of thread for upload data:

  1. Run Bucket Explore UI
  2. Click Tools - > Preferences - >Advance or Tools - > Advance Preferences .
  3. Change the value of maximum threads to desired value.
  4. Change the value of maximum allowed size to desired value.
  5. Click on OK Button.
  6. Now from next time whenever you run upload then Bucket Explorer will upload files with specified "maximum allowed size" & "maximum threads" in queue at a time.

Advance Preferences to Use All Available Bandwidth

Related Topics:


 

Give us your feedback