Throttling of Maximum Parallel Data in Upload Queue

Introduction

Throttling is a process responsible for regulating the rate at which application processing is conducted.
We are using the throttling concept in Bucket Explorer’s upload process .

How throttling works with Bucket Explorer?

With default setting of this feature you can upload maximum 100 MB of file(s) or run 5 threads at a time. If the size of files being uploaded, is more than 100 MB then only one thread will run. Suppose you are uploading 105MB of file, because its size is more than maximum limit so only one thread will run.

Why You Need Throttling?

If we have some files running in queue with different sizes, let us suppose we have first two files having there sum of size more than in configuration xml, then we run only single file. Now we process the queue for second and third file, if the sum of these files exceeds from in size, then we process the second file only and the process will be followed for all remaining file.

We have three files to be run at queue respectively ‘a of size 35 MB’ , ‘b of size 70 MB’ and ‘c of size 65 MB’. In configuration xml it is set to 100 MB, so when I process these files in queue, then ‘a’ will process alone as because sum of the sizes of ‘a’ and ‘b’ exceeds from 100 MB. Now file ‘b’ also process alone in queue as because sum of the sizes of ‘b’ and ‘c’ exceeds from running 100 MB. Then ‘c will process.’

Suppose you are uploading 200MB of file, because its size is more then maximum limit so as per default setting in Bucket Explorer only one thread will run. Now if you want to run 5 threads of 200 MB each then you can only do this by setting maximum limit of parallel data in queue. Now if you set the maximum limit to 1000 MB then you can run 5 threads of 200 MB each as per your requirement.

What is the advantage of using this feature?

The main advantage of setting maximum limit of parallel queue is the deduction of time, spend in running big processes one by one in queue. Let’s talk in reference to above example, here you are uploading a file of 200 MB at a time and if you don’t increase the maximum limit then you will have to wait for 5 processes which are supposed to be run one by one, and if you increase the maximum limit to 1000 then you can run 5 processes at once in parallel queue that will reduce the time spend in processing.