Add new functionality to calculate chunk size dynamically

[aayusharyan]

Add calculateChunkSize option when the chunkSize cannot be predecided for all the files... So, this will be called if it is defined and fileObject is passed as a parameter, so the chunk size can be set for each file without creating a new instance of Flow.

[aayusharyan]

@AidasK
Hi, when you have time. Please check this. 🙇

[AidasK]

I think solution could be a bit cleaner.

Maybe chunkSize option itself could be a function?
And chunkSize in FlowChunk is no longer valid

flow.js/src/flow.js

Line 1162 in fc6c242

this.chunkSize = this.flowObj.opts.chunkSize;

So this value might be changed via constructor params

get params too:

flow.js/src/flow.js

Line 1276 in fc6c242

flowChunkSize: this.flowObj.opts.chunkSize,

[aayusharyan]

Okay.
@AidasK I have changed the opts chunkSize to work as a function also. There is no BC. I have checked everything including the getParams method response for each chunk. Attaching one evidence for your peace of mind. (This is the response of getParams) 😅

[akshay-kh]

@aayusharyan @AidasK is there any update related to this PR.

[AidasK]

That looks cleaner! @aayusharyan @akshay-kh can you tell me more about the use case of this feature? Why do we need this?

[aayusharyan]

The use-case will be when we need to have a chunk size dynamically for each individual file... For example, I can say in my use-case GCS Takes 32 chunks in a single merge request. And due to backend limitations, I can perform only 32 chunks and my files can be anywhere from 500KB to 30GB and thus, I want to make chunkSize dynamic for each individual file.

[aayusharyan]

@AidasK,
Thanks for the Merge. I have one more suggestion. I'll make that improvement soon. 😅

[AidasK]

Oh, sounds super useful then 👍