[Epic]: Problems Uploading Large Files

[felix-appsmith]

Is there an existing issue for this?

• I have searched the existing issues

Description

When we try to upload a file to a database that is larger than 20mb the file upload fails, this problem happens with different sizes for different users for some user the file upload fails when it is larger than 5mb but another when it is larger than 20mb this doesn't make much sense.

To get a better idea of this issue, create a repository with the tests that have been done.

appsmith-problems-uploading-large-files

Apart from this, here I attach issues that are related to the issue.

1. Base64 files larger than 5 Mb fail to display in Appsmith
2. Upload of files larger than 5mb fails when changing port
3. Not able to upload files greater than 75 mb
4. How to increase Filepicker upload size on self-hosted
5. Issue with video uploads to S3 with files greater than 5MB
6. Increase the filepicker supported size on cloud

Steps To Reproduce

1. Enter this application: app
2. Try to upload a video larger than 25mb

Public Sample App

https://app.appsmith.com/app/filesuploaderror/page1-636914a6b7d12f577aa56521

Issue video log

No response

Version

Cloud : Appsmith v1.8.7-SNAPSHOT

Front conversations

[tomjose92]

Another user reported facing this error while trying to upload a file larger than 50mb.

[AnaghHegde]

I spoke to one more user who wants to upload large files( > 100mb ). Is there any workaround for this.

[dilippitchika]

Limitations

• Spring in memory limit,
• plugin specific limit
• and a few more things

If we are going to allow >100MB, we'll need to test and verify that it actually works

More context -https://theappsmith.slack.com/archives/CGBPVEJ5C/p1669722874855689?thread_ts=1669700677.989409&cid=CGBPVEJ5C

[ereio]

Just adding as another example, we have files that are upwards of 300mb that we need uploaded.

[dilippitchika]

@ereio can you also add your use-case on why these large files need to be uploaded in your app? How is appsmith going to help here?

[ereio]

@dilippitchika For sure!

We have tool where management is going to upload large statement files instead of pulling them from where we normally do automatically. We don’t want to build a webpage outside appsmith that’s only for management to drag and drop large files to upload.

We have an API endpoint that can handling uploading very large files through multipart requests, and were hoping AppSmith could help us build out the UI part.