Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]-[210]:Issue with video uploads to S3 with files greater than 5MB #11137

Open
1 task done
Imtinan1996 opened this issue Feb 14, 2022 · 8 comments
Open
1 task done
Assignees
Labels
Bug Something isn't working Community Reported issues reported by community members Core Query Execution Issues related to the execution of all queries File upload issues Issues related to uploading any type of files from within Appsmith Frontend This label marks the issue or pull request to reference client code High This issue blocks a user from building or impacts a lot of users Integrations Product Issues related to a specific integration Needs Triaging Needs attention from maintainers to triage Production Query & JS Pod Issues related to the query & JS Pod Query performance Issues that have to do with lack in performance of query execution

Comments

@Imtinan1996
Copy link

Is there an existing issue for this?

  • I have searched the existing issues

Current Behavior

When uploading multiples files to S3, the query fails for video files that are above 5MB with the error message

File content is not base64 encoded. File content needs to be base64 encoded when the 'File Data Type: Base64/Text' field is selected 'Yes'.

Any images uploaded work fine. Video uploads work fine if file is less than 5MB, i have set the file size to 25MB still the video doesn't upload. Fails even if one video is selected

Steps To Reproduce

Set the file picker options to the following

  • Max files - 5
  • Max file size - 25
  • Allowed types - 2 (Image/video)
  • Data format - Base64

set S3 upload query options to

  • Commands: Create multiple new files
  • File data type - Base64
  • Content - {{ file_picker.files }}

Select any video to upload (greater than 5 MB) - Sample Videos
Video will fail to upload and will give error

File content is not base64 encoded. File content needs to be base64 encoded when the 'File Data Type: Base64/Text' field is selected 'Yes'.

Environment

Production

Version

Self-Hosted

@Imtinan1996 Imtinan1996 added Bug Something isn't working Needs Triaging Needs attention from maintainers to triage labels Feb 14, 2022
@rohan-arthur rohan-arthur added S3 Issues related to the S3 plugin Community Reported issues reported by community members labels Feb 15, 2022
@github-actions github-actions bot added Query & JS Pod Issues related to the query & JS Pod Actions Pod labels Feb 15, 2022
@Nikhil-Nandagopal
Copy link
Contributor

@Imtinan1996 on our cloud version there is a 5mb limit on processing files. If you are selfhosting, you can increase this limit by setting APPSMITH_CODEC_SIZE=100 on the self-hosted instance

@Imtinan1996
Copy link
Author

alright, will have a look at it, thanks!

@Nikhil-Nandagopal
Copy link
Contributor

Do let us know if this is still a problem for you!

@Imtinan1996
Copy link
Author

@Nikhil-Nandagopal just wanted to inform you that changing the env variable didnt solve the issue

@mojtab23
Copy link
Contributor

@Imtinan1996 We are working on it. We will notify you when we found the soloution.

@rohan-arthur rohan-arthur added the High This issue blocks a user from building or impacts a lot of users label Feb 25, 2022
@mojtab23 mojtab23 added Frontend This label marks the issue or pull request to reference client code and removed Needs Triaging Needs attention from maintainers to triage labels Mar 2, 2022
@mojtab23
Copy link
Contributor

mojtab23 commented Mar 2, 2022

Seems like there is a frontend problem here, in execute request frontend doesn't send the content of a large file.

@mojtab23
Copy link
Contributor

mojtab23 commented Mar 8, 2022

Related issue #11711 for UI/UX improvement.

@rashmi-rai rashmi-rai removed their assignment Mar 14, 2022
@nidhi-nair nidhi-nair assigned rashmi-rai and unassigned rashmi-rai Mar 17, 2022
@Nikhil-Nandagopal
Copy link
Contributor

Nikhil-Nandagopal commented Apr 7, 2022

Stats

Stat Values
Reach 105
Effort (months) 1

@Nikhil-Nandagopal Nikhil-Nandagopal changed the title [Bug]: Issue with video uploads to S3 with files greater than 5MB [Bug]-[210]:Issue with video uploads to S3 with files greater than 5MB Apr 7, 2022
@leotom2000 leotom2000 assigned leotom2000 and unassigned mojtab23 Apr 26, 2022
@Nikhil-Nandagopal Nikhil-Nandagopal added the Integrations Product Issues related to a specific integration label Sep 12, 2022
@sribalajig sribalajig added Core Query Execution Issues related to the execution of all queries Data Platform Pod Issues related to the underlying data platform Query performance Issues that have to do with lack in performance of query execution and removed Integrations Product Issues related to a specific integration S3 Issues related to the S3 plugin labels Jan 26, 2023
@github-actions github-actions bot removed the Query & JS Pod Issues related to the query & JS Pod label Jan 26, 2023
@github-actions github-actions bot added the Query & JS Pod Issues related to the query & JS Pod label Mar 2, 2024
@nidhi-nair nidhi-nair added the Needs Triaging Needs attention from maintainers to triage label Apr 2, 2024
@riteshkew riteshkew added Integrations Product Issues related to a specific integration and removed Query & JS Pod Issues related to the query & JS Pod Data Platform Pod Issues related to the underlying data platform labels Apr 11, 2024
@github-actions github-actions bot added the Query & JS Pod Issues related to the query & JS Pod label Apr 11, 2024
@sneha122 sneha122 added the File upload issues Issues related to uploading any type of files from within Appsmith label Oct 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug Something isn't working Community Reported issues reported by community members Core Query Execution Issues related to the execution of all queries File upload issues Issues related to uploading any type of files from within Appsmith Frontend This label marks the issue or pull request to reference client code High This issue blocks a user from building or impacts a lot of users Integrations Product Issues related to a specific integration Needs Triaging Needs attention from maintainers to triage Production Query & JS Pod Issues related to the query & JS Pod Query performance Issues that have to do with lack in performance of query execution
Projects
Status: No status
Development

No branches or pull requests