Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"Repo is too big to import" #348

Closed
dgennetten opened this issue Dec 1, 2017 · 16 comments
Closed

"Repo is too big to import" #348

dgennetten opened this issue Dec 1, 2017 · 16 comments
Labels

Comments

@dgennetten
Copy link

dgennetten commented Dec 1, 2017

Consistently getting "Repo is too big to import" for all links launched from v2.grommet.io.

Example: https://codesandbox.io/s/github/grommet/grommet-site?initialpath=button&module=%2Fscreens%2FButton.js

@CompuIves
Copy link
Member

CompuIves commented Dec 3, 2017

Thanks for letting me know! The line throwing the error is here: https://github.com/codesandbox-app/git-extractor/blob/master/src/routes/github/api.ts#L479. The zip of the repo is 112MB, which was above the 30MB limit we set, we set this limit to make sure we don't hit any memory limit. I raised the limit to 128MB now, but there seems to be another limit that's hit. I can check tomorrow what limit that is and maybe raise it, I think it may be the file count limit (is set to 100 right now).

The public/img/image*.js files in the grommet-site repo are the files that cause it to hit the limit now, so if they are not important you can also delete those files and it'll work.

Regardless, we should re-evaluate our limits from time to time. I can check tomorrow if we can raise any other limits 😄 .

@ryanpcmcquen
Copy link
Contributor

Did the limits ever get raised here @CompuIves? Curious for this and: #1007

@CompuIves
Copy link
Member

CompuIves commented Aug 12, 2018

Yes! It's now double if I'm not mistaken (200 files). Not that we don't count node_modules in this calculation.

@ryanpcmcquen
Copy link
Contributor

@CompuIves, any plan to raise it more? I must have hit the 200 module limit for my repo ...

@rowild
Copy link
Contributor

rowild commented Aug 23, 2018

This error message appears after uploading one simple, small vue file already...

@CompuIves
Copy link
Member

Do you have an example @rowild? The error shouldn't happen for less than 200 files. We're planning to raise the limit this week.

@rowild
Copy link
Contributor

rowild commented Aug 25, 2018

With example, do you mean a project at codesandbox that I should share?
https://codesandbox.io/s/lp2o446nrz
Please have a look into the folder "components" and try to open "jvds-main.vue".
It happens with any file.

@CompuIves
Copy link
Member

Oh wow, that's a different issue but totally shouldn't happen @rowild. I committed a fix for it and should be up today (1b241e6).

@rowild
Copy link
Contributor

rowild commented Aug 26, 2018

Wow! Thanks for reacting so quickly! But just to let you know: this also happens wit SCSS files. I added one.

(BTW: uploaded once on Firefox, once on Chrome [where I have some extensions like AdGuard]: same result. But realize another thing: codeSandbox does not update - which is ok -, but an update button the tree view would be awesome!)

@CompuIves
Copy link
Member

Oh man, I thought our zip implementation would've seen those as text files. A quick fix would be to add them to the list of forced text extensions (the ones defined here https://github.com/CompuIves/codesandbox-client/blob/master/packages/app/src/app/store/modules/files/actions.js#L70-L73). Would you be interested in adding it @rowild? Otherwise I can do it too.

@rowild
Copy link
Contributor

rowild commented Aug 26, 2018

Ha! You are challenging me! :-)
Ok, I gave it a try! If this is BS, please let me know how to improve!
Thank you!

BTW: Uploading to a folder is only possible, if the folder is opened. Uploads won't work if the folder is closed. This is somewhat irritating, since every folder has its own handle icons anyway. So: is this by design and intentional? If so, a warning message would be nice. And if not, please let me know, then I file a separat bug report.

@rowild
Copy link
Contributor

rowild commented Aug 26, 2018

Thanks! What about my questions though? The closed folder, the update button... Any info for me? ;-)

@CompuIves
Copy link
Member

What about my questions though? The closed folder, the update button... Any info for me? ;-)

Do you mean with this that we should auto open a folder if you hover long enough on it?

@rowild
Copy link
Contributor

rowild commented Aug 27, 2018

No, I think autoOpen on hover would yield a very stressful user experience. But the fact that you can only upload a file, when the folder is open, and not, when it is closed, should in some way be communicated to the user, IMO. Otherwise I assume: "Ah, each folder has its own upload button, cool! So I do not need to open the e.g. scss folder, instead I just click on the upload button, upload the file and it should be there."
Fact is, that the upload actually reacts to this user behavior and makes me believe the file was uploaded. But only after a manual check - by opening the scss folder - I see that it, in fact, was NOT uploaded.

There could be 3 solution:

  1. Make it possible to upload to a closed folder.
  2. Provide some sort of feedback, like: "Uploading to closed folder is forbidden".
  3. Hide the upload button, as long as the folder is closed.

Currently I would dare to say that "just making it possible" would be the easiest solution, implementation-wise and user-experience-wise... but I have really waaaaay too little experience with such a huge project like yours!

(And also an update button, the refreshed the list of files, would be great!)

CompuIves pushed a commit that referenced this issue Aug 28, 2018
…s. (#1056)

<!-- Is it a Bug fix, feature, docs update, ... -->
**What kind of change does this PR introduce?**
Add (le|sa|sc)ss and style files types to the list of forced text extensions.


<!-- You can also link to an open issue here -->
**What is the current behavior?**
#348 (comment)
When uploading(le|sa|sc)ss or styl (and probably other) files, and error message is thrown:

"This file is too big to edit
We will add support for this as soon as possible
Open file externally". 

It seems the zip implementation does not recognize them as text files. CompuIves recommends to add them to the list of forced text extensions.

Important: This happens only, when such files are *uploaded*! (creating such files within the editor works fine.)

<!-- if this is a feature change -->
**What is the new behavior?**
On upload, recognize more file types. (Again: on *upload*!)

<!-- Have you done all of these things?  -->
**Checklist**:
<!-- add "N/A" to the end of each line that's irrelevant to your changes -->
<!-- to check an item, place an "x" in the box like so: "- [x] Documentation" -->
- [ ] Documentation N/A
- [ ] Tests
- [ ] Ready to be merged <!-- In your opinion, is this ready to be merged as soon as it's reviewed? -->
- [ ] Added myself to contributors table <!-- this is optional, see the contributing guidelines for instructions -->

<!-- feel free to add additional comments -->
I do this upon being challenged by compulves (see link above) to contribute.

<!-- Thank you for contributing! -->
@github-actions
Copy link

github-actions bot commented Sep 4, 2020

This issue is stale because it has been open many days with no activity. It will be closed soon unless the stale label is removed or a comment is made.

@github-actions github-actions bot added the stale label Sep 4, 2020
@github-actions
Copy link

github-actions bot commented Oct 3, 2020

This issue has been automatically closed because there wasn't any activity after the previous notice or the stale label wasn't removed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

6 participants