Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove/adjust index size limit of 100 files #9

Closed
jrieken opened this issue Nov 8, 2021 · 3 comments
Closed

Remove/adjust index size limit of 100 files #9

jrieken opened this issue Nov 8, 2021 · 3 comments
Assignees
Labels
feature-request Request for new features or functionality on-testplan
Milestone

Comments

@jrieken
Copy link
Member

jrieken commented Nov 8, 2021

By default we cap the file index at 100 files. This is done for performance reasons and to prevent GH.com load. Tho, when using anycode together with remotehub (which is the likely case) we have a tar-based file system. We should make sure that's always used for anycode and remove the file limit. We should also investigate in other fs perf tricks

@JacksonKearl
Copy link

Next release of remotehub will have an option to auto-download repos when the size is less than a given amount, that should resolve this.

@JacksonKearl
Copy link

Next release of RemoteHub will download tars by default. I think we should not download additional files when the user has explicitly opted out of indexing, either a) their network is very poor and hammering it with network requests would be ill-advised or b) the repo is very large and downloading some fixed 100 files is likely of little use.

@jrieken
Copy link
Member Author

jrieken commented Feb 21, 2022

Closing, we are good on this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature-request Request for new features or functionality on-testplan
Projects
None yet
Development

No branches or pull requests

2 participants