Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increase the limit of sentences downloaded from a list #927

Open
RyckRichards opened this issue Nov 16, 2015 · 7 comments

Comments

Projects
None yet
4 participants
@RyckRichards
Copy link
Member

commented Nov 16, 2015

By PaulP - https://tatoeba.org/eng/wall/show_message/24895#message_24895

The download feature has been disabled for this list because it contains X sentences. Only lists containing 100 or fewer sentences can be downloaded. If you can edit the list, you may want to split it into multiple lists.

Is there an easy way to do this, other than deleting the sentences one by one?

@RyckRichards

This comment has been minimized.

Copy link
Member Author

commented Nov 16, 2015

+1
It would help a lot - even more students.

@ckjpn

This comment has been minimized.

Copy link

commented Jan 3, 2016

If the main reason this is limited to 100 sentences is to lower the load, then perhaps you could allow downloading the whole list if it's just the sentences without linked translations, but only limit the download if it requires linking to another language.

Also, perhaps create the option to allow people to download the complete list as numbers only without translations. I have found there are times I wish I could do this rather than wait for the weekly exports to get this information. Maybe this wouldn't put too much load on the system.

@ckjpn

This comment has been minimized.

Copy link

commented Feb 21, 2016

Another possibility is to allow downloading the complete list incrementally, sort of like you get it if you browse the pages.

Download the first 100.
Download the second 100. (201-300)
Download the third 100. (301-400)
etc.

@RyckRichards RyckRichards self-assigned this Feb 24, 2016

@RyckRichards

This comment has been minimized.

Copy link
Member Author

commented Feb 24, 2016

Paul says that he use the lists he create to study. After creating a list, he exports them to his phone which he can easily study and as far that it's only possible to download lists which have 100 entries, he have to chop them into many other lists which demand too much time and effort.

@trang

This comment has been minimized.

Copy link
Member

commented Feb 25, 2016

How many sentences does Paul have in his lists?

@RyckRichards

This comment has been minimized.

Copy link
Member Author

commented Feb 25, 2016

@jiru

This comment has been minimized.

Copy link
Member

commented Feb 27, 2016

For the record, I think it’s possible increase the limit tremendously without significantly increasing the server load, by using the following approach:

  • In the controller method:
    • Increase the PHP script timeout
    • Get sentences using successive paged queries (to avoid filling up RAM)
    • Output the CSV already, instead of passing data to the view (necessary because of paged results)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.