Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Прикрутить json streamer #25

Closed
navolotsky opened this issue Nov 14, 2018 · 1 comment · Fixed by #29
Closed

Прикрутить json streamer #25

navolotsky opened this issue Nov 14, 2018 · 1 comment · Fixed by #29
Labels
priority/normal Normal issue priority type/code maintenance New feature/requirement that focuses on improving architecture, realization and code style
Projects
Веб-краулер
Milestone
Итерация 21.10.20...

Comments

@navolotsky
Copy link
Member

Code maintenance request

Опишите проблему, которая приводит к необходимости этих изменений

При сборке редакций кодексов накапливаются большие объемы данных. Настолько большие, что считать их в память за раз невозможно. Нужно обрабатывать json потоково.
@navolotsky navolotsky added type/code maintenance New feature/requirement that focuses on improving architecture, realization and code style priority/normal Normal issue priority labels Nov 14, 2018
@navolotsky navolotsky added this to the просто камень milestone Nov 14, 2018
@navolotsky navolotsky added this to To do in Веб-краулер via automation Nov 14, 2018
@navolotsky
Copy link
Member Author

Возможно, в будущем это не потребуется. Пока что заменил запись в json файл на запись отдельными строками в json корректном формате.

@Rexarrior Rexarrior mentioned this issue Nov 26, 2018
Merged
Веб-краулер automation moved this from To do to Done Dec 3, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
priority/normal Normal issue priority type/code maintenance New feature/requirement that focuses on improving architecture, realization and code style
Projects
Веб-краулер
  
Done
Milestone
Итерация 21.10.2018 — 05.12.2018
Development

Successfully merging a pull request may close this issue.

Refactoring robot-lab/judyst-web-crawler
2 participants
@Vasar007 @navolotsky