Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Share cache loader] Долгий старт при наличии в шаре каталога с 67 тыс мелкими файлами #1045

Open
pavel-pimenov opened this issue Aug 24, 2015 · 5 comments

Comments

@pavel-pimenov
Copy link
Owner

commented Aug 24, 2015

From Pavel.Pimenov@gmail.com on April 25, 2013 04:48:53

[2013-04-25 06:33:59] [Start] [Share cache loader]
[2013-04-25 06:33:59] [Step ] [Share cache loader] read and uncompress D:\FlylinkDC++ r500 -beta-last\Settings\files.xml.bz2 done [6 ms]
[2013-04-25 06:41:13] [Step ] [Share cache loader] parse xml done [433901 ms]
[2013-04-25 06:41:15] [Step ] [Share cache loader] update index done [2182 ms]
[2013-04-25 06:41:15] [Stop ] [Share cache loader] [17 ms, Total: 436106 ms]

436 сек! на i7
Разобраться с этим Share cache loader
зачем он открывается и парсится при старте.

мой файл в аттаче

Attachment: files.xml.bz2

Original issue: http://code.google.com/p/flylinkdc/issues/detail?id=1008

@pavel-pimenov

This comment has been minimized.

Copy link
Owner Author

commented Aug 24, 2015

From tret2...@gmail.com on April 25, 2013 01:29:28

[2013-04-25 15:26:25] [Start] [Share cache loader]
[2013-04-25 15:26:25] [Step ] [Share cache loader] read and uncompress C:\VC9\google\r5xx\compiled\Settings\files.xml.bz2 done [1 ms]
[2013-04-25 15:26:28] [Step ] [Share cache loader] parse xml done [3390 ms]
[2013-04-25 15:26:28] [Step ] [Share cache loader] update index done [1 ms]
[2013-04-25 15:26:28] [Stop ] [Share cache loader] [1 ms, Total: 3393 ms]

у меня 3 секунды парсил

@pavel-pimenov

This comment has been minimized.

Copy link
Owner Author

commented Aug 24, 2015

From Pavel.Pimenov@gmail.com on April 25, 2013 01:47:19

Странно. именно мой файл подсовывал?

@pavel-pimenov

This comment has been minimized.

Copy link
Owner Author

commented Aug 24, 2015

From a.rain...@gmail.com on April 25, 2013 06:29:56

Вообще старнно это, ибо у меня более 450 тыс. файлов в шаре сейчас, да процесс импорта не быстр, но уж точно не 436106 ms, несколько секунд не более.

@pavel-pimenov

This comment has been minimized.

Copy link
Owner Author

commented Aug 24, 2015

From Pavel.Pimenov@gmail.com on April 25, 2013 08:24:00

Вложил лог открытия файла через монитор

Attachment: issue-1008-monitor-open-file.png

@pavel-pimenov

This comment has been minimized.

Copy link
Owner Author

commented Aug 24, 2015

From mike.kor...@gmail.com on May 03, 2013 15:18:50

Около 430000 файлов 77бета открывает намного быстрее (меньше минуты) при том, что еще не все прохешировано. Фрагментацию файлов проверяли ? Архивов, базы и системного лога, может быть до 10000 фрагментов.
-=[ FlylinkDC++ r502 -beta77-x64 build 13794 Compiled on: 2013-05-02 ]=-
-=[ Uptime: 0:04:27. Cpu time: 0:03:20 ]=-
-=[ Memory usage (peak): 689,92 МБ (734,64 МБ). Virtual (peak): 692,92 МБ (717,30 МБ) ]=-
-=[ Files in share: 360259. Total users: 44596 on hubs: 18 ]=-
-=[ Downloaded: 2,33 МБ. Uploaded: 146,36 кБ ]=-
-=[ Total download: 0 Б. Total upload: 173,02 ГБ ]=-
-=[ CPU Clock: 2912,7 MHz ]=-

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
1 participant
You can’t perform that action at this time.