Title unparseable index at http://mirror.bjtu.edu.cn/tdf/
Priority bug Status in-progress
Superseder Nosy List floeff, poeml
Assigned To poeml Keywords
msg404 (view) Author: floeff Date: 2012-07-20.16:29:28
It seems that http://mirror.bjtu.edu.cn/tdf/ changed their layout, resulting in
the following error message:
mirror.bjtu.edu.cn: unparseable HTML index in
msg491 (view) Author: poeml Date: 2014-01-31.00:02:03
I suggest a workaround:
Use rsync://mirror.bjtu.edu.cn/tdf/ for scanning, which should give better
results and should also be more efficient in general.
msg492 (view) Author: poeml Date: 2014-01-31.00:04:07
There's CSS in front of the HTML which contains
<style type="text/css"> table { border: none; ...
The "table" confuses the scanner, because that's what it looks for.
msg493 (view) Author: poeml Date: 2014-01-31.00:31:06
Or rather, it's a directory listing sent by nginx, and locally styled.
I'm a bit reluctant to adjust the existing parser for nginx directory listings
to this listing. I'm not sure if it's worth the effort, if it's only about this
mirror, for which the scanning can be done via rsync in a much more reliable way.
msg494 (view) Author: poeml Date: 2014-01-31.00:37:38
Sigh, rsync times out, when attempting a scan... there's also FTP, however, the
tdf directory is empty through that channel:
ftp://mirror.bjtu.edu.cn/mirror/tdf/
Too bad.
msg500 (view) Author: floeff Date: 2014-01-31.08:38:00
Your call ;-)
I think you have a valid point with fixing for only one mirror doesn't make
sense, yep, I agree.
History
Date User Action Args
2014-01-31 08:38:00 floeff set messages: + msg500
2014-01-31 00:37:38 poeml set messages: + msg494
2014-01-31 00:31:06 poeml set messages: + msg493
2014-01-31 00:04:07 poeml set messages: + msg492
2014-01-31 00:02:03 poeml set messages: + msg491
2013-01-31 22:03:03 poeml set assignedto: poeml
nosy: + poeml
2013-01-31 22:02:58 poeml set status: unread -> in-progress
2012-07-20 16:29:28 floeff create
(end of migrated issue)
Issue migrated (2015-06-05) from old issue tracker http://mirrorbrain.org/issues/issue115
msg404 (view) Author: floeff Date: 2012-07-20.16:29:28
It seems that http://mirror.bjtu.edu.cn/tdf/ changed their layout, resulting in
the following error message:
mirror.bjtu.edu.cn: unparseable HTML index in
msg491 (view) Author: poeml Date: 2014-01-31.00:02:03
I suggest a workaround:
Use rsync://mirror.bjtu.edu.cn/tdf/ for scanning, which should give better
results and should also be more efficient in general.
msg492 (view) Author: poeml Date: 2014-01-31.00:04:07
There's CSS in front of the HTML which contains
<style type="text/css"> table { border: none; ...
The "table" confuses the scanner, because that's what it looks for.
msg493 (view) Author: poeml Date: 2014-01-31.00:31:06
Or rather, it's a directory listing sent by nginx, and locally styled.
I'm a bit reluctant to adjust the existing parser for nginx directory listings
to this listing. I'm not sure if it's worth the effort, if it's only about this
mirror, for which the scanning can be done via rsync in a much more reliable way.
msg494 (view) Author: poeml Date: 2014-01-31.00:37:38
Sigh, rsync times out, when attempting a scan... there's also FTP, however, the
tdf directory is empty through that channel:
ftp://mirror.bjtu.edu.cn/mirror/tdf/
Too bad.
msg500 (view) Author: floeff Date: 2014-01-31.08:38:00
Your call ;-)
I think you have a valid point with fixing for only one mirror doesn't make
sense, yep, I agree.
(end of migrated issue)