Minor error on CTPN performance in your paper (page 11, table 2)

[jwnsu]

CTPN's performance on ICDAR 2013 dataset is F-measure 0.88 (R 0.83, P 0.93), not 0.822 in your paper (table 2 on page 11.) They published test model at https://github.com/tianzhi0549/CTPN (downloadable test model has F 0.86 on ICDAR 2013, which does not include side refinement feature described in the paper.)

CTPN does not handle angled text well, though. Their score on 2015 dataset is quite low.

[xhzdeng]

Hi, @jwnsu . Thanks for your reading and pointing out this issue. Firstly, all of results which reported in my paper are evaluated under the ICDAR2013 standard. The paper of CTPN didn't show their performance on this evalutation. So I have to search it on http://rrc.cvc.uab.es/?ch=2&com=evaluation&task=1&f=1&e=1 by myself. If there is a mistake, I will modify it ASAP. ^_^

[jwnsu]

@xhzdeng thx for the info. It's better to take the performance result from their published paper, as the benchmark report website was not necessarily the result of their final model. If you check the discussions at their github issues area, F 0.86 (without the side refinement) was reproduced by other teams, training from scratch, which is a strong evidence of F 0.88 (with side refinement) reported in the paper.

[xhzdeng]

@jwnsu Different evaluations will result in different results, you can see it on the ICDAR2013 leaderboard. Besides, the 0.82 performance is also reported in https://arxiv.org/pdf/1709.00138.pdf which is another novel work from the CTPN team. ^_^

[jwnsu]

ok, perhaps adds a few words in your paper to mark it as ICDAR 2013 standard? I'm closing the issue.