Inference Time

[bharatsubedi]

I tried your network and got a good result but I faced the problem of inference speed. could you please let me know I can increase the speed of recognition?

[simplify23]

Compared with the parallel attention mechanism, our method has no advantage in inference speed, but it is not far behind the traditional encoder-decoder method. If speed of reasoning is required, try decoding 2-3 characters at one timestep, or distil a CTC student network. We plan to design a rapid inference version of CDistNet V2 later.

[bharatsubedi]

changed the network structure and got faster inferencing time now.
Thank you very much.

[WongVi]

Compared with the parallel attention mechanism, our method has no advantage in inference speed, but it is not far behind the traditional encoder-decoder method. If speed of reasoning is required, try decoding 2-3 characters at one timestep, or distil a CTC student network. We plan to design a rapid inference version of CDistNet V2 later.

waiting rapid version