ReLu function max(0,a) gives 0

[jeromecy]

Using Ladybug pic as an example, the ReLU function after the top one layer (orange colour) gives 0 when the max value is not zero. For example, I got max(0,0.64)=0. Should it be 0.64? Thank you.

[xiaohk]

Hello @jeromecy, thanks for reaching out to us!

In which ReLU layer did you see the max(0, 0.64)=0 case?

I am looking at the relu_2_2 layer for the laydybug pic and it looks correct.

[jeromecy]

Hi @xiaohk , many thanks for the reply. I apologies that it was my bad. The negative sign is too small on my screen, and I didn't notice it. After zooming in, I can see it clearly. Thank you so much!

[xiaohk]

Hey @jeromecy, you should not apologize! It's a legit usability issue, and we should apologize for the confusion. Thanks again for raising the issue so we can improve the design!

In b9c1759 I changed the original - sign (Hyphen-Minus) to a longer － sign (Fullwidth Hyphen-Minus). I hope it can help. Below is a before and after comparison.