You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
RemoveIdentityOps seems to be broken if the identity operation directly follows a fork-node. It seemingly rewires the fork-node output only into that branch containing the identity op, disconnecting the others. Currently this happens when using packed input projections in multi-head scaled dot-product attention. I will try to fix this soon, probably only requires an additional test added to the remove_node_and_rewire utility function.
The text was updated successfully, but these errors were encountered:
This problem reported over at FINN belongs here, see Xilinx/finn#878 (comment).
RemoveIdentityOps
seems to be broken if the identity operation directly follows a fork-node. It seemingly rewires the fork-node output only into that branch containing the identity op, disconnecting the others. Currently this happens when using packed input projections in multi-head scaled dot-product attention. I will try to fix this soon, probably only requires an additional test added to theremove_node_and_rewire
utility function.The text was updated successfully, but these errors were encountered: