Simplify backward when inserting a sum operator to accumulate all duplicated variables #4703
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Since
sum_op
is used instead ofadd_op
, and it supports to accumulate a vector of variables at one time, we do not need to insert multiplesum_op
to add those inputs one by one. Just add all inputs in onesum_op
.I make a simple test based on
interp_op
. See diff ofinterp_op
:The
DebugString
ofinterp_op
:The
DebugString
ofinterp_grad_op
in previous implementation:The
DebugString
ofinterp_grad_op
in this PR: