Show scopes for operations

[saar-eliad]

Hi,
A key feature we are looking but is currently missing is showing scopes for operations (like the tensorflow profiler).

Example:

empty_

vs.

SequentialModel/layers[2]/Attention/empty_

And we want the 2nd option.
(with the 2nd option, getting combined statistics for all occurrences of empty_ could be done by grouping)

According to the Pytorch API, using with_stack=True would only record file and line numbers.
Unfortunately, file and line numbers is still confusing since we can have both

• SequentialModel/layers[2]/Attention/empty_
• SequentialModel/layers[3]/SomeModelWithAttention/Attention/empty_

which would point to the same place in code.

[nbcsm]

Thanks for the feedback.
We will take this into consideration for future releases.
@ilia-cher for awareness.

[gaoteng-git]

@saar-eliad Our latest tensorboard plugin support grouping-by operators with same call-stacks as key.

[ilia-cher]

@bitfort Victor, I think that work on surfacing layer names could help here