Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No graph trace in tensorboard when using @tf.function(jit_compile=True) #58263

Closed
yz-chen18 opened this issue Oct 22, 2022 · 5 comments
Closed
Assignees
Labels
comp:tensorboard Tensorboard related issues stale This label marks the issue/pr stale - to be closed automatically if no activity stat:awaiting response Status - Awaiting response from author TF 2.10 type:bug Bug

Comments

@yz-chen18
Copy link

yz-chen18 commented Oct 22, 2022

Click to expand!

Issue Type

Bug

Source

binary

Tensorflow Version

2.10.0

Custom Code

Yes

OS Platform and Distribution

No response

Mobile device

No response

Python version

No response

Bazel version

No response

GCC/Compiler version

No response

CUDA/cuDNN version

No response

GPU model and memory

No response

Current Behaviour?

I'm trying to trace a model inference. When I turn off jit_compile option, it works fine. However, when I turn it on, no inference graph appears on tensorboard. I wonder what might happen there. Thanks.

Standalone code to reproduce the issue

logdir = "./xla_dir"

input = np.random.rand(10,3,224,224).astype("float32")

@tf.function(jit_compile=True)
def inf(input):
    # tf_model is a resnet18 model imported from an onnx
    output = tf_model(input_1=input)
    return output

writer = tf.summary.create_file_writer(logdir)
tf.summary.trace_on(graph=True)

inf(input)
with writer.as_default():
    tf.summary.trace_export(
      name="my_func_trace",
      step=0,
      profiler_outdir=logdir)

Relevant log output

No response

@bhack
Copy link
Contributor

bhack commented Oct 22, 2022

I am also tracking the same at tensorflow/profiler#503

But the ownership of this issue is still not clear.

/cc @yatbear

@tilakrayal tilakrayal added TF 2.10 comp:tensorboard Tensorboard related issues labels Oct 26, 2022
@tilakrayal
Copy link
Contributor

@yz-chen18,
As mentioned above, Could you please track the issue tensorflow/profiler#503. Thank you!

@tilakrayal tilakrayal added the stat:awaiting response Status - Awaiting response from author label Oct 26, 2022
@bhack bhack self-assigned this Oct 26, 2022
@google-ml-butler
Copy link

This issue has been automatically marked as stale because it has no recent activity. It will be closed if no further activity occurs. Thank you.

@google-ml-butler google-ml-butler bot added the stale This label marks the issue/pr stale - to be closed automatically if no activity label Nov 2, 2022
@google-ml-butler
Copy link

Closing as stale. Please reopen if you'd like to work on this further.

@google-ml-butler
Copy link

Are you satisfied with the resolution of your issue?
Yes
No

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp:tensorboard Tensorboard related issues stale This label marks the issue/pr stale - to be closed automatically if no activity stat:awaiting response Status - Awaiting response from author TF 2.10 type:bug Bug
Projects
None yet
Development

No branches or pull requests

3 participants