Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix intermittent CUDA activity flush issue #95

Closed
wants to merge 1 commit into from

Commits on Feb 28, 2021

  1. Fix intermittent CUDA activity flush issue

    Summary:
    We recently observed that no Cuda activities appears in libkineto traces for certain setups.
    The issue is that cuptiActivityFlushAll sometimes produces no buffers.
    Setting the CUPTI_ACTIVITY_FLAG_FLUSH_FORCED appears to give us consistent results.
    
    We're still figuring out which setups are affected.
    
    Differential Revision: D26717258
    
    fbshipit-source-id: ac3f39841de1f64d7800393f2bad5d105897a708
    gdankel authored and facebook-github-bot committed Feb 28, 2021
    Copy the full SHA
    5257665 View commit details
    Browse the repository at this point in the history