You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am reading the description of the enqueueV3 function, it states
Modifying or releasing memory that has been registered for the tensors before stream
synchronization or the event passed to setInputConsumedEvent has been being triggered results in undefined
behavior
Does that mean that after I preprocess my data, making it ready for the inference, I have to invoke cudaStreamSynchronize before I call enqueueV3?
I expect that I need no synchronization because all the preprocessing followed by inference is done asynchronously on the same cudaStream_t, however I just wanted to make sure that my understanding is correct and there will be no undefined behavior if I have no synchronization in this case
P.S. I am aware that I would need to cudaStreamSynchronize after inference before I move data to host and get results
The text was updated successfully, but these errors were encountered:
I am reading the description of the enqueueV3 function, it states
Does that mean that after I preprocess my data, making it ready for the inference, I have to invoke cudaStreamSynchronize before I call enqueueV3?
I expect that I need no synchronization because all the preprocessing followed by inference is done asynchronously on the same cudaStream_t, however I just wanted to make sure that my understanding is correct and there will be no undefined behavior if I have no synchronization in this case
P.S. I am aware that I would need to cudaStreamSynchronize after inference before I move data to host and get results
The text was updated successfully, but these errors were encountered: