-
Notifications
You must be signed in to change notification settings - Fork 6.8k
CUDA: an illegal memory access was encountered on hybridized yolo model #18834
Comments
@stu1130 could you help verify if this still happens with the master branch? |
@szha sure but when I build mxnet from source I ran into the error.
This is the command I used.
|
@stu1130 how about installing patchelf? Just run |
@leezu thanks! It works |
It seems gluoncv 0.7 doesn't work with mxnet 2.0. Is the gluoncv 0.7 the latest version I can get?
|
That is surprising as I can still import nd from a build on the master branch. |
@szha I have same issue in my code. After I turned |
@troyliu0105 it just means that you managed to corrupt your python profile. Try uninstalling all mxnet packages (you probably have multiple insatlled?) and installing again |
@leezu actually, I created different anaconda env and duplicated source code directory for each build. So, I think they are isolated. |
Sorry, but as you experience the issue of importing, it means that your environment is broken. You can try using |
@leezu 😂,that's not the issue I encountered. I think you confused me with the one opened this issue. |
Ok. I thought you talk about the |
@szha I build the most recently master branch. cuz gluoncv is not compatible with mxnet 2.0 (can't pass version assert), so I use previous exported weight to test like below: from gluoncv import model_zoo, data, utils
from matplotlib import pyplot as plt
import mxnet as mx
from mxnet import gluon
deserialized_net = gluon.nn.SymbolBlock.imports("yolo-symbol.json", ['data'], "yolo-0000.params", ctx=mx.gpu())
image = mx.nd.random.normal(shape=(1, 3, 1000, 1000), ctx=mx.gpu())
print(deserialized_net(image)) |
Any updates ? Got the same problem for mxnet 1.7. |
@waytrue17 and I also had this issue with mxnet 1.7 |
I can confirm that the issue only occurs at |
This issue still exists in mxnet-cu102==1.8.0.post0, mxnet-cu102==1.7.0.post1, It is OK with mxnet-cu102==1.6.0.post0 |
Step to reproduce
It works fine when I use CPU or mxnet-cu101 1.6 pip wheel
The text was updated successfully, but these errors were encountered: