You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
How do you use ByteSize()? Maybe we can implement a function which returns the result you build with it. I don't think protobuf will update its API since it is not meant to support models bigger than 2Gb.
The other option is to export the model with external weights enabled. A new API https://onnx.ai/onnx/api/model_container.html was introduced to make it easier to build such model with external weights without serialization of the weights. That would be the direction I would recommend.
System Info
Who can help?
No response
Information
Tasks
examples
folder (such as GLUE/SQuAD, ...)Reproduction (minimal, reproducible, runnable)
run the following command:
python -m optimum.exporters.onnx -m microsoft/phi-2 --library-name transformers .
The following errors will be raised.
![image](https://private-user-images.githubusercontent.com/817030/296148743-2cc28d5a-1f65-4b11-bb6a-72339d9d6575.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk3NDg1ODMsIm5iZiI6MTcxOTc0ODI4MywicGF0aCI6Ii84MTcwMzAvMjk2MTQ4NzQzLTJjYzI4ZDVhLTFmNjUtNGIxMS1iYjZhLTcyMzM5ZDlkNjU3NS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNjMwJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDYzMFQxMTUxMjNaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT04MDllMmUxZTdmNTZmZmJhNTBkN2VkODNkZTBkN2QxZjNmZDQ2YjNmMzM0YTJkZDMyZTk3NmQxZWQwM2ZlYWU3JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.qZufjYcnWlrlPkx8oa614PH082sauAV8TzoE93fAayA)
I made one line print in graph_transformations.py.
![image](https://private-user-images.githubusercontent.com/817030/296148829-e3266b8c-f6b0-4473-980d-d84dcac64f2b.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk3NDg1ODMsIm5iZiI6MTcxOTc0ODI4MywicGF0aCI6Ii84MTcwMzAvMjk2MTQ4ODI5LWUzMjY2YjhjLWY2YjAtNDQ3My05ODBkLWQ4NGRjYWM2NGYyYi5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNjMwJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDYzMFQxMTUxMjNaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT0wZmRiZmU5YmI4YTAzZjUyYzUzNTIyMWM2NDcyMzc0ZTc1MDdkMmIxYTYzNmRlNTQ2NTg1Mzc2M2JjY2I1ODQ4JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.stDSrP9twE-zbjlF3ZPQXGoCUWQy2RwtlIknZuogmnM)
Expected behavior
We might need add the following checks?
![image](https://private-user-images.githubusercontent.com/817030/296149086-64f82851-fc3d-4c82-b689-6d5d414f0381.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk3NDg1ODMsIm5iZiI6MTcxOTc0ODI4MywicGF0aCI6Ii84MTcwMzAvMjk2MTQ5MDg2LTY0ZjgyODUxLWZjM2QtNGM4Mi1iNjg5LTZkNWQ0MTRmMDM4MS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNjMwJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDYzMFQxMTUxMjNaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1jNmYxZDI5YjRhNTRhOWZmM2UwYTFlNzI3ZWRhNThjN2MwOTMxOTM1MDE0ZjE1YTFkMDEzZTg0MzlmMmY3ODNiJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.9v_1STstfcVX-uGIke4u7R5u_Wr5-XIaz2KP9zd6AN8)
Just not sure why the model.ByteSizes() return -1765569341
The text was updated successfully, but these errors were encountered: