Skip to content

OpenVINO EP fails to run models with in-memory external data #25304

Open
@shiyi9801

Description

@shiyi9801

As issue#24768 Native WebGPU EP fails to run model with in-memory external data stated:

For models that are built by ModelEditorAPI, they may have initializers that are TensorProto with external data in existing memory buffer. For those TensorProto, the 'location' field of the external data info is set to a special marker /ORT_MEM_ADDR/, and the 'offset' field contains the address of the memory buffer.

Similar to this issue, the OpenVINO EP doesn't support the external data in memory buffer for TensorProto either. When trying to run a model with in-memory external data, an error will be thrown during session creation:

ORT status error code: 6 error message: Exception during initialization: D:\a_work\1\s\WCRforIntel\win-onnxruntime\onnxruntime\core\providers\openvino\backend_manager.cc:189 __cdecl onnxruntime::openvino_ep::BackendManager::BackendManager(struct onnxruntime::openvino_ep::SessionContext &,class onnxruntime::openvino_ep::SharedContext &,const struct onnxruntime::Node &,const class onnxruntime::GraphViewer &,const struct onnxruntime::logging::Logger &,class onnxruntime::openvino_ep::EPCtxHandler &) D:\a_work\1\s\WCRforIntel\win-onnxruntime\onnxruntime\core\providers\openvino\ov_interface.cc:81 class std::shared_ptr __cdecl onnxruntime::openvino_ep::OVCore::ReadModel(class std::basic_string<char,struct std::char_traits,class std::allocator > &&,const class std::basic_string<char,struct std::char_traits,class std::allocator > &) [OpenVINO-EP] [OpenVINO-EP] Exception while Reading network: invalid external data: ExternalDataInfo(data_full_path: /ORT_MEM_ADDR/, offset: 91998230694912, data_length: 2048)

Metadata

Metadata

Assignees

Labels

ep:OpenVINOissues related to OpenVINO execution providerep:WebGPUort-web webgpu providerplatform:webissues related to ONNX Runtime web; typically submitted using template

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions