Skip to content

ORT raises node "does not have type information set by parent node" for initializers declared in outer graph #24880

New issue
New issue
Open
#25068
Open
ORT raises node "does not have type information set by parent node" for initializers declared in outer graph#24880
#25068
Assignees
copilot-swe-agent
Labels
core runtimeissues related to core runtimemodel:transformerissues related to a transformer model: BERT, GPT2, Hugging Face, Longformer, T5, etc.
@justinchuby

Description

@justinchuby
justinchuby
opened on May 28, 2025

Describe the issue

Checked in

onnxruntime/onnxruntime/core/graph/graph.cc

Line 2843 in f8c1393

if (is_outer_scope_nodearg(input_def->Name()))
and manifested in

onnxruntime/onnxruntime/python/tools/transformers/convert_generation.py

Lines 1077 to 1081 in f8c1393

# Add type info, otherwise ORT will raise error: "input arg (*) does not have type information set by parent node."
for initializer in moved_initializers:
shape = onnx.numpy_helper.to_array(initializer).shape
value_info = onnx.helper.make_tensor_value_info(initializer.name, initializer.data_type, shape)
graph.value_info.append(value_info)

is_outer_scope_nodearg doesn't seem to return true when the node input is an initializer defined in the outer graph (w/o having a value_info proto in the subgraph).

To reproduce

Produce a node with a subgraph that references an outer graph, and do not create a value_info for the initializer in the subgraph.

The node I observed was from

Urgency

No response

Platform

Linux

OS Version

N/A

ONNX Runtime Installation

Released Package

ONNX Runtime Version or Commit ID

1.22

ONNX Runtime API

Python

Architecture

X64

Execution Provider

Default CPU

Execution Provider Library Version

No response

Metadata

Metadata

Assignees

Labels

core runtimeissues related to core runtimemodel:transformerissues related to a transformer model: BERT, GPT2, Hugging Face, Longformer, T5, etc.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions