Skip to content

Commit c299d16

Browse files
committed
examples: graph: fixup
1 parent 80aeeff commit c299d16

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

examples/graph/gqa.cpp

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -156,6 +156,7 @@ void bench_gqa(engine::kind ekind, logical_tensor::data_type dt,
156156
auto probs = logical_tensor(id++, dt, score_sz, layout_type::strided);
157157
auto softmax = op(id++, op::kind::SoftMax, "softmax");
158158
softmax.set_attr<int64_t>(op::attr::axis, -1);
159+
softmax.set_attr<std::string>(op::attr::mode, "inf_as_zero");
159160
softmax.add_inputs({masked_score});
160161
softmax.add_outputs({probs});
161162

0 commit comments

Comments
 (0)