breaking api change on 0.5.2 -> 0.7.0

[natke]

Discussed in #1400

^{Originally posted by dsslight April 15, 2025}
hi guys,
I faced with the issue - I'm doing like specified I the test below

onnxruntime-genai/test/python/test_onnxruntime_genai_api.py

Line 269 in b47b4e7

def test_batching(device, phi2_for):

        while not generator.is_done():
            generator.generate_next_token()
        
        new_token = generator.get_sequence(0)

and in this new token I see prompt tokens only (I decoded and saw what the content), I don't see response. Please recommend how to get it and what I'm doing wrong?

[dsslight]

screenshorts also here

#1401

[dsslight]

are there any updates?