Skip to content

No response is visible from Phi Silica #5499

Closed
@Tracy-P

Description

@Tracy-P

Describe the bug

On my device I installed the AI Dev Gallery. Click the Generate button and nothing appears. It shows Tokens were created.
ASUS Zenbook S 16 UM5606WA. It has an AMD Ryzen AI 9 365 w/ Radeon 880M processor.

Steps to reproduce the bug

On my ASUS Zenbook S 16 UM5606WA. It has an AMD Ryzen AI 9 365 w/ Radeon 880M processor.
I installed the AI Dev Gallery via winget.
In in the Windows AI APIs I selected Phi Silica and Text Generation. Pre loaded there is the Tell me a fun fact about space.. I click Generate. I see the quick blip on the NPU in Task Manager and note that tokens per seconds in the bottom right of that area updates each time I click Generate.
No text appears under the input, and above the tokens per second.

I have VS 2022 installed, I exported the sample with the Export Sample button. I added a count, and put a breakpoint in the code that retrieves the data from the SLM. (GenerateResponseAsync...Progress)
The count only shows 1 and the variable delta is always blank.

        var operation = _languageModel.GenerateResponseAsync(prompt);
        int counts = 0;
        operation.Progress = (asyncInfo, delta) =>
        {
            DispatcherQueue.TryEnqueue(() =>
            {
                if (_isProgressVisible)
                {
                    StopBtn.Visibility = Visibility.Visible;
                    IsProgressVisible = false;
                }
                counts++;
                GenerateTextBlock.Text += delta; // BreakPoint
                if (_cts?.IsCancellationRequested == true)
                {
                    operation.Cancel();
                }
            });
        };

        var result = await operation;

        StopBtn.Visibility = Visibility.Collapsed; // BreakPoint

Expected behavior

Some text should be generated and displayed under the textbox.

Screenshots

Image

Image

Image

NuGet package version

None

Packaging type

No response

Windows version

Windows 11 version 24H2 (22621, October 2024 Update)

IDE

Visual Studio 2022

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions