Skip to content

test_generative_with_contextual_session fails intermittently #121

@jakelorocco

Description

@jakelorocco

The structured output appears to be failing / generating an empty string.

___________________ test_generative_with_contextual_session ____________________

model_id = ModelIdentifier(hf_model_name='unsloth/Llama-3.2-1B', ollama_name='llama3.2:1b', watsonx_name=None, mlx_name=None, hf_tokenizer_name=None)

    def test_generative_with_contextual_session(model_id):
        """Test generative slots work with contextual sessions."""
        with start_session(model_id=model_id):
            # Test without explicit session parameter
            result = classify_sentiment(text="I love this!")
            assert result in ["positive", "negative"]
    
            # Test with summary generation
            summary = generate_summary(text="A short text about something interesting.")
            assert isinstance(summary, str)
>           assert len(summary) > 0
E           AssertionError: assert 0 > 0
E            +  where 0 = len('')

test/stdlib_basics/test_contextual_session.py:75: AssertionError

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workinggood first issueGood for newcomers

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions