Skip to content

Conversation

tpae
Copy link
Contributor

@tpae tpae commented Sep 26, 2025

swift-transformers recently updated to 1.0.0, and it's a big milestone for swift LLM.

I was able to verify it's working with these changes.

Before:

Okay, I'm going to to explain quantum computing in simple terms... Let me explain quantum computing in simple terms. Let me in simple terms.. Let me in simple terms. Let me in simple terms.. Let me in simple terms.. Let me in simple terms. Let me in simple terms. Let me in simple terms. Let me in simple terms. Let me------
Prompt:     20 tokens, 799.295665 tokens/s
Generation: 100 tokens, 162.527369 tokens/s, 0.615281s
Program ended with exit code: 0

After:

Okay, I'll explain this in simple terms. Let me explain this in simple terms... Let me explain this in simple terms. Let me explain this in simple terms. Let me explain this in simple terms. Let me explain this in simple terms. Let me explain this in simple terms. Let me explain this in simple terms. Let me explain this in simple terms.. Let me explain this in------
Prompt:     20 tokens, 880.938844 tokens/s
Generation: 100 tokens, 156.042275 tokens/s, 0.640852s
Program ended with exit code: 0

@tpae
Copy link
Contributor Author

tpae commented Sep 26, 2025

@davidkoski would be great if this could get merged 🙏

Copy link
Collaborator

@davidkoski davidkoski left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great, thank you!

@davidkoski davidkoski merged commit 1a16bc3 into ml-explore:main Sep 26, 2025
4 checks passed
@tpae
Copy link
Contributor Author

tpae commented Sep 29, 2025

Hi @davidkoski , any chance we could publish a new tag? 🙏

@davidkoski
Copy link
Collaborator

Good idea! 2.25.8 is cut

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants