v0.8.0

What's Changed

• optional colored logs and speculative decoding by @IlyasMoutawwakil in #7
• revert by @IlyasMoutawwakil in #8

Full Changelog: v0.7.0...v0.8.0

v0.7.0

What's Changed

• Updates for TGI 2.0 by @IlyasMoutawwakil in #6

Full Changelog: v0.6.0...v0.7.0

v0.6.0

What's Changed

• Added semaphores and event loop management by @IlyasMoutawwakil in #4

Full Changelog: v0.5.0...v0.6.0

v0.5.0

What's Changed

TEI + TGI, dataclass configs, asyncio instead of threads

• refacored + syncio by @IlyasMoutawwakil in #3

Full Changelog: v0.2.0...v0.5.0

v0.2.0

What's Changed

• Text embedding inference by @IlyasMoutawwakil in #2

Full Changelog: v0.1.3...v0.2.0

v0.1.3

What's Changed

• Rocm and custom devices support
• PyPI at https://pypi.org/project/py-tgi/

v0.1.2

• CI testing on Ubuntu (cpu only).
• vLLM like interface.
• PyPI release 🥳