Skip to content

Releases: aychang95/fastnn

0.4.0

01 Nov 21:07
Compare
Choose a tag to compare

What's Changed

Added text generation

Full Changelog: v0.3.0...0.4.0

0.3.0 Release

27 Oct 12:08
18cc476
Compare
Choose a tag to compare

What's Changed

Major dependency updates.

Official support python3.7.10-3.11.

Added sentence-transformers as dependency

Full Changelog: 0.2.0...v0.3.0

v0.2.0 Release Updates

14 Feb 01:41
c1d67c0
Compare
Choose a tag to compare

Haven't released in a while.

Update and organize dependencies within extras. FastNN main dependencies are transformers, pytorch, and triton client.

Update documentation and replace mkautodocs(archive-mode) with mkdocstrings.

Update triton version and image versions.

Added github publish workflow.

Initial 0.1.0 Release of FastNN

03 Dec 07:37
Compare
Choose a tag to compare

A small release for a fun little project with more to come.

For this initial release you can refer to the README and at https://andrewchang.dev/fastnn

But here are some of the features this includes:

  • Data Processing
    • Intuitive data processing modules for encoding human-readible data into tensors compatible with deep learning libraries
  • Model Exporting
    • FastNN torch modules and tools for exporting models via. TorchScript tracing and scripting to a production environment
  • Model Zoo
    • Various exported models hosted in this repo via. git-lfs and AWS S3. Includes models from the HuggingFace's Transformers and
      TorchVision
  • Model Deployment
    • Deploy models using Triton Inference Server on CPU/GPU-compatible server(s) with helm or docker
  • FastNN Client
    • Client wrapper for Triton Inference Server's client module for programmatic requests with python