Efficient few-shot learning with Sentence Transformers

Unsupervised text tokenizer for Neural Network-based text generation.

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

State-of-the-Art Text Embeddings

日本語T5モデル

The official Python library for the OpenAI API

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

lists of text corpus and more (mainly Japanese)

Japanese tokenizer for Transformers

Optical character recognition for Japanese text, with the main focus being Japanese manga

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

Tensors and Dynamic neural networks in Python with strong GPU acceleration

A library for efficient similarity search and clustering of dense vectors.

Accessible large language models via k-bit quantization for PyTorch.

Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

Open-source search and retrieval database for AI applications.

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website …