Supercharge huggingface transformers with model parallelism.

Forward-Looking Active REtrieval-augmented generation (FLARE)

HyDE: Precise Zero-Shot Dense Retrieval without Relevance Labels

A library for efficient similarity search and clustering of dense vectors.

PaL: Program-Aided Language Models (ICML 2023)

Train Dense Passage Retriever (DPR) with a single GPU

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

PyTorch Extension Library of Optimized Scatter Operations

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

DeepCT and HDCT uses BERT to generate novel, context-aware bag-of-words term weights for documents and queries.

Repo of code and data for SIGIR-19 short paper "Deeper Text Understanding for IR with Contextual NeuralLanguage Modeling"