GoDjMike
Follow
📏 ML Eval
Benchmarks of approximate nearest neighbor libraries in Python
LLM Benchmark for Throughput via Ollama (Local LLMs)
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
Retrieval and Retrieval-augmented LLMs
Framework for evaluating ANNS algorithms on billion scale datasets.
Things you can do with the token embeddings of an LLM
Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, implementing, and testing new search methods. Baguetter support…
⚡️A Blazing-Fast Python Library for Ranking Evaluation, Comparison, and Fusion 🐍
A language for constraint-guided and efficient LLM programming.
Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 2024
The simplest, fastest repository for training/finetuning medium-sized GPTs.
A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.
Website with current metrics on the fastest AI models.
Benchmarking LLMs with Challenging Tasks from Real Users
Shopping Queries Dataset: A Large-Scale ESCI Benchmark for Improving Product Search
A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning
Pytorch library for fast transformer implementations
Visual inference exploration & experimentation playground
Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
Evaluation and Tracking for LLM Experiments and AI Agents
Chat language model that can use tools and interpret the results
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
A website where you can compare every AI Model ✨
AutoEvals is a tool for quickly and easily evaluating AI model outputs using best practices.
Flax is a neural network library for JAX that is designed for flexibility.