Deep Infra
- 33 followers
- United States of America
- https://deepinfra.com
- @DeepInfra
- company/deep-infra
- info@deepinfra.com
Popular repositories
-
text-generation-inference
text-generation-inference PublicForked from huggingface/text-generation-inference
Large Language Model Text Generation Inference
-
deepinfra-node
deepinfra-node PublicOfficial TypeScript wrapper for DeepInfra Inference API
TypeScript 5
-
langchain
langchain PublicForked from langchain-ai/langchain
⚡ Building applications with LLMs through composability ⚡
Python 1
-
full-stack-deep-learning-website
full-stack-deep-learning-website PublicForked from the-full-stack/website
Source for https://fullstackdeeplearning.com
HTML
-
sentence-transformers
sentence-transformers PublicForked from UKPLab/sentence-transformers
Multilingual Sentence & Image Embeddings with BERT
Python
Repositories
-
- TensorRT-LLM Public Forked from NVIDIA/TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
- tensorrtllm_backend Public Forked from triton-inference-server/tensorrtllm_backend
The Triton TensorRT-LLM Backend
- lm-evaluation-harness Public Forked from EleutherAI/lm-evaluation-harness
A framework for few-shot evaluation of language models.
- vllm Public Forked from vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
- litellm Public Forked from BerriAI/litellm
Call all LLM APIs using the OpenAI format. Use Azure, OpenAI, Cohere, Anthropic, Ollama, VLLM, Sagemaker, HuggingFace, Replicate (100+ LLMs)
- text-generation-inference Public Forked from huggingface/text-generation-inference
Large Language Model Text Generation Inference
-
People
This organization has no public members. You must be a member to see who’s a part of this organization.
Top languages
Loading…
Most used topics
Loading…