A small Node.js benchmark suite for the tiktoken WASM port.
-
Updated
May 29, 2023 - TypeScript
A small Node.js benchmark suite for the tiktoken WASM port.
В рамках хакатона был создан телеграм бот для консультации с клиентами с сфере обслуживания магазина "Ашан"
console based game based on a llm
This project harnesses the power of Tiktoken and the OpenAI API to create a Python Streamlit web application with a primary focus on token counting and price estimation.
An Industry Standard Tokenizer, purposed for large-scale language models like OpenAI's GPT Series.
Web crawling GUI app for non-govermental events, easy integration with custom proxy, user agents, ApenAI Api and Redis Stack. Enjoy!
Count tokens to determine cost differential of ChatGPT Plus subscription and ChatGPT API
This project uses the CrewAI framework to automate stock analysis, enabling AI agents to collaborate and execute complex tasks efficiently. Example stock: Nvidia. Technologies include Python, CrewAI, Unstructured, PyOWM, Tools, Wikipedia, yFinance, SEC-API, tiktoken, faiss-cpu, python-dotenv, langchain-community, langchain-core, and OpenAI.
Byte Pair Encoding (BPE) in the Zig programming language (0.13.0)
The projects which made by me while self learning.
LLM trained on reddit short stories!
The client connects to a frontend server using a middleware load balancer that manages Docker instances with a "least connected" algorithm. New instances register dynamically, and a monitoring endpoint shows logs and request counts. The service counts tokens in text.
Add a description, image, and links to the tiktoken topic page so that developers can more easily learn about it.
To associate your repository with the tiktoken topic, visit your repo's landing page and select "manage topics."