tiktoken
Here are 22 public repositories matching this topic...
A custom GPT based on [Zero To Hero](https://karpathy.ai/zero-to-hero.html) utilizing tiktoken with the intent to augment AI Transformer-model education and reverse engineer GPT models from scratch.
-
Updated
Jun 19, 2023 - Python
Simple wrapper around tiktoken to use it in your favorite language.
-
Updated
Jul 8, 2023 - Python
The ChatGPT Long Term Memory package is a powerful tool designed to empower your projects with the ability to handle a large number of simultaneous users and external sources.
-
Updated
Jul 31, 2023 - Python
В рамках хакатона был создан телеграм бот для консультации с клиентами с сфере обслуживания магазина "Ашан"
-
Updated
Aug 23, 2023 - Python
Tiktoken-counter as standalone API
-
Updated
Sep 3, 2023 - Python
Predict the exact openai token usage of functions
-
Updated
Sep 20, 2023 - Python
console based game based on a llm
-
Updated
Oct 29, 2023 - Python
Logseq Markdown Tokenizer is a Python application that tokenizes and estimates prices for one to many markdown files.
-
Updated
Mar 7, 2024 - Python
Web crawling GUI app for non-govermental events, easy integration with custom proxy, user agents, ApenAI Api and Redis Stack. Enjoy!
-
Updated
Apr 17, 2024 - Python
Extracts Google Sheets to JSONL for fine-tuning, estimates task costs with tiktoken.
-
Updated
Jul 6, 2024 - Python
This project harnesses the power of Tiktoken and the OpenAI API to create a Python Streamlit web application with a primary focus on token counting and price estimation.
-
Updated
May 27, 2024 - Python
Specify a github or local repo, github pull request, arXiv or Sci-Hub paper, Youtube transcript or documentation URL on the web and scrape into a text file and clipboard for easier LLM ingestion
-
Updated
Jun 15, 2024 - Python
-
Updated
Jun 23, 2024 - Python
Improve this page
Add a description, image, and links to the tiktoken topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the tiktoken topic, visit your repo's landing page and select "manage topics."