This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.
-
Updated
May 15, 2024 - C#
This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.
Fast and memory-efficient library for WordPiece tokenization as it is used by BERT.
OpenID Connect Client Tool in C#
A toolkit that helps you to write your own parser.
2020, PJATK, Aplikacje baz danych
Approov token check in ASP.NET Core 2.0
A simple yet versatile tokenized string formatting library for .NET that replaces string.Format.
TokensBuilder.NET - is a TokensBuilder for .NET
project in C# using facebook API to create a desktop application practicing design patterns and multithreads
TokenEvaluator.Net is a simple and useful library designed to measure and calculate the token count of given text inputs, as per the specifics of the language model specified by the user. This tool is crucial for efficient resource management when dealing with AI language models, such as OpenAI's GPT-4 and others.
TokensStandard library for .NET
Involving JWT with . Net Core
Add a description, image, and links to the tokens topic page so that developers can more easily learn about it.
To associate your repository with the tokens topic, visit your repo's landing page and select "manage topics."