TokensStandard library for .NET
-
Updated
Aug 20, 2020 - C#
TokensStandard library for .NET
TokensBuilder.NET - is a TokensBuilder for .NET
OpenID Connect Client Tool in C#
A simple yet versatile tokenized string formatting library for .NET that replaces string.Format.
2020, PJATK, Aplikacje baz danych
Approov token check in ASP.NET Core 2.0
project in C# using facebook API to create a desktop application practicing design patterns and multithreads
TokenEvaluator.Net is a simple and useful library designed to measure and calculate the token count of given text inputs, as per the specifics of the language model specified by the user. This tool is crucial for efficient resource management when dealing with AI language models, such as OpenAI's GPT-4 and others.
A toolkit that helps you to write your own parser.
Involving JWT with . Net Core
This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.
Fast and memory-efficient library for WordPiece tokenization as it is used by BERT.
Add a description, image, and links to the tokens topic page so that developers can more easily learn about it.
To associate your repository with the tokens topic, visit your repo's landing page and select "manage topics."