Skip to content

Release v0.1.0 - Initial Release

Choose a tag to compare

View all tags
@yazon yazon released this 06 May 06:38
· 4 commits to main since this release
v0.1.0
3229e04

Release v0.1.0

This release introduces the Token Probability Visualizer, a web application designed to help users understand the token probabilities generated by OpenAI models.

Overview

The Token Probability Visualizer allows you to:

  • Visualize token probabilities from OpenAI models in generated text.
  • See color-coded tokens indicating different probability levels (high probability = green, low probability = red).
  • Hover over tokens to view detailed probability information and alternative likely tokens.

Key Features

  • Model Configuration: Select from available OpenAI models associated with your API key, adjust temperature, top_p, and maximum tokens.
  • Interactive Prompting: Enter prompts and generate text with probability visualization.
  • Detailed Insights: Hover over tokens for log probabilities and alternative token options.
  • Customizable Legend: Default probability thresholds and colors are provided (details in config.py and models/token_processor.py).

Getting Started

  1. Installation: Please refer to the Installation Guide in the README for detailed setup instructions.
  2. Running the App: Follow the Running the Application steps in the README.
  3. Usage: See the Using the Application section for a guide on how to use the visualizer.

Requirements

  • Python 3.10+
  • Flask
  • OpenAI API key (configured in a .env file)

Please report any issues or provide feedback.

Assets 2
Loading