Skip to content

LiveScreenTranslator utilizes OCR and translation services to provide instantaneous on-screen text translation, incorporating multi-monitor support, Text-to-Speech functionality, and the ability to save translated text to a file, delivering a solution for diverse translation requirements.

License

Notifications You must be signed in to change notification settings

ryanp3343/LiveScreenTranslator

Repository files navigation

Unit Tests Release GitHub release

LiveScreenTranslator

Description

LiveScreenTranslator is an application that helps users translate text on their screen in real-time. It uses advanced OCR (Optical Character Recognition) and machine translation technologies to provide accurate and quick translations. This tool is useful for people who interact with content in multiple languages and need a seamless translation experience.

Key features include:

  • Real-time translation on the screen.
  • Support for multiple monitors.
  • Option to save translated text to a file.
  • Text-to-speech functionality for an enhanced user experience.

Table of Contents

Prerequisites

Before installing LiveScreenTranslator, make sure to download and install the following prerequisite:

  1. Tesseract OCR - Tesseract OCR is an Optical Character Recognition engine that LiveScreenTranslator relies on for text recognition. Follow the instructions on the linked page to download and install the appropriate version for your operating system.

Note: When installing make sure to click additional script data and additional language data

Note: When installing Tesseract OCR, please ensure it is installed to the following path: 'C:\Program Files\Tesseract-OCR'

Installation

There are two ways to install and run LiveScreenTranslator:

Method 1: Download the Release

  1. Download the latest release of LiveScreenTranslator from the Releases page. Download the LiveScreenTranslator.zip asset.
  2. Extract the downloaded archive to a location of your choice.
  3. Navigate to the extracted folder and run the LiveScreenTranslator.exe file to start the application.

Method 2: Clone the Repository

  1. Clone the LiveScreenTranslator repository to your local machine using the following command:

    git clone https://github.com/ryanp3343/LiveScreenTranslator.git
    
  2. Navigate to the cloned repository folder:

    cd LiveScreenTranslator
    
  3. Install the required dependencies using the requirements.txt file:

    pip install -r requirements.txt
    
  4. Run the main.py file to start the application:

    python main.py
    

Usage

To use LiveScreenTranslator, follow these steps:

  1. Launch the LiveScreenTranslator application.

usage

  1. Choose the source (translate from) and target (translate to) languages using the provided dropdown boxes.

  2. If applicable, select the monitor you want to run the application on from the monitor selection dropdown box. The application will show a preview image of each of your monitors.

  3. Enable Text-to-Speech (TTS) or the "Save text to file" option as desired:

    • If you enable the "Save text to file" option, you'll be prompted to choose a file name and location to save the translated text.
  4. Click the "Select Area" button. A transparent screen will appear over the selected monitor.

  5. Click and drag to define the area on the screen you want to capture for translation.

usage2

Gameplay source: Original Video

  1. Click the "Start Capturing Screen" button to begin real-time translation.

The translated text will appear on your screen over the selected area. You can adjust the source and target languages or change the capture area as needed while using the application.

demo

Gameplay source: Original Video

Disclaimer

Please note that OCR and translation services may not always provide 100% accurate results. Factors that can affect the accuracy of OCR include background, color, image quality, and text size. In terms of translations, certain expressions, slang terms, or idiomatic phrases may not be translated accurately or may lack appropriate equivalents in the target language. Users are advised to consider these potential limitations if relying on LiveScreenTranslator for their translation needs.

License

LiveScreenTranslator is released under the MIT License. For more information, please refer to the LICENSE file in the repository.

Contact

For any questions or inquiries, please feel free to reach out:

About

LiveScreenTranslator utilizes OCR and translation services to provide instantaneous on-screen text translation, incorporating multi-monitor support, Text-to-Speech functionality, and the ability to save translated text to a file, delivering a solution for diverse translation requirements.

Topics

Resources

License

Stars

Watchers

Forks

Languages