Skip to content

Full Wiki enables seamless access to Wikipedia content in multiple languages. It translates English Wikipedia the most comprensive knowledge base into other languages. The user do not need to know the translated search term. This project should be a concept of how LLMs will tear down language barriers.

License

Notifications You must be signed in to change notification settings

bizrockman/FullWikiProject

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Full Wiki

Welcome to Full Wiki! 🎉

Full Wiki Logo

Full Wiki enables seamless access to Wikipedia content in multiple languages. It translates English Wikipedia articles into German, French, Spanish, and Italian, providing a more interactive and comprehensive experience by translating section by section. It also aggregates knowledge from different language versions, ensuring no valuable insight is missed due to language barriers.

Full Wiki is a project that was created during the THE FUTURE OF AI IS OPEN by Snowflake and Streamlit to celebrate the release of the huge Arctic model.

Full Description

Features

  • Translate Wikipedia articles from English to German, French, Spanish, and Italian.-
  • Giving no english speaker access to the information in their native language, without even knowing the english search term.
  • The english version of Wikipedia has the most articles and is the most up-to-date, so it is accessible to many more people now.
  • Section-by-section translation for an interactive experience.
  • Caching system for faster response times.
  • Summarize and translate summaries for efficient information retrieval.
  • Combine knowledge from multiple Wikipedia language versions. Since Wiki is a cornerstone of knowledge, but it is not a centralised repository. Now even english speaking people can access informations about a topic that might be hidden in a foreign language version.

Installation

  1. Clone the repository:

    git clone https://github.com/yourusername/full-wiki.git
    cd full-wiki
    
  2. Create and activate a virtual environment:

    python3 -m venv venv
    source venv/bin/activate
  3. Install the dependencies:

    pip install -r requirements.txt
  4. Set up environment variables in a .env file.

  5. Run the app:

    streamlit run app.py

Usage

  • Enter a Wikipedia search term.
  • Select the desired language for translation.
  • Navigate through sections to view translations.
  • Use the "Combined Knowledge" feature to aggregate information from different language versions.

ToDo / Optional Enhancements

License

This project is licensed under the MIT License.

Contributions

Contributions are welcome! Please fork the repository and create a pull request with your changes.

About

Full Wiki enables seamless access to Wikipedia content in multiple languages. It translates English Wikipedia the most comprensive knowledge base into other languages. The user do not need to know the translated search term. This project should be a concept of how LLMs will tear down language barriers.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages