Project: Ask An Entrepreneur

[AshleyZhao]

Project name

Ask An Entrepreneur

Description

Summary

This app can answer general questions from famous entrepreneurs' perspectives. Currently, the app only supports Q&A with Jack Ma and Elon Musk. The answers are based on transcripts of interviews with the subject. The application uses a Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and OpenAI large language models. You can ask questions in the format of "What does Elon Musk think of space flight?"

Improvements made for LLM performance for Chinese

• The original text splitting parameters do not optimize chunking for CJK languages. We implemented a function to change the section length for chunking size depending on the language. The section length needed to be considerably smaller as Chinese text contains more information in a shorter amount of text.
• For the model to look up multiple languages more accurately, we implemented a translation function that translated the user prompt so the prompt is in both English and Chinese.
• Modified punctuation for detecting word breaks better by incorporating Chinese punctuation characters.

P.S. thanks pamelafox

P.P.S It could be the free tier of Azure deployments causes some delay when loading the endpoint. Please try again if it does not load for the first time.

Language

English, Chinese

Project Repository URL

https://github.com/AshleyZhao/ai-rag-entrepreneur-qa/tree/main

Deployed Endpoint URL

https://app-backend-edxc4c4wxgjxo.azurewebsites.net/

Project video

https://www.youtube.com/watch?v=02SXIUjNn6U

Team members

AshleyZhao, katieyang

Showcase Consent

Yes