Fall is the time to get your shit together. It brings the academic pressures with the onset of the school year, as well as a new recruiting season! But since you were slacking off and relaxing in the summer, you now realize it's been a long long time since you last practiced your speaking skills. Suddenly the fall season is throwing all these school presentations, job interviews, and other super-important speaking situations right at you and you've forgotten how to articulate your words! Introducing... RTQlate! (AR-TI-CU-late)
RTQlate is a 5-feature speaking assistant and feedback provider:
- Auto-summarized flashcards in the convenient form of a physical wearable.
- Real-time eye-tracking
- Sentiment analysis
- Enunciation, pronunciation, and clarity indicator
- Confidence level measurer
- Firebase for account authentication
- AssemblyAI to transcribe speech and check pauses between words and other stuff
- OpenAI API for text summarization
- Python Flask server
- The flash card bullet points are displayed on an LCD, built using Arduino and C++. A push button is used to flip through the cards. These points are automatically summarized by our OpenCV endpoint.
- Vanilla React frontend styled with Tailwind CSS
- Before you begin, ensure you have met the following requirements:
- Install required dependencies in root folder and both frontend and backend folders
npm install
- Create a
.env
file in this folder with the following variables:
OPENAI_API_KEY={YOUR_API_KEY}
FLASK_APP=main.py
(127.0.0.1:5000 by default)
cd server
python3 -m venv venv
source venv/bin/activate
(MacOS)venv\Scripts\activate
(Windows Powershell)pip install -r requirements.txt
FLASK_APP=main.py flask run
(MacOS)flask run
(Windows Powershell)
(localhost:3000 by default)
cd app
npm install
npm start
![](https://private-user-images.githubusercontent.com/110139243/305715064-c464b92a-4f75-48df-900b-c554a29962dc.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTg4MTQ3ODUsIm5iZiI6MTcxODgxNDQ4NSwicGF0aCI6Ii8xMTAxMzkyNDMvMzA1NzE1MDY0LWM0NjRiOTJhLTRmNzUtNDhkZi05MDBiLWM1NTRhMjk5NjJkYy5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNjE5JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDYxOVQxNjI4MDVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1kMWY3OTRhNTNhYzFhYWY3M2MyZDdmNWVjY2NhMDQ5Y2ZkMDRjMjk0NWJhMzE5NDFiNGExOThhYzc1YmU3NTIzJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.EFOiDlX8BkmShn2WsYzcmbg5Mt4egq7FgTXm6FGxq2I)
![](https://private-user-images.githubusercontent.com/110139243/305715072-bbd87d34-4d6e-4095-8234-bcac63c078a7.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTg4MTQ3ODUsIm5iZiI6MTcxODgxNDQ4NSwicGF0aCI6Ii8xMTAxMzkyNDMvMzA1NzE1MDcyLWJiZDg3ZDM0LTRkNmUtNDA5NS04MjM0LWJjYWM2M2MwNzhhNy5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNjE5JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDYxOVQxNjI4MDVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT04NGI2NjZlYzEzNTU3ZWEyYzVlYTQzMDUzMzJkMDE5OTMxYzUxODhiM2ZiOTNiNTNkODQ5YzFhMTM1NDgyODA5JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.b54QCL_GovpA8qACWqGygHFoW-SFMT6Z2bikXETRdzM)
![](https://private-user-images.githubusercontent.com/110139243/305715084-a31f8f51-8e22-40ed-a222-b9dfea9e6d1c.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTg4MTQ3ODUsIm5iZiI6MTcxODgxNDQ4NSwicGF0aCI6Ii8xMTAxMzkyNDMvMzA1NzE1MDg0LWEzMWY4ZjUxLThlMjItNDBlZC1hMjIyLWI5ZGZlYTllNmQxYy5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNjE5JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDYxOVQxNjI4MDVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT0zMmVhYzg1OWYzZDM5ODhlZThmY2RkNjM5NWJkMjY4MmU1ZjFjNzM0YThiMDhhZThjMWRjODE5YTZlMzQ3MTZiJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.QpGmiIkQzM5bMkvYdguCUNV3R2mDXxPiA_Umj1p-Z_w)
![](https://private-user-images.githubusercontent.com/110139243/305715101-b85f3eba-0b97-4d10-b883-2551c838442f.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTg4MTQ3ODUsIm5iZiI6MTcxODgxNDQ4NSwicGF0aCI6Ii8xMTAxMzkyNDMvMzA1NzE1MTAxLWI4NWYzZWJhLTBiOTctNGQxMC1iODgzLTI1NTFjODM4NDQyZi5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNjE5JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDYxOVQxNjI4MDVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1iZDM4MjY3MTNiNTQ1ZGYwYjg4OGVhN2ZmM2EyZjFlODM5OTQ1YmUzYjgyYjMyMmVmYWJjMjcyNDAxNjMyZjA5JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.1MF39kbrtEvK1rEG2aWtIKk8DlEVOtc9WCtkiygUwyk)
![](https://private-user-images.githubusercontent.com/110139243/305715109-2f6bc68f-4c96-4ca9-b8a7-39fdb53f73fe.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTg4MTQ3ODUsIm5iZiI6MTcxODgxNDQ4NSwicGF0aCI6Ii8xMTAxMzkyNDMvMzA1NzE1MTA5LTJmNmJjNjhmLTRjOTYtNGNhOS1iOGE3LTM5ZmRiNTNmNzNmZS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNjE5JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDYxOVQxNjI4MDVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1iYmE3MDBlYmIwNjEwYzFiMzFlYmNlOWY5MzFiYTkzYzZlMmNjODA1NDVmN2ZhYzAwYjI4NzFkZDJiY2U5MThjJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.hLQhoismNEXLyrO_bvzwxNLZ8bU0iHBjIG-z32KKAfA)
![](https://private-user-images.githubusercontent.com/110139243/305715119-392b9147-276c-425a-ac67-4081ca51294d.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTg4MTQ3ODUsIm5iZiI6MTcxODgxNDQ4NSwicGF0aCI6Ii8xMTAxMzkyNDMvMzA1NzE1MTE5LTM5MmI5MTQ3LTI3NmMtNDI1YS1hYzY3LTQwODFjYTUxMjk0ZC5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNjE5JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDYxOVQxNjI4MDVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1jMGRmMjJkNTQ3Yzc5Mzg3ZjA4NTAxOWM4MzdjMzk3YTM1NjA5NTMzODFlMmE0ZWMwMTcwNGFjNTJlZDkyYmQ5JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.Hb8_-tzOc85Rd_RxT4QpF5LLhrB6mu_q38NDfogTaXI)
- Eyes chart
- Deployment
- Demo Video