https://devpost.com/software/bright-buddy-qyu1h6
This repository contains a full-stack web application designed to provide real-time emotion tracking and AI interaction through text input. The system integrates a backend powered by Flask and an SQLite database for managing button states, and a frontend built in React to interact with various backend components. The project also includes functionality for AI text generation based on specific areas of a given book.
Dynamic Button Configuration: Store and update button states in an SQLite database for tracking different UI components.
- AI Text Generation: Generate dynamic responses using a large language model (OpenAI) based on predefined contexts.
- OpenAI: For guiding the Dialogic reading!
- React: For building interactive user interfaces.
- Axios: For making HTTP requests to the Flask backend.
-
Frontend Setup - React
- cd Frontend
- npm run dev
-
Backend Setup (Flask + SQLite):
-
Navigate to the Backend Directory:
cd backend -
Create a Virtual Environment and Install Dependencies:
python3 -m venv env source env/bin/activate # For Windows, use `env\Scripts\activate` pip install -r requirements.txt
-
Create the Initial SQLite Database:
python create_buttons_db.py
-
Start the Flask Server:
python app.py
The server will start running at
http://127.0.0.1:5000.
-
-
Frontend Setup (React + Axios):
-
Navigate to the Frontend Directory:
cd ../frontend -
Install React Dependencies:
npm install
-
Start the React Development Server:
npm start
The React app will start running at
http://localhost:3000.
-
-
Integrate STT and TTS Models:
- Set up real-time STT for capturing user inputs.
- Implement TTS to convert AI-generated text into speech.
-
Contextual AI Text Generation:
- Use openAI LLM model to generate text-based on specific book segments.
-
Improved Frontend Design:
- Add visual indicators and enhancements for different button states.
Nick Johnson, Juan Ceresa, Reiko Chen, Siu Ching Wong - MHacks17