SoonWillRemember😣

Aphasia is a disorder caused by stroke or brain injury that impairs a person's ability to process language. We want to make people's rehabilitation easier and more comfortable.

Description 📝

There are a lot of people with disabilities who are seeking help. A handful of gadjets were invented for the most common impairments, e.g. blind, deaf, injured people. Our idea specializes in a temporary disability called Aphasia, which happens after a heart stroke or a head injury. What does it look like? Imagine a person wants to say "I want to eat," and instead of that he says "I banana fish meat" or sometimes "I want to ehmm ... you know.. putting food in mouth ... ". In the former one, they believe that they said what they intended to say and can not understand why everybody is staring at them. In latter one, they can not remember basic words. We want to help them go through it easier. In our MVP, image from camera is being processed, and trying to understand where person is and what they want to say. This makes it so they can read phrases or listen to them from the screen.

Instructions to run🚀

1. Clone this git
2. Install all requirements in requirements.txt
3. Run programm, typing python -m uvicorn main:app in a terminal
4. Open https/localhost:8000
5. Run another program, typing python image_reader.py in a separate terminal

How it works🤔

1. Image from your camera goes straight in ultra lightweight model YOLOv11 nano
   It looks for different objects very fast, and sends what it found to main.py
2. Main.py sends these details to gemini 2.5 and asks to make 3 phrases, depending on where the user is
   and try to predict what they want

Possible future📈

• First variant, we can use any headwear camera, either GoPro, metaglasses or even a VR Helmet.
  Image from the camera will be sent to the server every 1-2 seconds(which will be enough to send and process the image) and show phrases on your phone.

• Second variant is much more better, we can make a special head-worn camera, which will look like a headband. It will be small because it needs only a camera, Esim, and a microprocessor.
  It can be made specially for hospitals, thus they can give it to people on rehabilitation.

Contributers👨‍💻

• chistyar
• keepitsimple3