Live project: https://originalpollyapp.netlify.app
Live project USING AZURE: https://azurepollyapp.netlify.app/
- Styled Components
- React Bootstrap
- Firebase
- ESLint
- FontSource
- Figma
- Azure Text to Speech
- Canva
- Netlify
- Sortable JS
- Speech Synthesis
Polly is an augmentative and alternative communication (AAC) device for individuals that cannot communicate verbally. An augmentative and alternative communication (AAC) device, is a tablet or laptop that helps someone with a speech or language impairment to communicate. The term AAC device is often used interchangeably with terms like speech-generating device (SGD) or assistive communication device or simply communication device. AAC devices help users to communicate through a combination of words, sentences, and images that the device then “says out loud.” Polly is specially designed for young children. This app was inspired by my nephew, Liam. Liam is currently 4 years old and is on the autism spectrum. He is non-verbal and cannot physically communicate. With this app, Liam will be able to communicate his needs. He will be able to drag a photo or multiple ones, and have them read out loud. His parents will also be able to upload new photos to the database and add them so Liam will have more photos to select from. They will also be able to edit the profile section in order to show Liam's age, name and photo.
Information on AAC Devices: https://www.aphasia.com/aac-devices/what-is-an-aac-device/
Information on Autism: https://www.nimh.nih.gov/health/topics/autism-spectrum-disorders-asd#:~:text=Autism%20spectrum%20disorder%20(ASD)%20is,first%20two%20years%20of%20life.
After hacing created this project, I learned how to use AWS Polly, and Azure text-to-speech. I also practiced using firebase and reading through all of the functions they have available. I really enjoyed designing the wireframes for the project. I also enjoyed doing research on people with Austim and how to design to their needs. The most difficult part was working with Azure for the first time. Azure had some difficulties working across browsers. Lastly, Sortable JS was also a bit difficult at times. However, I was able to figure it out after reading the documentation and doing trials.
This project was developed by two people: Luis Brito, and Yannelly Mercado(Myself). Both developers were involved in the design, development, and testing of the project.
- Category: Technology/ Assistive Technology
- Tablet: This app is primarily developed and designed to be used in a tablet device. It is currently designed as a desktop app in order to show functionality and design.
- Story: Users can communicate their needs by selecting one or multiple photos, dropping them in the input bar, and having the photos read out loud. Users can also upload new photos along with a label. Lastly, users can edit and input their information in the profile section.
- Market: This app is intended to be used for individuals with speech or language impairments.
- Habit: This app is meant to be used multiple times a day, every day.
- Scope: Ideally, this app would be available in any app store. It would provide an alternative to other AAC devices that might charge the user for using the app.
Required Must-have Stories
- User logs in to the Polly App or creates an account if user doesn't have one.
- User can drag and drop an image to the input bar and have it read out loud.
- User can delete one or multiple images from input bar.
- User can delete a card by dragging it and dropping it on the trash icon.
- User can click on the speaker icon in order to have all cards/images to have it read.
- User can upload an image along with its label and have it displayed on the home page.
- User can upload a new profile image and change the user information.
Additional features I would like to add:
- Have the app be available on the app store and as a mobile app.
- Include a confirmation view window for the delete card option.
- Include a caroussel for the photo section.
- Allow the user to sign in with a Google account.
- Login -> Users can log in if they have an account.
- Sign Up -> Users can create an account if they do not have one yet.
- Home -> Users can browse through the photos, drag the photos to the input bar, and have it read by the speaker.
- Upload -> Allows users to label photos and upload them to the database.
- Profile -> Allows users to upload a new image and edit their information.
Tab Navigation
- Log in/ Sign up
- Home
- Upload
- Profile
Flow Navigation (Screen to Screen)
- Log-in /Sign up -> Logs the user in and takes it to home. If there's no account, lets user create an account.
- Home -> Takes user to the home page that includes all user cards(vocabulary).
- Upload -> Upload a photo, along with a label, to the home page.
- Profile -> Upload a new user photo, and edit the user information.
Live Prototype: https://www.figma.com/proto/a7CQwAY8frhAVek2wA3bfh/Polly?node-id=1%3A2&scaling=scale-down&page-id=0%3A1&starting-point-node-id=1%3A2
