In this project, we aim to develop an interactive storytelling robot that engages children by narrating stories
and allowing them to interact with the narrative. The robot will utilize a combination of hardware and software
technologies to deliver personalized and immersive storytelling experiences.
-
Robotics Platform: Select a suitable robotics platform (e.g., Raspberry Pi with motor controllers) to build
The physical structure of the storytelling robot. -
Speech Synthesis and Recognition: Integrate speech synthesis for the robot to narrate stories and incorporate
speech recognition to enable verbal interaction with children. -
Programming Environment: Develop a programming interface to create and customize interactive storylines
for the robot, considering user-friendly design principles. -
Machine Learning for Personalization: Implement machine learning algorithms to personalize the storytelling
experience based on the child's preferences and engagement levels. -
Sensors for Interaction: Equip the robot with sensors (e.g., touch sensors) to enable physical interaction
with children and trigger story events. -
Visual and Audio Elements: Enhance the storytelling experience with visual and audio elements such as animated
displays, LED lights, and sound effects. -
Power Supply and Durability: Ensure the robot has a reliable power supply and design it with durability
to withstand interaction with children. -
Safety Features: Implement safety features to protect children from potential hazards associated with
interacting with the robot.
-
Robotics Platform: Motor controllers and Micro controllers that serve different purposes
-
scripts folder will be updated to contain
-
Speech Synthesis: Use OpenAI's Whisper to interpret voices and
then use a combination of scripts before coming up with a response. -
Visual and Audio Elements: Allow background music (that can be toggled on/off) and have adaptive LEDs
-
Power Supply and Durability: Research the most reliable power supplies for portable devices and
the prototype should be relatively sturdy while its materials are held together by strong glue or screws. -
Safety Features: After interpreting the speech of the subject, provide a warning that is relayed as follows
'profanity, sensitive subjects, and material that aren't appropriate for the age provided will not be entertained'.- Therefore, the program must be able to store information related to age and must reference certain
dictionaries that contain disallowed vocabulary that will trigger the warning
- Therefore, the program must be able to store information related to age and must reference certain
OpenAI's Whisper and its dependencies are now accessible packages for my project.
Steps Going Forward:
- Have my program interpret, produce, convert, and modify speech (.wav) files
- Find the best way to store user information. Most convenient would be locally onto the micro-controller's storage
- Store user information locally through JSON files (learn how to do this in Python3)
Ideas:
- It would be complicated to allow the machine to listen while providing its response. Instead, produce an auditory
signal to show the machine has completed its response (perhaps as a not annoying beep noise). - Figure out how to have the robot respond using my own laptop machine prior to running this on a micro-controller.
The website should be decently animated with few interactive components. The user should be able to view the
technologies used, understand my inspiration, and view the current state of the robot (as when it is initially
released it will be in its prototype phase). This website should be in constant development until the completion
or abandonment of said project.