Skip to content

Apollo, my personal assistant written from scratch using Speech Recognition and NLP API's

Notifications You must be signed in to change notification settings

RafaelPiloto10/A.P.O.L.L.O

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

64 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

A.P.O.L.L.O (A Pretty Original Lovely Looking Object)

Description

A Personal Assistant hosted on the browser that can complete various tasks upon request using your voice!

Functionality

Current Obvious Trigger words:

  • search (topic) on (platform)
  • find (topic) on (platform)
  • send (topic) on (platform)

Current platforms implemented:

  • GMAIL
  • YouTube
  • Google
  • Wikipedia
  • Google Maps
  • Google Translate

Other commands include:

  • Getting the weather / weather forecast for the current location or requested city
  • Request voice recognition to be turned off
    • Stop listening or Give me some privacy disables voice recongnition
    • Pressing the down arrow key also disables voice recognition (pressing the up arrow enables)
  • Set a timer (time) - Sets a timer on a different tab
  • Set a reminder to (reminder) (at/before/after/on/etc) (time)
    • Order in which the reminder and time are said does not matter

Spotify Recommender Command

Request a song recommendation using either:

  • Sentiment Analysis - Provide a sentence that describes your current mood.
  • Similar Song - Provide a song title that describes your current mood and a similar song will be recommended.

Installation

Coming Soon!

Senior Seminar

Senior Seminar Folder

TODO

  • Implement Socket.IO

  • Implement YouTube API

  • Implement Wikipedia API

  • Implement Google Search

  • Implement OpenWeatherMap API

  • Implement Nodemailer Library

  • Implement IP Search for security

  • Implement Google Maps Search

  • Implement Timer functionality

  • Implement Reminder functionality (+10 seconds only)

  • Implement Google Translate Search

  • Implemenet DialogFlow for better language processing (hard to implement with Node JS)

  • Implement Wit.ai for easier language processing integration

  • Implement Spotify Mood Player

    • Built prototype - COMPLETE
    • Built prototype Neural Network - Need to export model and implement with JS
  • Build/Improve landing page for Spotify Recommender API

  • More ideas for future implementation

  • Discovered solution to Google Security Policy preventing device access ie Microphone & location Solution

    • chrome://flags/#unsafely-treat-insecure-origin-as-secure

About

Apollo, my personal assistant written from scratch using Speech Recognition and NLP API's

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published