Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature/voice command #961

Merged
merged 62 commits into from
Feb 24, 2023
Merged

Feature/voice command #961

merged 62 commits into from
Feb 24, 2023

Conversation

cdhiraj40
Copy link
Contributor

Here are some of the notable work that are done in the GSoC'22 timeline:

  • Created a voice-command module
  • Integrated the voice trigger, google-speech kit library and added CMU Pocketsphinx language model
  • Implemented the wake word.
  • Integrated the recognition of the user's speech and translate it to plain text.
  • Both the integration has tested well.
  • Added all the Aimybox-specific code to separate a voice command module
  • Added voice command option in settings
  • Ask for microphone permission after enabling voice command
  • Added a check for microphone permission in the main activity
  • Custom good-looking snack bar for voice trigger
  • Modularized all the code inside voice command module to make it readable
  • Integrated start recording voice command with the enviroCar application
  • Integrated stop recording voice command with the enviroCar application
  • Integrated car selection voice command with the enviroCar application

matthesrieke and others added 30 commits January 24, 2022 10:53
@matthesrieke
update vesion number to 52
7714f31
@SebaDro
Merge branch 'develop'
1ec2225
@SebaDro
Update version number to 53
cb17197
@SebaDro
Set API URL to stable
9f35ad7
@SebaDro
Raise version name
6cd20da
@cdhiraj40
added voice-command module
87cc6c8
@cdhiraj40
integrated the voice trigger lib and renamed the voice-command module
e1bd17f
@cdhiraj40
integrated the google-speech-kit lib
e700a79
@cdhiraj40
added english model
acb691b
@cdhiraj40
implemented wake word recognition and recognition of user's speech an…
1d35af9 
…d translating it to plan text
@cdhiraj40
renamed model folder
4230ee5
@cdhiraj40
moved aimybox code to separate voicecommand module
0e2dd70
@cdhiraj40
updated the build gradle
2e45b83
@cdhiraj40
Merge branch 'feature/voicecommand' into feature/voice-command
cc1e151
@cdhiraj40
updated comments for build gradle
2831eb3
@cdhiraj40
added rasa server webhook url
ea133fb
@cdhiraj40
updated imports
f109591
@matthesrieke
Merge branch 'v53_2.2.0'
bead932
@cdhiraj40
added custom snackbar for voice trigger
e9d52cb
@matthesrieke
register sensor when uploading first track chunk
228a1c9
@cdhiraj40
added enable voice command feature in settings
0f95e7f
@matthesrieke
stop protocol selection for cartrend if one was successful
b049f23
@matthesrieke
Merge pull request enviroCar#937 from enviroCar/hotfix/sensor-registr…
ceeaaad 
…ation-on-chunk-feature

register sensor when uploading first track chunk
@matthesrieke
Merge pull request enviroCar#938 from enviroCar/hotfix/cartrend-proto…
1007dd8 
…col-selection

stop protocol selection for cartrend if one was successful
@cdhiraj40
updated voice command setting strings
831147f
@cdhiraj40
Merge branch 'enviroCar:master' into feature/voice-command
f743b1a
@cdhiraj40
added ask microphone permission after enabling voice command feature …
082f833 
…from settings
@cdhiraj40
added a check for microphone permission in main activity if voice com…
554c006 
…mand feature is enabled
@cdhiraj40
added Pocketsphinx model
6c40ffb
@cdhiraj40
added Pocketsphinx library
b2754cc
cdhiraj40 and others added 25 commits August 23, 2022 02:16
@cdhiraj40
added custom dialog api, request and response for rasa
6deddd4
@cdhiraj40
Added handler for rasa response and metadata
92ea075
@cdhiraj40
added action, activity extras, custom rasa and extra metadata models
f80f1e3
@cdhiraj40
Added envirocar intention to post bus events
31df7c7
@cdhiraj40
Added data classes for various events
d344545
@cdhiraj40
Added enums
7f7b510
@cdhiraj40
added json extenstions utils
42f996d
@cdhiraj40
injected metadata handler object
fc338c2
@cdhiraj40
Reusability: added methods to show snackbar for short and long period
0f96272
@cdhiraj40
Reusability: Added methods to get bluetooth and locaiton permissions
986f7b7
@cdhiraj40
Implemented start recordig voice command
281acc0
@cdhiraj40
Added custom event model with name and type.
183c5a6
@cdhiraj40
Added custom event model with name and type for ActionModel.kt
6b415ab
@cdhiraj40
Added voice command event types
2943cd0
@cdhiraj40
Added car selection enum and event
9aad99b
@cdhiraj40
Added navigation screen enum and event for navigation
46c27a7
@cdhiraj40
Refactored the EnviroCarIntention.kt with different event types, and …
fea5535 
…EnviroCarRasaCustomSkill.kt with 'actionType'
@cdhiraj40
Added feature to send available cars to rasa server and getting prope…
ec41306 
…r response back
@cdhiraj40
Redesiged enviroBot snackbar with a cario_color_primary colored frame
21287e2
@cdhiraj40
Replaced rasa response "text" field with "message" to align payload s…
8ca5971 
…chema with server
@cdhiraj40
Added Car selection voice command
1d6eafa
@cdhiraj40
Added 'is_recording_screen' to ExtraMetadata.kt for stop recording vo…
cf74129 
…ice command
@cdhiraj40
removed unnecessary code
f40fce6
@cdhiraj40
Improved stop recording voice command
60dc763
@cdhiraj40
Merge branch 'feature/voicecommand' into feature/voice-command
38d1e77
@SebaDro SebaDro self-assigned this Sep 22, 2022
@SebaDro SebaDro merged commit c7b42f9 into enviroCar:feature/voicecommand Feb 24, 2023
@Yash12Bansal
Copy link

hello @SebaDro @cdhiraj40
I am interested in 52 North projects. I have some experience in open source. So, will you please guide me to start contributing to this? Also, it would be great if we make a Discord and slack channel for discussions

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@SebaDro SebaDro

Labels
enhancement GSoC
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@cdhiraj40 @Yash12Bansal @SebaDro @matthesrieke