Skip to content

duyhho/soulful.ai

 
 

Repository files navigation


WELCOME TO Soulful.AI - Inspired by Use Case #4 for Hack-a-Roo Fall 2020

Introduction

There are two modes - Friendly Mode and Critical Mode.

  1. Friendly Mode - 2 settings:
  • User vs. Bot:
    • The chatbot will talk to the user mostly in the sympathetic and empathetic way.
    • Helps user relieve potential stress, anxiety, and depression from COVID or personal issues.
  • Bot vs. Bot (automatic):
    • Two separate models (trained with different personality) will have a short conversation with each other. Roles may vary.
    • For example, model 1 can be a depressed person while model 2 is the therapist or a comforter.
  1. Critical Mode - 2 settings:
  • User vs. Bot:
    • The chatbot will talk to the user mostly in a critical manner.
    • Helps user dig deeper into a controversial topic or simply understand conflicting viewpoints.
  • Bot vs. Bot (automatic):
    • Two separate models (trained with different perspectives) will have a short conversation with each other. Roles may vary.
    • For example, model 1 can be Republican supporter while model 2 can be a Democratic supporter.

Implementation:

  • An ensemble of models was built on Google Colaboratory, consisting of 4-5 different models suitable for different knowledge domains.
  • The NLP framework is HuggingFace, the leading open-source framework for NLP solutions using Transformers built on top of PyTorch.
  • The mobile application was built on Android via the React Native framework, one of the most popular choices for developing robust cross-platform applications using JavaScript. The multiplatform-compatible framework was developed by Facebook for ease of building native applications.

Future Scope:

  • Human in the loop: Real-time feedback
  • Multiple simultaneous messages from each side.
  • More knowledge domains
  • UI improvement
  • Model deployment on the Cloud (Amazon AWS, Microsoft Azure, …)
  • Application Deployment in Google Playstore
  • Multi-modality Analysis:
    • Natural Language Processing
    • Object Detection (to interpret user’s uploaded images)
    • User Sentiment Analysis
  • Diverse text-to-speech models (gender-based, age-sensitive, and more natural-sounding)
  • Speech-to-text features (to simulate phone calls or Facetiming)

Resources

References:


READY TO VIEW THE APP YOURSELF? Follow the instructions below!

Prerequisite

Must have React Native, Git and Node.js globally installed on your computer!

Set Up Development Environment

Get Started!

Once you have everything configured, follow the steps below to run the app:

  • Open command line of your choice and clone the project: git clone https://github.com/ngchieu857529/emotionalchatbot.git
  • Direct into the cloned folder: cd emotionalchatbot
  • (This third step can be different for different machine. Here, we are using Android emulator to run the app) Open Android Studio and run an emulator. Wait for everything to load
  • Go back to the command line and run: react-native run-android => DONE! An app should appear on your Android emulator. If you are facing any issues, look up the internet to resolve the errors! Have fun chatting with the bot!

Releases

No releases published

Packages

No packages published

Languages

  • JavaScript 67.4%
  • Java 15.1%
  • Objective-C 10.6%
  • Starlark 4.6%
  • Ruby 2.3%