Skip to content

This project contains one of my graduated school application with NLP and Virtual Agent

License

Notifications You must be signed in to change notification settings

AkishinoShiame/Graduated-Project

Repository files navigation

AI Kernel (Graduated-Project)

This project contains one of my graduated school application with NLP and Virtual Agent.

Details

--Respository's name-- --description--
Chinese-Speech-Emotion-Datasets Datasets of the Speech Spectrogram with emotion tag.
Virtual-Elderly-Chatbot-Server-Structure The server code and main part of structure, using python.
Virtual-Elderly-Chatbot-App The main part of client structure, using unity to build up for multi-plaftform.
Virtual-Elderly-Chatbot-IOS-Project The IOS project (Opened with Xcode) of Virtual Elderly Chatbot App.
Speech-Dataset-in-scikit-learn The extended tests and verify on Datasets with other methods in scikit-learn.
Test data was random picked from all Counts data.

Structures

alt text

Client : Unity ==> Xcode Proj ==> IOS app ( if want, can have a try on android.)

Important !!!

Please cites this peper belows if you used this or any of the sub-respositories.

Lee, M. C., Yeh, S. C., Chiu, S. Y., & Chang, J. W. (2017, June). A Deep Convolutional Neural Network Based Virtual Elderly Companion Agent.

Ming Che Lee, Sheng Cheng Yeh, Sheng Yu Chiu, Jia Wei Chang.
 "A Deep Convolutional Neural Network Based Virtual Elderly Companion Agent",
 MMSys'17 Proceedings of the 8th ACM on Multimedia Systems Conference,
 Pages 235-238, June 20 - 23, 2017, Taipei, Taiwan. (EI, SIGMM, accept rate: 28%)

Release Note

This chapter is adding around 令和1年6月 .

The project will have a formal name called "AI Kernel".

2017.09.01

First beta release, finished all the function and codes makes both server and client works.

The version of the Server using python 2 on NVidia DIGITS server and python 3 on Chatbot Server.

Client version using Unity 5.6.2f1 version build to iOS 11 (beta) version.

HardWare tested:

Server: i7-4790 (3.6 GHz), 16GB RAM, Nvidia 1050Ti 4G DDR5 GPU.

Client: iPhone SE.

2018.12.24

Rebuild the release and update the codes if needed.

Discuess with new enviorment to build the service.

2019.04.17

Trying rebuild the server part.

HardWare as the link:

Japanese English Chinese

2019.06.17

Update the release documentation of this project.

Read the Document from Here

Found there are some update for the latest verison of NVidia DIGITS (v6.1.1). Fixed the NVidia API part code.

Found error when convert spectrogram to jpg format. Changing codes to use PNG format instead.

May have a update release of the server code in recent future.

2019.07.02

Update the Server code locate in sub-respositories

Set-up a V2.0 release(May be final). Which can found in Here.

May have added update & release for builds on Unity and IOS 12 in recent future.

Update @ 22:49 JPT with IOS 12 release project

Create production Release.

Create and update documentation in "令和Update" release.

Video DEMO

Demoムービー01

alt Demoムービー

Demoムービー02

alt Demoムービー

Demoムービー03

alt Demoムービー