Integration with chatbots and hardware such as actuators, sensors, robotic arms, cameras

[kensoh]

Posting on behalf of a user who posted in another issue, for benefit of other users.

---

I have ceased my employment with my previous company recently.
I am thinking about providing consultancy jobs related to AI. I intend to
return to work in 6 to 12 months.
I have a request for a robot office reception.
Case illustration: a tablet at the office counter. It sense motion near it.
Wakes up and say "Hi, are you here to visit an employee or deliver?"
It listens for a name and search database & call employee to inform
visitor. In the meantime, it will communicate with visitor to register
name, contact & purpose of visit.
It listens for "deliver" too. If yes, it will trigger a drop box open, and
request the deliver person to drop the delivery. As the delivery man drop
the item, a few video will be captured as proof of delivery. And the system
will communicate with the delivery man for confirmation including generate
a signed POD for print.

I am thinking it is somewhat related to your system but require chatbot
integration, and ability to integrate with sensors.

Please share any guidance if available.,

[kensoh]

Hi @jameschanck thanks for sharing your background and the user scenario.

TagUI can making outgoing API calls and receive incoming API calls. The source and targets can be Raspberry Pi, Arduino, chatbot APIs such as Dialogflow or Wit.ai or ChatterBot for example.

More details on TagUI's API integration here - https://github.com/kelaberetiv/TagUI#api

This part on CLI assistant may also be relevant if you plan to invoke the command through voice-to-text and calling corresponding command line or API service to invoke some web-based automation actions - https://github.com/kelaberetiv/TagUI#cli-assistant

Your scenarios above don't sound impossible, just that it will probably take a lot of effort to build the different components and get them working accurately in your client's environment. The part of development related to TagUI is probably small, most of the work is the individual components getting them to work and receiving and send API calls accurately.

[kensoh]

Closing issue but feel free to continue the conversation