HxI

Human <computer/machine/robot> interfaces (HxI)

Pose estimation

• Body:

  • Kinect SDK
  • OpenKinect (old)
  • Azure Kinect DK
  • Alpha-Pose

• Head:

  • OpenFace
  • OpenHeadPose

• Hands:

  • OpenPose
  • OpenNI/NITE

Visual Data Processing

• FaceReader (Expensive >2000 euro)

• Affdex SDK

• Face API (~12 months free trial)

• dlib

• OpenVINO

• GazeSense

• EyeTracking

Supervised object detection models

• PyTorch (image recognition and language processing)
• YOLO

Face detection

• OpenCV
• Algorithms
  • Viola-Jones or Haar classifier
  • cascade classifier

Automatic Speech Recognition (ASR)

• Google
• Microsoft
• Dragon Naturally Speaking (15 usd - 500 usd)
• Siri
• Amazon
• Kaldi github(~40 Gb) Tutorial
• Julius
• CMUSphinx

Audio features / signal processing

• TorchAudio
• Honk (Keyword Spotting)
• openEAR ()
• openSMILE

Natural Language processing

• OpenAI
• Opennlp

Others

• Social LEAP Estimates Animal Poses (SLEAP)

• NAOqi Framework used to program NAO