HxI

Human <computer/machine/robot> interfaces (HxI)

Pose estimation

Body, Hands, etc. Recognition

Speech Recognition

Sensors

Data and Signal Processing

• Body:

  • OpenPose (Project page) (ROS wrapper)
  • Kinect SDK
  • OpenKinect
  • Azure Kinect SDK
  • Alpha-Pose

• Head:

  • OpenFace
  • OpenHeadPose

• Hands:

  • UltraLeap / LeapMotion (Project page) (ROS wrapper)
  • OpenPose
  • OpenNI/NITE

• Other

  • Social LEAP Estimates Animal Poses (SLEAP) (Project page)

Visual Data Processing

• FaceReader

• Affdex SDK

• Face API (~12 months free trial)

• dlib

• OpenVINO

• GazeSense

• EyeTracking

Supervised object detection models

• PyTorch (image recognition and language processing)
• YOLO

Face detection

• OpenCV
• Algorithms
  • Viola-Jones or Haar classifier
  • cascade classifier

Automatic Speech Recognition (ASR)

• VOSK (Project page) (ROS wrapper)
• CMUSphinx (Project page)
• Google Speech-to-Text (Project page) (ROS wrapper)
• Microsoft Speech-to-Text (Project page)
• Amazon Speech-to-Text (Project page)
• Kaldi (Project page) (Tutorial)
• Julius (Project page)

Audio features / signal processing

• TorchAudio
• Honk (Keyword Spotting)
• openEAR ()
• openSMILE

Natural Language processing

• OpenAI
• Opennlp

Hardware / Software components

• Hardware components

  • usb_cam (ROS package)
  • realsense_ros (ROS package)
  • UltraLeap / LeapMotion (Project page) (ROS wrapper)

• Software components

  • ar_track_alvar (ROS package)