A keypoint detection model consisting of an action detection model to decode certain actions. This is built using Tensorflow, keras to build a deep neural network introducing LSTM layers to handle the sequence of keypoints using MediaPipe Holistic Keypoints The work is mainly divided into the following parts:
- Importing required dependencies
- Keypoints using MP Histolic
- Extract keypoint values
- Setup folders for collection
- Collect keypoint values for Training and Testing
- Preprocess data and create labels and features
- Build and Train LSTM Neural Network
- Make predictions
- Save weights
- Evaluation using confusion matrix and Accuracy
- Test in real time