Skip to content

iOS, Python GPU, and Windows Python 3.11 support for MediaPipe Tasks

Compare
Choose a tag to compare
@ayushgdev ayushgdev released this 05 Jun 18:51
· 1721 commits to release since this release

Major Features and Improvements

iOS

  • Published MediaPipeTasksText and MediaPipeTasksVision CocoaPods at version 0.10.1-alpha-2
  • Add FaceDetector iOS API
  • Add Gesture Recognizer iOS API

Web

  • Add iOS support for GPU processing for Segmentation Tasks
  • Add .close() method to ImageSegmenterResult/InteractiveSegmenterResult/PoseLandmarkerResult
  • Add quality scores to Segmenter tasks
  • Make FaceLandmarker result non-optional

Bug Fixes and Other Changes

Android

  • Remove unused MediaPipe Tasks Android sample

iOS

  • Added validation of C++ image classification result packet in MPPImageClassifierResult+Helpers.mm
  • Fixed deps in iOS task BUILD file
  • Reverted addition of flow limiter calculator in image classifier iOS
  • Added delegates in iOS gesture recognizer options
  • Added MPPGestureRecognizerOptionsHelpers, MPPGestureRecognizerResultHelpers, MPPGestureRecognizer header
  • Updated the vision task runner to split the method that creates normalized rect based on ROI
  • Added C++ utils for parsing protos from text files for iOS tests
  • Added hand landmarker result, hand landmarker options, hand landmarker options helpers
  • Add FaceLandmarkerOptions and FaceLandmarker Result API
  • Added utils of containers and core to MPPTaskCommon to avoid warnings in xcode
  • Updated error tests to use XCTAssertEqualObjects

Javascript

  • Update WASM files for 0.10.1 release


Framework and Core Calculator Improvements

Bug Fixes and Other Changes

  • Added clearing of all graph options protos in MPPGestureRecognizerOptions Helpers, support to set delegates in MPPBaseOptions
  • Added method to create unique dispatch queue names in MPPVisionTaskRunner
  • Updated MPPImageClassifier to use delegates instead of completion blocks for callback
  • Updated documentation
  • Updated time out for image classifier async tests
  • Updated time out for object detector
  • Added flow limiter calculator in MediaPipeTasksCommon
  • Added clearing of all graph options protos in MPPGestureRecognizerOptions Helpers
  • Update base_options.py
  • Update Dockerfile
  • Add some helpful error messages in case GL texture creation fails
  • Updated Image classifier result to return empty results if packet can't be validated
  • Updated MPPObjectDetectorResult Helpers to return empty result instead of nil
  • Add needed enum type for choose fuse pipeline
  • Added C++ utils for parsing protos from text files for iOS tests
  • Updated face detector to use new methods from vision task runner
  • Updated variable names in MPPHandLandmarkerOptionsHelpers
  • Add MultiLandmarksSmoothingCalculator
  • Add MP_DISABLE_GPU to .so target
  • Updated CVPixelBuffer to support pixel format type of 32RGBA
  • Added support to set delegates in MPPBaseOptions

MediaPipe Dependencies

  • Removed opencv dependency from MPPVIsionTaskRunner
  • Update MediaPipe to RE2 release 2023-06-01