Skip to content

MediaPipe v1.0.0

Latest
Latest

Choose a tag to compare

View all tags
@dbcp1 dbcp1 released this 28 Jul 22:13
v1.0.0
6d31f1e

Build changes

  • Remove MacOS prebuilts
  • Replace ITUIOSTestUtil with ITUTestRunEnvironment in iOS tests.

Bazel changes

  • Migrate Apple rules dependencies to MODULE.bazel.

Framework and core calculator improvements

  • Add Gecko support to MediaPipe Text Embedder Task
  • Store wgpu::Instance in WebGpuService.
  • Supporting builds with DRISHTI_DISABLE_GL_COMPUTE define.
  • Bump MediaPipe version to 0.10.36.
    • Abseil (com_google_absl): Updated from (2023-10-18) to (2025-01-14).
  • Add Gecko support to TextEmbedder C API.
  • Use standardized enum constants for Running Mode
  • Report Mat type in debug logging.
  • Add AddAudioHeaderCalculator
  • Remove run_llm_inference.sh
  • Add webgpu::Instance to WebGpuDeviceAttachmentManager.
  • Fix MediaPipe nightly build failure and cleanup Bzlmod warnings.
  • Fix null pointer access in Tensor::GetOpenGlTexture2dReadView() for AHWB backed Tensor.
  • Adds SpectrogramFloatCalculator and InverseSpectrogramFloatCalculator to support float precision.
  • Add support for Embedding Gemma models in TextEmbedder.
  • Make wgpu::Instance a member of WebGpuAsyncFuture.
  • Enforce namespacing conventions for MediaPipe Tasks C and Python APIs.
  • Add methods to create and access Matrix packets using Direct ByteBuffers.
  • Ensure AhwbGpuResources destructor cleans up OpenGL/EGL resources and forces AHWB usage completion.
  • Update MediaPipe Python build Dockerfiles.
  • Update base options and host environment.
  • Introducing extra base options and corresponding conversion/get functions.
  • Improve error message for option_value problems
  • Support models with empty tags
  • Add empty image checks to ScaleImageCalculator.
  • Add gpu_postprocessing option for TensorsToSegmentationCalculator.
  • Add text chunking utility
  • Expand LiteRtService to support system runtime on Android.
  • Add vImageExtractChannelAndConvertToFloat function.
  • Compile with OpenCV 5's features
  • Add documentation for LiteRT Inference Calculator accelerators
  • Fix data race accessing GlContext::profiling_helper_
  • Add a "prefer_ahwb" flag to MemoryManager
  • Add Builder v2 and v3 APIs to change the node name
  • Add verbose debug logging for buffer pooling
  • Updates the manylinux Dockerfile and related build scripts to fix the
  • Re-format GraphRunner
  • Add EXIF orientation support to MpImageCreateFromFile and the Python Task API

MediaPipe Tasks update

This section should highlight the changes that are done specifically for any platform and don't propagate to
other platforms.

Android

  • Revert Java switch statement syntax update
  • Introducing utils to convert BaseOptions <-> proto::BaseOptions.
  • Release TextSummarizer and summarization_200m model
  • Release TextProofreader and proofread_200m model
  • Update TextSummarizer to load from file descriptor

iOS

  • Add Gecko support to iOS Text Embedding API
  • Remove iOS and Android LLM Inference Engine from release
  • appId/appVersion/osVersion to common utility.
  • Makes InteractiveSegmenter a legacy one, in preparation of releasing v2 / new interface.
  • Add Documents path fallback for MPPFileInfo.
  • Add TextProofreader and TextSummarizer to MediaPipe Tasks iOS.
  • Add AudioToolbox framework to MediaPipeTasksCommon podspec.

Javascript

  • Add Gecko support to MP Text Embedder for Web
  • Add a Module.BAZEL to MediaPipe and migrate JS depdendencies to Aspect JS
  • Add dummy logging framework
  • Add MediaPipe Tasks Privacy Notice
  • Add IIFE bundles for web task modules.
  • Export InteractiveSegmenter methods for public visibility
  • Allow MP Web LLM Inference to load .litertlm files containing web-formatted LLMs
  • MP Web LLM Inference: add new experimental 'disableRewinding' flag for testing long-context support
  • Cache running mode in VisionTaskRunner.

Python

  • Add Gecko support to the Python Text Embedder API
  • Remove MediaPipe Python GenAI components f
  • TextSummarizer Python API OSS
  • TextProofreader Python API OSS
  • Expose TextSummarizer and TextProofreader in MediaPipe Python Text API.
  • Add missing types and enums to the public Python Text API.

MediaPipe Dependencies

  • Do not load text files from GCS
Assets 2
Loading