Skip to content

b10783

Pre-release
Pre-release

Choose a tag to compare

@github-actions github-actions released this 03 Sep 11:17
f45576a

mtmd : add const in various places (#28307)

  • mtmd : mark context as const in more methods

Mark mtmd_context as const in:

  • mtmd_bitmap_init_lazy
  • mtmd_tokenize
  • mtmd_tokenize_from_parts
  • mtmd_helper_support_video
  • mtmd_helper_bitmap_init_from_file
  • mtmd_helper_bitmap_init_from_buf
  • mtmd_helper_video_init
  • mtmd_helper_video_init_from_buf
  • mtmd_helper_model_can_chat

The tokenization functions in particular are useful to have marked
const, as that allows more easily telling the compiler that we can
safely tokenize from multiple threads (mtmd_tokenize is already
documented as thread-safe, this just reifies that in the signature).

  • mtmd : mark tokenization input pointer as const

Mark the bitmaps and parts pointers in mtmd_tokenize and
mtmd_tokenize_from_parts as const. This allows more easily calling
these with immutable arrays / vectors.

  • mtmd : mark llama_context as const in mtmd_helper_model_can_chat

Website:

Attestations:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI: