Refer to a spatial bounding box of video (by area)

[jronallo]

Description

Refer to a spatial bounding box of video (by area)

Proposed Solutions

xywh media fragments (same as for images)

Related IIIF: Canvas # Fragments

Additional Background

Source: BL workshop notes
Interest: 100%

[azaroth42]

If the use case is to refer to an area for an annotation, then we would annotate the Canvas directly, not the media asset. For example, to annotate a part of the "video" to identify an object that's depicted.

So it's not request a region from within a video, it's just refer to it. If we follow the current pattern (and I think we should), then we get this for free from the Presentation API when it supports A/V on canvases.

[zimeon]

Summary of discussion on 2016-08-23 A/V WG Call:

• Issue is about reference to spatial bounding box of a video by area (not download (Segmentation by time for download #4,Request a snippet be created for later download #47), or playback (~ Zoom into videos #25))
• Terminology: use "region" (cf. region in Image API) which is specified in terms of xywh as we use for both canvases and images
• Question of whether aspect ratio comes into play? Whether we are talking about effective dimensions or actual dimensions? If we consider this use case to be about reference as opposed to request, then that means we would be referring to a region of a Canvas so this is mainly a presentation API issue.
• Example uses:
  • Would like to be able to say "the person that you’re seeing in the background of this video in this region has this name..." as an annotation
• Part of the issue when talking about regions on videos is areas/regions of interest changing over time (with still images, referring to a region/area of interest will not change over time)
• Perhaps not a very common feature... maybe concentrate on more common features such as jumping to certain point in time, or certain duration of video/audio
• Avalon does no not yet deal with annotation of a region of video, but it is a use case that comes up
• Note that corresponding temporal reference use case is Refer to a point or range in time of the content #11, being able to refer to both region and time point or range seems more common than region alone.