Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Media Source Extensions API (MSE) #22416

Open
ferjm opened this issue Dec 11, 2018 · 6 comments
Open

Media Source Extensions API (MSE) #22416

ferjm opened this issue Dec 11, 2018 · 6 comments
Labels
A-content/media B-high-value Represents work that would have a big impact B-interesting-project Represents work that is expected to be interesting in some fashion E-very-complex Very difficult. Do not attempt without significant relevant experience and motivation.
Projects
Media playback

Comments

@ferjm
Copy link
Contributor

ferjm commented Dec 11, 2018

Spec: https://www.w3.org/TR/media-source/
@ferjm ferjm added E-very-complex Very difficult. Do not attempt without significant relevant experience and motivation. B-interesting-project Represents work that is expected to be interesting in some fashion B-high-value Represents work that would have a big impact A-content/media labels Dec 11, 2018
@ferjm
Copy link
Contributor Author

ferjm commented Dec 11, 2018

This branch contains some of the DOM bits that were implemented for gecko-media and that we may be able to reuse.

@ferjm ferjm added this to Backlog in Media playback Dec 11, 2018
@ferjm
Copy link
Contributor Author

ferjm commented Dec 11, 2018

WebKit has a GStreamer based implementation of this API http://eocanha.org/blog/2016/02/18/improving-media-source-extensions-on-gstreamer-based-webkit-ports/

@csmoe
Copy link
Contributor

csmoe commented Dec 15, 2018

@ferjm I'll take care of this as a short trip in servo codebase.

@ferjm
Copy link
Contributor Author

ferjm commented Dec 16, 2018

@csmoe Thanks for your interest in working on this issue!

Note that this is a pretty large project. A big chunk of the work should likely happen in https://github.com/servo/media and it will require quite some knowledge of how GStreamer works.

At the moment there are no specific plans or proposed architectures for this API other than following WebKit's one), so unless you want to propose an alternative approach, I would start by trying to prototype their GStreamer pipeline (here) (ideally along with similar MediaSource, SourceBuffer and MediaPlayer abstractions).

@pshaughn
Copy link
Member

WPT tests for the Fetch API care about this.

@jdm jdm changed the title Media Source Extensions API Media Source Extensions API (MSE) Jun 18, 2020
@jdm
Copy link
Member

jdm commented Jun 18, 2020 •
edited

Relevant webkit source: https://github.com/WebKit/webkit/tree/89c28d471fae35f1788a0f857067896a10af8974/Source/WebCore/platform/graphics/gstreamer/mse

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
A-content/media B-high-value Represents work that would have a big impact B-interesting-project Represents work that is expected to be interesting in some fashion E-very-complex Very difficult. Do not attempt without significant relevant experience and motivation.
Projects
Media playback
  
Backlog
Milestone
No milestone
Development

No branches or pull requests
4 participants
@jdm @ferjm @pshaughn @csmoe