WebRTC/media-streaming with Presentation API?

[rektide]

WebRTC / Presentation API media-streaming

Hello all. Coming to this spec & curious about how media across Presentation API devices would work. Is WebRTC is usable within OSP, & is that how such a use case would work, or is it intended that the Streaming Protocol is usable within Playback API? Is there any cross-integration between Streaming Protocol and WebRTC? Can OSP help set up QUIC connections that tools like WebTransport & other or future webrtc-quic work might leverage?

As a web developer trying to work with multimedia across multiple devices, I'd normally rely on WebRTC to, for example, have two user-agents share webcams with one another inside an HTML experience. If those tools & skills were portable into an OSP experience, that would be great. If not, can Presentation controllers and a receiver share video with each other via some other means?

relation to #117, streaming protocol

How if at all does this ask relate to this action item from May 15, 2018 Berlin F2F, mentioned in #117:

@mfoltzgoogle to open an issue on how to map WebRTC on the control protocol for media streaming

#117 was closed this past summer, declaring that, "OSP now has a streaming protocol (section 9, "Streaming Protocol."). This can be closed.".

I was initially hoping this implied that WebRTC needed to map atop the control protocol, but I'm not sure if I understood the original intent, & whether that intent in OSP has changed over time or not?

relation to webrtc-quic work

How do these use cases & desires relate to ongoing work in QUIC API for P2P connections and web-transport work, originating from this presentation mentioned in #84?

To me, there is some crude, approximate resemblence between what Streaming Protocol does & the QuicTransport interface, in that each works somewhat as a container for a bunch of different streams. Ideally as a developer I'd like to see some way for OSP devices to initiate these emerging standard communication technologies with each other.

developer experience with Streaming Protocol

At the risk of wandering further away from this Presentation API / WebRTC-oriented interest, I'd say in general I don't really understand what context the Streaming Protocol exists in, what it's for. It seems like it's a way to send audio & video & data, but where-as Presentation API & Remote Playback give me a sense of how & what the user experience would look like, I do not understand how & what Streaming Protocol is for: it's a protocol, an abstract capability, & I'm not sure how or where or who or what uses it. It would be helpful if the spec mentioned Streaming Protocol in the introduction or in general before [§ 9. Streaming Protocol](https://w3c.github.io/openscreenprotocol/#streaming-protocol Streaming Protocol).

My guess is that Streaming Protocol underlies a means for OSP Remote Playback & Presentation API to work, but I'm not sure how or where these developer-facing means get specified in terms of underlying Streaming Protocol interactions.

update Playback API requirements?

Ideally I'd like to see streaming media added to the Presentation API requirements. At the moment I'm not sure if it is a design goal or possibility or not.

Any further information about how these other upcoming technologies mix in with OSP would be good to hear too. Thank you, godspeed, I have high hopes this technology can send us all to fantastic new places.