DASH Grand Challenge at IEEE ICME 2018

Christian Timmerer edited this page Mar 12, 2018 · 8 revisions

Host organization: DASH-IF (http://dashif.org/)

Coordinator Contacts: Christian Timmerer, Chair of DASH-IF Academic Track (christian.timmerer@itec.aau.at) Ali C. Begen (ali.begen@networked.media)

Challenge Title: Grand Challenge on DASH

Challenge Description

Real-time entertainment services such as streaming video and audio are currently accounting for more than 70% of the Internet traffic during peak hours. Interestingly, these services are all delivered over-the-top (OTT) of the existing networking infrastructure using HTTP. The MPEG Dynamic Adaptive Streaming over HTTP (DASH) standard enables smooth multimedia streaming towards heterogeneous devices.

The MPEG DASH standard provides an interoperable representation format but deliberately does not define the adaptation behavior for the client implementations, which is left open for research and industry competition. In a typical deployment, the encoding itself is optimized for the respective delivery channels but - as the content is delivered over the top without any guarantees - various issues during the streaming (e.g., high startup delay, stalls/re-buffering, high switching frequency, inefficient network utilization, unfairness to competing network traffic, etc.) may limit the quality of experience (QoE) as perceived by the viewers.

The aim of this grand challenge is to solicit contributions addressing end-to-end delivery aspects that will help improve the QoE while optimally using the network resources at an acceptable cost. Such aspects include, but are not limited to, content preparation for adaptive streaming, delivery in the Internet and streaming client implementations.

A special focus of 2018’s grand challenge will be related to immersive media applications and services including omnidirectional/360-degree videos.

Dataset/APIs/Library URL

Evaluation Criteria

Evaluation of Streaming Performance

Each proposal shall be evaluated according to a predefined and well-established evaluation setup as documented in the current literature. This could be done using network emulation (based on synthetic or real-world network traces) or in real-world environments. The evaluation can be done within the lab and/or crowdsourcing using objective and subjective metrics.

The streaming performance shall be evaluated using the following metrics: initial/start-up delay, buffer underruns also known as stalls, quality switches, media throughput, network utilization, network costs, and objective (e.g., PSNR, SSIM, …) and subjective (MOS) quality scores.

Evaluation Methodology

Proposals for new evaluation methodologies to evaluate the streaming performance should contain a detailed description including dataset and source code of the methodology. This could include any new objective and subjective evaluation method in the broad area of adaptive media streaming over HTTP.

Disruptive Technology

Proposals for new, disruptive ways of video streaming are welcome along with proposals for content preparation, streaming, consumption, and evaluation methodologies. Such content should be made freely available for research and standardization purposes.

Deadline of Submission:

  • Submission deadline: March 26, 2018 (extended)
  • Acceptance notification: April 23, 2018
  • Camera Ready Paper submission deadline: May 11, 2018

Submission Guidelines

Submissions of DASH implementations or evaluation methodologies should provide a detailed technical description in the form of a short paper as well as material to validate the performance of the submission (e.g., dataset and binary executable to reconstruct and measure performance). Submissions for additional content should be made along with either a streaming algorithm or an evaluation methodology. Accepted papers will be included as part of the ICME proceedings and published on IEEEXplore if accepted after peer review.

Submission site: https://cmt3.research.microsoft.com/ICME2018W

Additional Information

A winner and runner-up will be selected by a judging committee from the DASH-IF. The winner will be awarded €750 and the runner-up will be awarded €250.

Questions and Requests

If you have any questions or requests, or need further clarifications, please the organizers.

You can’t perform that action at this time.
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.
Press h to open a hovercard with more details.