Skip to content

Commit

Permalink
measure-quality: updated bitrates to provide better bd-rate overlap f…
Browse files Browse the repository at this point in the history
…or some sequences

Issue: VSMGWL-64651

After some studies we re-adjusted bitrates for MrFox/Sintel/Hearthstone
sequences to better future proof our BD-Rate calculations and provide a
larger range of potential overlap.
  • Loading branch information
chandler-brown authored and dvrogozh committed Aug 11, 2023
1 parent a30bb2c commit 38ac18f
Show file tree
Hide file tree
Showing 60 changed files with 418 additions and 404 deletions.
8 changes: 4 additions & 4 deletions doc/man/measure-quality.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -128,14 +128,14 @@ h| H.264/AVC h| H.265/HEVC h| AV1 h| H.264/AVC h| H.265/HEVC h| AV1
| PierSeaSide | 1280x720 | 1, 1.5, 3, 6, 12 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 6, 12 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5
| Tango | 1280x720 | 1, 1.5, 3, 6, 12 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 6, 12 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5
| TouchDownPass | 1280x720 | 1, 1.5, 3, 6, 12 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 6, 12 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5
| Bunny | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 8, 9, 10, 11, 12
| Bunny | 1920x1080 | 2, 3, 6, 9, 12 | 2, 3, 6, 9, 12 | 2, 3, 6, 9, 15 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 8, 9, 10, 11, 12
| CSGO | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 1.5, 2, 3, 9, 15
| DOTA2 | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15
| GTAV | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15
| Hearthstone | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15
| Hearthstone | 1920x1080 | 1.125, 2.25, 3, 5.5, 10 | 1.125, 2.25, 3, 5.5, 10 | 1.125, 2.25, 3, 5.5, 10 | 0.75, 1.125, 2.25, 3.25, 5.5 | 0.75, 1.125, 2.25, 3.25, 5.5 | 0.75, 1.125, 2.25, 3.25, 5.5
| Minecraft | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15
| MrFox_BlueBird | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15
| Sintel_o537n480 | 1920x1080 | 0.5, 1, 2, 6, 9 | 0.5, 1, 2, 6, 9 | 0.5, 1, 2, 6, 9 | 0.5, 1, 2, 6, 9 | 0.5, 1, 2, 6, 9 | 0.5, 1, 2, 6, 9
| MrFox_BlueBird | 1920x1080 | 1.125, 2.25, 3, 4, 5.5 | 0.75, 1.125, 2.25, 3.25, 5.5 | 0.75, 1.125, 2.25, 3.25, 5.5 | 0.75, 1.125, 2.25, 3.25, 5.5 | 0.75, 1.125, 2.25, 3.25, 5.5 | 0.75, 1.125, 2.25, 3.25, 5.5
| Sintel_o537n480 | 1920x1080 | 0.5, 1, 1.5, 2, 3 | 0.25, 0.5, 1, 1.5, 2 | 0.25, 0.5, 1, 1.5, 2 | 0.25, 0.5, 1, 1.5, 2 | 0.25, 0.5, 1, 1.5, 2 | 0.25, 0.5, 1, 1.5, 2
| Witcher | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15
|===

Expand Down
120 changes: 59 additions & 61 deletions doc/quality-lowdelay.rst
Original file line number Diff line number Diff line change
Expand Up @@ -141,67 +141,65 @@ The following table shows specific target bitrates used in quality evaluation of
based video encoders (for LD use case). Note that 5 bitrates are given: the lowest 4 are used for the low BD-rate
measure while the largest 4 are used for the high BD-rate measure.

+-------------------------------+------------+-----------------------------------------------------------------+
| Sequence | Resolution | Bitrates (Mb/s) |
| | +---------------------+---------------------+---------------------+
| | | H.264/AVC | H.265/HEVC | AV1 |
+===============================+============+=====================+=====================+=====================+
| BasketBallDrive | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| BQTerrace | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| Cactus | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| CrowdRun :sup:`*` | 1920x1080 | 15, 20, 25, 30, 35 | 15, 20, 25, 30, 35 | 15, 20, 25, 30, 35 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| DinnerScene :sup:`*` | 1920x1080 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 7, 11, 15 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| Kimono :sup:`*` | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3.5, 6, 9, 15 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| ParkJoy :sup:`*` | 1920x1080 | 15, 20, 25, 30, 35 | 15, 20, 25, 30, 35 | 15, 20, 25, 30, 35 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| RedKayak :sup:`*` | 1920x1080 | 2, 3, 6, 12, 24 | 9, 12, 15, 18, 22 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| RushFieldCuts | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| Boat | 1280x720 | 1, 1.5, 3, 6, 12 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| CrowdRun :sup:`*` | 1280x720 | 3, 4.5, 7.5, 10, 12 | 3, 4.5, 7.5, 10, 12 | 3, 4.5, 7.5, 10, 12 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| FoodMarket | 1280x720 | 1, 1.5, 3, 6, 12 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| Kimono | 1280x720 | 1, 1.5, 3, 6, 12 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| ParkJoy :sup:`*` | 1280x720 | 3, 4.5, 7.5, 10, 12 | 3, 4.5, 7.5, 10, 12 | 3, 4.5, 7.5, 10, 12 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| ParkScene | 1280x720 | 1, 1.5, 3, 6, 12 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| PierSeaSide | 1280x720 | 1, 1.5, 3, 6, 12 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| Tango | 1280x720 | 1, 1.5, 3, 6, 12 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| TouchDownPass | 1280x720 | 1, 1.5, 3, 6, 12 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| Bunny :sup:`*` | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 8, 9, 10, 11, 12 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| CSGO :sup:`*` | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 1.5, 2, 3, 9, 15 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| DOTA2 | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| GTAV | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| Hearthstone | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| Minecraft | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| MrFox_BlueBird | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| Sintel_offset537n480 :sup:`*` | 1920x1080 | 0.5, 1, 2, 6, 9 | 0.5, 1, 2, 6, 9 | 0.5, 1, 2, 6, 9 |
+-------------------------------+------------+---------------------+---------------------+---------------------+
| Witcher | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+---------------------+---------------------+---------------------+

:sup:`*` Sequences requiring exceptional target bitrates
+-------------------------------+------------+--------------------------------------------------------------------------------------------+
| Sequence | Resolution | Bitrates (Mb/s) |
| | +------------------------------+------------------------------+------------------------------+
| | | H.264/AVC | H.265/HEVC | AV1 |
+===============================+============+==============================+==============================+==============================+
| BasketBallDrive | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| BQTerrace | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| Cactus | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| CrowdRun | 1920x1080 | 15, 20, 25, 30, 35 | 15, 20, 25, 30, 35 | 15, 20, 25, 30, 35 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| DinnerScene | 1920x1080 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 7, 11, 15 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| Kimono | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3.5, 6, 9, 15 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| ParkJoy | 1920x1080 | 15, 20, 25, 30, 35 | 15, 20, 25, 30, 35 | 15, 20, 25, 30, 35 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| RedKayak | 1920x1080 | 2, 3, 6, 12, 24 | 9, 12, 15, 18, 22 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| RushFieldCuts | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| Boat | 1280x720 | 1, 1.5, 3, 6, 12 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| CrowdRun | 1280x720 | 3, 4.5, 7.5, 10, 12 | 3, 4.5, 7.5, 10, 12 | 3, 4.5, 7.5, 10, 12 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| FoodMarket | 1280x720 | 1, 1.5, 3, 6, 12 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| Kimono | 1280x720 | 1, 1.5, 3, 6, 12 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| ParkJoy | 1280x720 | 3, 4.5, 7.5, 10, 12 | 3, 4.5, 7.5, 10, 12 | 3, 4.5, 7.5, 10, 12 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| ParkScene | 1280x720 | 1, 1.5, 3, 6, 12 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| PierSeaSide | 1280x720 | 1, 1.5, 3, 6, 12 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| Tango | 1280x720 | 1, 1.5, 3, 6, 12 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| TouchDownPass | 1280x720 | 1, 1.5, 3, 6, 12 | 1, 1.5, 3, 4.5, 7.5 | 1, 1.5, 3, 4.5, 7.5 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| Bunny | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 8, 9, 10, 11, 12 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| CSGO | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 1.5, 2, 3, 9, 15 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| DOTA2 | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| GTAV | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| Hearthstone | 1920x1080 | 0.75, 1.125, 2.25, 3.25, 5.5 | 0.75, 1.125, 2.25, 3.25, 5.5 | 0.75, 1.125, 2.25, 3.25, 5.5 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| Minecraft | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| MrFox_BlueBird | 1920x1080 | 0.75, 1.125, 2.25, 3.25, 5.5 | 0.75, 1.125, 2.25, 3.25, 5.5 | 0.75, 1.125, 2.25, 3.25, 5.5 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| Sintel_offset537n480 | 1920x1080 | 0.25, 0.5, 1, 1.5, 2 | 0.25, 0.5, 1, 1.5, 2 | 0.25, 0.5, 1, 1.5, 2 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+
| Witcher | 1920x1080 | 2, 3, 6, 12, 24 | 2, 3, 6, 9, 15 | 2, 3, 6, 9, 15 |
+-------------------------------+------------+------------------------------+------------------------------+------------------------------+

If a user does not explicitly specify the target bitrates for a user-defined sequence or stream, the following
bitrates are used by default:
Expand Down
Loading

0 comments on commit 38ac18f

Please sign in to comment.