YourNetflixOurLab-TUFIQoE-2022

Chrome extension and Python/flask REST API for ecologically valid QoE experiment using Netflix streaming platform. Does NOT require usage of Netflix-1080p extension.

Technology stack

Frontend (Chrome extension)

• Webpack
• React
• Typescript
• HTML
• CSS (SASS)

Backend

• Python (Flask)
• Sqlite3

Installing and Running

Procedures:

1. Check if your Node.js version is >= 14.
2. Clone this repository.
3. Go to /extension folder.
4. Run npm install to install the dependencies.
5. Run npm run build
6. Load your extension on Chrome following:
   1. Access chrome://extensions/
   2. Check Developer mode
   3. Click on Load unpacked extension
   4. Select the build folder.
7. Run backend:
   1. cd into backend directory
   2. run python database/init.py to initialize SQLite3 database
   3. Create virtual environment python -m venv venv
   4. Activate the python virtual environment by running OS compatible command
   5. Install requirements pip install -r requirements.txt
   6. On macOS run source start-mac.sh || on Windows .\start-windows.bat
8. Happy hacking.

Glossary

• empty config - configuration file that does NOT contain all of the key-value pairs required to run experiment

  • mapping applicable
  • NOT experiment applicable

• complete config - configuration file that does contain all of the key-value pairs required to run experiment

  • mapping applicable (can be regenerated)
  • experiment applicable

• Bitrate to VMAF mapping - process of discovering VMAF substitutes to bitrate values available for a video in Netflix streaming platform. It is done by iterating. In this mode there is no communication with server.

Configuration file

Empty config file

{
  "assessment_interval": 150,
  "bitrate_interval": 150,
  "description": "description",
  "title": "title",
  "videos": [
    {
      "description": "",
      "name": "wielka_woda_s01e01",
      "url": "https://www.netflix.com/watch/81387423",
      "vmaf_template_scenario": [
        90,50,40,70,60,30,60,80,100,80,70,100,90,50,40,20
      ]
    }
  ]
}

Complete config file

{
  "assessment_interval": 150,
  "bitrate_interval": 150,
  "description": "",
  "title": "",
  "videos": [
    {
      "bitrate_vmaf_map": [
        {
          "bitrate": 101,
          "vmaf": 45
        },
        {
          "bitrate": 124,
          "vmaf": 55
        },
        {
          "bitrate": 153,
          "vmaf": 60
        },
        {
          "bitrate": 234,
          "vmaf": 71
        },
        {
          "bitrate": 364,
          "vmaf": 78
        },
        {
          "bitrate": 533,
          "vmaf": 83
        },
        {
          "bitrate": 949,
          "vmaf": 89
        },
        {
          "bitrate": 1618,
          "vmaf": 92
        },
        {
          "bitrate": 2919,
          "vmaf": 94
        },
        {
          "bitrate": 5886,
          "vmaf": 96
        }
      ],
      "description": "wielka_woda_s01e01",
      "name": "",
      "url": "https://www.netflix.com/watch/81387423",
      "vmaf_template_scenario": [
        90,50,40,70,60,30,60,80,100,80,70,100,90,50,40,20
      ],
      "scenario": [
        {
          "bitrate": 949,
          "vmaf": 89,
          "vmaf_template": 90,
          "vmaf_diff": 1
        },
        {
          "bitrate": 124,
          "vmaf": 55,
          "vmaf_template": 50,
          "vmaf_diff": 5
        },
        {
          "bitrate": 101,
          "vmaf": 45,
          "vmaf_template": 40,
          "vmaf_diff": 5
        },
        {
          "bitrate": 234,
          "vmaf": 71,
          "vmaf_template": 70,
          "vmaf_diff": 1
        },
        {
          "bitrate": 101,
          "vmaf": 45,
          "vmaf_template": 30,
          "vmaf_diff": 15
        },
        {
          "bitrate": 153,
          "vmaf": 60,
          "vmaf_template": 60,
          "vmaf_diff": 0
        },
        {
          "bitrate": 153,
          "vmaf": 60,
          "vmaf_template": 60,
          "vmaf_diff": 0
        },
        {
          "bitrate": 364,
          "vmaf": 78,
          "vmaf_template": 80,
          "vmaf_diff": 2
        },
        {
          "bitrate": 5886,
          "vmaf": 96,
          "vmaf_template": 100,
          "vmaf_diff": 4
        },
        {
          "bitrate": 364,
          "vmaf": 78,
          "vmaf_template": 80,
          "vmaf_diff": 2
        },
        {
          "bitrate": 234,
          "vmaf": 71,
          "vmaf_template": 70,
          "vmaf_diff": 1
        },
        {
          "bitrate": 5886,
          "vmaf": 96,
          "vmaf_template": 100,
          "vmaf_diff": 4
        },
        {
          "bitrate": 949,
          "vmaf": 89,
          "vmaf_template": 90,
          "vmaf_diff": 1
        },
        {
          "bitrate": 124,
          "vmaf": 55,
          "vmaf_template": 50,
          "vmaf_diff": 5
        },
        {
          "bitrate": 101,
          "vmaf": 45,
          "vmaf_template": 40,
          "vmaf_diff": 5
        },
        {
          "bitrate": 101,
          "vmaf": 45,
          "vmaf_template": 20,
          "vmaf_diff": 25
        }
      ]
    }
  ]
}