Skip to content

Disable training the backout model in the integration test

554f48d
Select commit
Loading
Failed to load commit list.
Merged

Disable training the backout model in the integration test #5021

Disable training the backout model in the integration test
554f48d
Select commit
Loading
Failed to load commit list.
Community-TC Integration / bugbug http service tests succeeded May 15, 2025 in 8m 17s

Community-TC (pull_request)

bugbug http service tests

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2025-05-15T16:26:54.637Z
Resolved: 2025-05-15T16:32:28.893Z
Task Execution Time: 5 minutes, 34 seconds, 256 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log


[taskcluster 2025-05-15T16:26:54.686Z] Worker Type (proj-bugbug/compute-smaller) settings:
[taskcluster 2025-05-15T16:26:54.686Z]   {
[taskcluster 2025-05-15T16:26:54.686Z]     "config": {
[taskcluster 2025-05-15T16:26:54.686Z]       "deploymentId": "ee7fd5d1e82e1257"
[taskcluster 2025-05-15T16:26:54.686Z]     },
[taskcluster 2025-05-15T16:26:54.686Z]     "generic-worker": {
[taskcluster 2025-05-15T16:26:54.686Z]       "config": {
[taskcluster 2025-05-15T16:26:54.686Z]         "headlessTasks": false
[taskcluster 2025-05-15T16:26:54.686Z]       },
[taskcluster 2025-05-15T16:26:54.686Z]       "engine": "multiuser",
[taskcluster 2025-05-15T16:26:54.686Z]       "go-arch": "amd64",
[taskcluster 2025-05-15T16:26:54.686Z]       "go-os": "linux",
[taskcluster 2025-05-15T16:26:54.686Z]       "go-version": "go1.24.2",
[taskcluster 2025-05-15T16:26:54.686Z]       "release": "https://github.com/taskcluster/taskcluster/releases/tag/v83.8.0",
[taskcluster 2025-05-15T16:26:54.686Z]       "revision": "f890ebf91e50708df52b1a709f12348b4cbe11f2",
[taskcluster 2025-05-15T16:26:54.686Z]       "source": "https://github.com/taskcluster/taskcluster/commits/f890ebf91e50708df52b1a709f12348b4cbe11f2",
[taskcluster 2025-05-15T16:26:54.686Z]       "version": "83.8.0"
[taskcluster 2025-05-15T16:26:54.686Z]     },
[taskcluster 2025-05-15T16:26:54.686Z]     "image": "projects/community-tc-workers/global/images/generic-worker-ubuntu-24-04-2uo4gttmexnap22h9yfl",
[taskcluster 2025-05-15T16:26:54.686Z]     "instance-id": "4334301610286754778",

...(892 lines hidden)...

  Downloading Redis_Sentinel_Url-1.0.1-py2.py3-none-any.whl.metadata (1.0 kB)
Requirement already satisfied: markupsafe in /usr/local/lib/python3.12/site-packages (from sentry-sdk[flask]==2.27.0->bugbug-http-service==0.0.574) (3.0.2)
Requirement already satisfied: python-dateutil>=2.7.0 in /usr/local/lib/python3.12/site-packages (from arrow->rq-dashboard==0.8.2.2->bugbug-http-service==0.0.574) (2.9.0.post0)
Requirement already satisfied: types-python-dateutil>=2.8.10 in /usr/local/lib/python3.12/site-packages (from arrow->rq-dashboard==0.8.2.2->bugbug-http-service==0.0.574) (2.9.0.20241206)
Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.12/site-packages (from python-dateutil>=2.7.0->arrow->rq-dashboard==0.8.2.2->bugbug-http-service==0.0.574) (1.17.0)
Downloading apispec-6.8.1-py3-none-any.whl (30 kB)
Downloading apispec_webframeworks-1.2.0-py3-none-any.whl (9.1 kB)
Downloading Cerberus-1.3.7-py3-none-any.whl (30 kB)
Downloading flask-3.1.0-py3-none-any.whl (102 kB)
Downloading flask_apispec-0.11.4-py2.py3-none-any.whl (2.4 MB)
Downloading flask_cors-5.0.1-py3-none-any.whl (11 kB)
Downloading gunicorn-23.0.0-py3-none-any.whl (85 kB)
Downloading kombu-5.5.3-py3-none-any.whl (209 kB)
Downloading rq-2.3.2-py3-none-any.whl (100 kB)
Downloading rq_dashboard-0.8.2.2-py2.py3-none-any.whl (210 kB)
Downloading sentry_sdk-2.27.0-py2.py3-none-any.whl (340 kB)
Downloading blinker-1.9.0-py3-none-any.whl (8.5 kB)
Downloading click-8.2.0-py3-none-any.whl (102 kB)
Downloading itsdangerous-2.2.0-py3-none-any.whl (16 kB)
Downloading redis-6.1.0-py3-none-any.whl (273 kB)
Downloading webargs-8.7.0-py3-none-any.whl (31 kB)
Downloading werkzeug-3.1.3-py3-none-any.whl (224 kB)
Downloading Redis_Sentinel_Url-1.0.1-py2.py3-none-any.whl (4.7 kB)
Building wheels for collected packages: bugbug-http-service
  Building wheel for bugbug-http-service (setup.py) ... -� �\� �done
  Created wheel for bugbug-http-service: filename=bugbug_http_service-0.0.574-py3-none-any.whl size=31679 sha256=726a1767ad7ca0a2f0c6c04d67f84552cf5f6fda7951865211d03d715d9171ed
  Stored in directory: /tmp/pip-ephem-wheel-cache-wy2raji3/wheels/95/f3/17/087a179ea056096ae433a20934a06ba3620178dfafa8d0c733
Successfully built bugbug-http-service
Installing collected packages: Werkzeug, sentry-sdk, redis, itsdangerous, gunicorn, click, cerberus, blinker, apispec, webargs, rq, redis-sentinel-url, kombu, Flask, rq-dashboard, flask-cors, flask-apispec, apispec-webframeworks, bugbug-http-service
Successfully installed Flask-3.1.0 Werkzeug-3.1.3 apispec-6.8.1 apispec-webframeworks-1.2.0 blinker-1.9.0 bugbug-http-service-0.0.574 cerberus-1.3.7 click-8.2.0 flask-apispec-0.11.4 flask-cors-5.0.1 gunicorn-23.0.0 itsdangerous-2.2.0 kombu-5.5.3 redis-6.1.0 redis-sentinel-url-1.0.1 rq-2.3.2 rq-dashboard-0.8.2.2 sentry-sdk-2.27.0 webargs-8.7.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
+ hg clone -r 90302f015ac8dd8877ef3ee24b5a62541142378b https://hg.mozilla.org/hgcustom/version-control-tools /version-control-tools/
*** failed to import extension "robustcheckout" from /version-control-tools/hgext/robustcheckout/__init__.py: [Errno 2] No such file or directory: '/version-control-tools/hgext/robustcheckout/__init__.py'
*** failed to import extension "hgmo" from /version-control-tools/hgext/hgmo: [Errno 2] No such file or directory: '/version-control-tools/hgext/hgmo'
*** failed to import extension "pushlog" from /version-control-tools/hgext/pushlog: [Errno 2] No such file or directory: '/version-control-tools/hgext/pushlog'
*** failed to import extension "mozext" from /version-control-tools/hgext/mozext: [Errno 2] No such file or directory: '/version-control-tools/hgext/mozext'
real URL is https://hg-edge.mozilla.org/hgcustom/version-control-tools
adding changesets
adding manifests
adding file changes

files [======================================>                  ] 2063/2977 01s
files [==========================================>              ] 2270/2977 01s
files [===========================================>             ] 2340/2977 01s
files [==============================================>          ] 2461/2977 01s
files [================================================>        ] 2566/2977 01s
files [===================================================>     ] 2742/2977 01s
files [====================================================>    ] 2780/2977 01s
files [=======================================================> ] 2961/2977 01s
                                                                                
added 8152 changesets with 19504 changes to 2977 files
new changesets 8277a178b3cb:90302f015ac8
updating to branch default
1300 files updated, 0 files merged, 0 files removed, 0 files unresolved
+ pytest --cov=http_service http_service/tests/ -vvv
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-8.3.5, pluggy-1.6.0 -- /usr/local/bin/python
cachedir: .pytest_cache
hypothesis profile 'default' -> database=DirectoryBasedExampleDatabase(PosixPath('/bugbug/.hypothesis/examples'))
rootdir: /bugbug/http_service/tests
configfile: pytest.ini
plugins: responses-0.5.1, langsmith-0.3.42, hypothesis-6.131.9, cov-6.1.1, anyio-4.9.0
collecting ... 
collected 22 items                                                             

http_service/tests/test_bug_classification.py::test_model_predict_id PASSED [  4%]
http_service/tests/test_bug_classification.py::test_model_predict_id_github PASSED [  9%]
http_service/tests/test_bug_classification.py::test_model_predict_batch PASSED [ 13%]
http_service/tests/test_bug_classification.py::test_model_predict_batch_broken_site_reports PASSED [ 18%]
http_service/tests/test_bug_classification.py::test_for_missing_bugs PASSED [ 22%]
http_service/tests/test_bug_classification.py::test_empty_batch PASSED   [ 27%]
http_service/tests/test_bug_classification.py::test_non_int_batch PASSED [ 31%]
http_service/tests/test_bug_classification.py::test_unknown_model PASSED [ 36%]
http_service/tests/test_bug_classification.py::test_no_api_key PASSED    [ 40%]
http_service/tests/test_get_config_specific_groups.py::test_get_config_specific_groups PASSED [ 45%]
http_service/tests/test_push_schedules.py::test_queue_job_valid PASSED   [ 50%]
http_service/tests/test_push_schedules.py::test_no_api_key PASSED        [ 54%]
http_service/tests/test_readthrough_cache.py::test_doesnt_cache_unless_accessed_within_ttl PASSED [ 59%]
http_service/tests/test_readthrough_cache.py::test_cache_purges_after_ttl PASSED [ 63%]
http_service/tests/test_readthrough_cache.py::test_cache_ttl_refreshes_after_get PASSED [ 68%]
http_service/tests/test_readthrough_cache.py::test_force_store PASSED    [ 72%]
http_service/tests/test_readthrough_cache.py::test_cache_thread PASSED   [ 77%]
http_service/tests/test_schedule_tests.py::test_simple_schedule[labels_to_choose0-groups_to_choose0-reduced_labels0-config_groups0] PASSED [ 81%]
http_service/tests/test_schedule_tests.py::test_simple_schedule[labels_to_choose1-groups_to_choose1-reduced_labels1-config_groups1] PASSED [ 86%]
http_service/tests/test_schedule_tests.py::test_simple_schedule[labels_to_choose2-groups_to_choose2-reduced_labels2-config_groups2] PASSED [ 90%]
http_service/tests/test_schedule_tests.py::test_simple_schedule[labels_to_choose3-groups_to_choose3-reduced_labels3-config_groups3] PASSED [ 95%]
http_service/tests/test_schedule_tests.py::test_simple_schedule[labels_to_choose4-groups_to_choose4-reduced_labels4-config_groups4] PASSED [100%]

=============================== warnings summary ===============================
<frozen importlib._bootstrap>:488
  <frozen importlib._bootstrap>:488: DeprecationWarning: builtin type SwigPyPacked has no __module__ attribute

<frozen importlib._bootstrap>:488
  <frozen importlib._bootstrap>:488: DeprecationWarning: builtin type SwigPyObject has no __module__ attribute

<frozen importlib._bootstrap>:488
  <frozen importlib._bootstrap>:488: DeprecationWarning: builtin type swigvarlink has no __module__ attribute

http_service/bugbug_http/readthrough_cache.py:73
test_readthrough_cache.py::test_cache_thread
  /bugbug/http_service/bugbug_http/readthrough_cache.py:73: DeprecationWarning: setDaemon() is deprecated, set the daemon attribute instead
    thread.setDaemon(True)

../usr/local/lib/python3.12/site-packages/marshmallow/fields.py:1218
  /usr/local/lib/python3.12/site-packages/marshmallow/fields.py:1218: RemovedInMarshmallow4Warning: Passing field metadata as keyword arguments is deprecated. Use the explicit `metadata=...` argument instead. Additional metadata: {'enum': [False]}
    super().__init__(**kwargs)

http_service/bugbug_http/app.py:114
  /bugbug/http_service/bugbug_http/app.py:114: RemovedInMarshmallow4Warning: Passing field metadata as keyword arguments is deprecated. Use the explicit `metadata=...` argument instead. Additional metadata: {'enum': ['defectenhancementtask', 'component', 'invalidcompatibilityreport', 'needsdiagnosis', 'regression', 'stepstoreproduce', 'spambug', 'testlabelselect', 'testgroupselect', 'accessibility', 'performancebug', 'worksforme', 'fenixcomponent'], 'example': 'component'}
    model_name = fields.Str(enum=MODELS_NAMES, example="component")

http_service/bugbug_http/app.py:118
  /bugbug/http_service/bugbug_http/app.py:118: RemovedInMarshmallow4Warning: The 'default' argument to fields is deprecated. Use 'dump_default' instead.
    message = fields.Str(default="Error, missing X-API-KEY")

http_service/bugbug_http/app.py:122
  /bugbug/http_service/bugbug_http/app.py:122: RemovedInMarshmallow4Warning: Passing field metadata as keyword arguments is deprecated. Use the explicit `metadata=...` argument instead. Additional metadata: {'example': 'autoland'}
    branch = fields.Str(example="autoland")

test_schedule_tests.py: 10 warnings
  /usr/local/lib/python3.12/site-packages/bugbug/repository.py:898: DeprecationWarning: datetime.datetime.utcnow() is deprecated and scheduled for removal in a future version. Use timezone-aware objects to represent datetimes in UTC: datetime.datetime.now(datetime.UTC).
    pushdate = datetime.utcnow()

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
================================ tests coverage ================================
_______________ coverage: platform linux, python 3.12.3-final-0 ________________

Name                                                    Stmts   Miss  Cover
---------------------------------------------------------------------------
http_service/bugbug_http/__init__.py                        4      0   100%
http_service/bugbug_http/app.py                           367     44    88%
http_service/bugbug_http/boot.py                          123    123     0%
http_service/bugbug_http/download_models.py                18     18     0%
http_service/bugbug_http/listener.py                       59     59     0%
http_service/bugbug_http/models.py                        154     82    47%
http_service/bugbug_http/readthrough_cache.py              44      0   100%
http_service/bugbug_http/sentry.py                          7      2    71%
http_service/bugbug_http/worker.py                         20     20     0%
http_service/setup.py                                      10     10     0%
http_service/tests/__init__.py                              0      0   100%
http_service/tests/conftest.py                            235      9    96%
http_service/tests/test_bug_classification.py             115      1    99%
http_service/tests/test_get_config_specific_groups.py      10      0   100%
http_service/tests/test_integration.py                     38     28    26%
http_service/tests/test_push_schedules.py                  24      1    96%
http_service/tests/test_readthrough_cache.py              113      6    95%
http_service/tests/test_schedule_tests.py                  30      0   100%
---------------------------------------------------------------------------
TOTAL                                                    1371    403    71%
======================= 22 passed, 19 warnings in 48.98s =======================
+ bash /dev/fd/63
++ curl -s https://codecov.io/bash

  _____          _
 / ____|        | |
| |     ___   __| | ___  ___ _____   __
| |    / _ \ / _` |/ _ \/ __/ _ \ \ / /
| |___| (_) | (_| |  __/ (_| (_) \ V /
 \_____\___/ \__,_|\___|\___\___/ \_/
                              Bash-1.0.6


==> git version 2.39.2 found
==> curl 7.88.1 (x86_64-pc-linux-gnu) libcurl/7.88.1 OpenSSL/3.0.11 zlib/1.2.13 brotli/1.0.9 zstd/1.5.4 libidn2/2.3.3 libpsl/0.21.2 (+libidn2/2.3.3) libssh2/1.10.0 nghttp2/1.52.0 librtmp/2.3 OpenLDAP/2.5.13
Release-Date: 2023-02-20, security patched: 7.88.1-10+deb12u5
Protocols: dict file ftp ftps gopher gophers http https imap imaps ldap ldaps mqtt pop3 pop3s rtmp rtsp scp sftp smb smbs smtp smtps telnet tftp
Features: alt-svc AsynchDNS brotli GSS-API HSTS HTTP2 HTTPS-proxy IDN IPv6 Kerberos Largefile libz NTLM NTLM_WB PSL SPNEGO SSL threadsafe TLS-SRP UnixSockets zstd
x> No CI provider detected.
    Testing inside Docker? http://docs.codecov.io/docs/testing-with-docker
    Testing with Tox? https://docs.codecov.io/docs/python#section-testing-with-tox
    current dir:  /bugbug
    project root: .
--> token set from env
    Yaml found at: .codecov.yml
==> Running gcov in . (disable via -X gcov)
==> Python coveragepy exists disable via -X coveragepy
    -> Running coverage xml
==> Searching for coverage reports in:
    + .
    -> Found 1 reports
==> Detecting git/mercurial file structure
==> Reading reports
    + ./coverage.xml bytes=52988
==> Appending adjustments
    https://docs.codecov.io/docs/fixing-reports
    -> No adjustments found
==> Gzipping contents
        8.0K	/tmp/codecov.GXVaWH.gz
==> Uploading reports
    url: https://codecov.io
    query: branch=&commit=554f48defe8f7581c142b24b376aa096e241c1eb&build=&build_url=&name=&tag=&slug=&service=&flags=&pr=&job=&cmd_args=
->  Pinging Codecov
https://codecov.io/upload/v4?package=bash-1.0.6&token=<hidden>&package=bash-1.0.6&token=66162f89-a4d9-420c-84bd-d10f12a428d9&branch=&commit=554f48defe8f7581c142b24b376aa096e241c1eb&build=&build_url=&name=&tag=&slug=&service=&flags=&pr=&job=&cmd_args=
->  Uploading to
https://storage.googleapis.com/codecov-production/shelter/v4/github/mozilla/bugbug/554f48defe8f7581c142b24b376aa096e241c1eb/d020d9da-ede7-4e9a-8492-55c54324f99f.txt?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GOOG1EJWQHUGIBILH4J7Q6ZUSCIFNEOLYSNDS7L3B4N5SIBQ2J4YLYE5CRFCD%2F20250515%2Fus%2Fs3%2Faws4_request&X-Amz-Date=20250515T163227Z&X-Amz-Expires=120&X-Amz-SignedHeaders=host&X-Amz-Signature=7d1d72d1c36b24f8644ed8629e87779d6018091dee7f75b98cf6e865929bef34
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  5655    0     0  100  5655      0  59305 --:--:-- --:--:-- --:--:-- 59526
    -> Reports have been successfully queued for processing at https://app.codecov.io/github/mozilla/bugbug/commit/554f48defe8f7581c142b24b376aa096e241c1eb
[taskcluster 2025-05-15T16:32:27.446Z]                   Exit Code: 0
[taskcluster 2025-05-15T16:32:27.446Z]                   User Time: 213.515ms
[taskcluster 2025-05-15T16:32:27.446Z]                 Kernel Time: 70.848ms
[taskcluster 2025-05-15T16:32:27.446Z]                   Wall Time: 5m5.446070113s
[taskcluster 2025-05-15T16:32:27.446Z]  Average System Memory Used: 1.33 GiB
[taskcluster 2025-05-15T16:32:27.446Z]     Peak System Memory Used: 2.25 GiB
[taskcluster 2025-05-15T16:32:27.446Z]         Total System Memory: 7.75 GiB
[taskcluster 2025-05-15T16:32:27.446Z]                      Result: SUCCEEDED
[taskcluster 2025-05-15T16:32:27.446Z] === Task Finished ===
[taskcluster 2025-05-15T16:32:27.446Z] Task Duration: 5m5.44649238s
[taskcluster 2025-05-15T16:32:28.548Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2026-05-15T17:24:11.804Z