Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update bitrate calculation scripts for the IS24 discrete speech challenge #5677

Merged
merged 7 commits into from
Feb 27, 2024

Conversation

ftshijt
Copy link
Collaborator

@ftshijt ftshijt commented Feb 26, 2024

Two scripts for bitrate calculation.

The calculate_bitrate.py is for processing the submission package (i.e., all submission from participants shall be able to use this one to compute)

The convert_token2json.py is for converting espnet baseline results into a submission package.

Please consider merging it in advance so @simpleoier can push the ASR side scoring and I update the TTS and SVS scoring.

@mergify mergify bot added the ESPnet2 label Feb 26, 2024
@ftshijt ftshijt added Recipe TTS Text-to-speech ASR Automatic speech recogntion Music Music processing labels Feb 26, 2024
@ftshijt ftshijt added this to the v.202405 milestone Feb 26, 2024
Copy link

codecov bot commented Feb 26, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 70.27%. Comparing base (3ad92c2) to head (1d3ede4).

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #5677      +/-   ##
==========================================
- Coverage   76.11%   70.27%   -5.85%     
==========================================
  Files         747      746       -1     
  Lines       69409    69369      -40     
==========================================
- Hits        52834    48752    -4082     
- Misses      16575    20617    +4042     
Flag Coverage Δ
test_configuration_espnet2 ∅ <ø> (∅)
test_integration_espnet1 62.92% <ø> (ø)
test_integration_espnet2 ?
test_python_espnet1 18.32% <ø> (ø)
test_python_espnet2 52.05% <ø> (-0.65%) ⬇️
test_utils 21.90% <ø> (-0.26%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@sw005320
Copy link
Contributor

OK, thanks.
Please also add the test for this function when you make a PR for scoring.

@sw005320 sw005320 added the auto-merge Enable auto-merge label Feb 26, 2024
@sw005320 sw005320 merged commit 631ffa7 into espnet:master Feb 27, 2024
19 of 27 checks passed
@sw005320
Copy link
Contributor

I'm merged it assuming that the CI error is not related to this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ASR Automatic speech recogntion auto-merge Enable auto-merge ESPnet2 Music Music processing Recipe TTS Text-to-speech
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants