Roman Solovyev, Alexander Stempkovskiy, Tatiana Habruseva

[ZFTurbo]

Roman Solovyev, Alexander Stempkovskiy, Tatiana Habruseva

AUTHOR

Dear SDX workshop committee,

I request a review for the following SDX submission (Abstract: 250 Words+one page pdf)_

As a participant of the SDX challenge, please know that your talk would be automatically accepted after a minimal prescreening. Hence, don't forget to provide us with the link to your team in the AIcrowd website.
You are also welcome to submit us some unrelated abstract, in case your interest would be in presenting some method or idea you would just like to discuss with the participants passing by.

Benchmarks and leaderboards for sound demixing tasks

Author(s):

• Roman Solovyev
• Alexander Stempkovskiy
• Tatiana Habruseva

Challenge submission (weather this submission is related to an sdx challenge entry):

• MDX Leaderboard A
• MDX Leaderboard B
• MDX Leaderboard C
• CDX Leaderboard A
• CDX Leaderboard B

Workshop participance

• Virtual
• On-Site

---

ORGANISATION COMMITTEE (do not fill out)

• Editor acknowledgment
• Reviewer 1
• Reviewer 2
• Review 1 decision [accept/reject]
• Review 2 decision [accept/reject]
• Editor decision [accept/reject]

[faroit]

👋 @ZFTurbo thanks for your submission. We are going to start reviewing end of this week!

[StefanUhlich-sony]

Hello @ZFTurbo, thanks a lot for your submission - everything looks fine, I only have the two small comments below.

One other thing (not for the abstract - just out of curiosity 😊): Did you compare your leaderboard ranking to the ranking that you would obtain with MUSDB18 (test split)? It would be interesting to see the correlation for each song - maybe there are some songs more suited to predict the performance on MDXDB21.

[ZFTurbo]

One other thing (not for the abstract - just out of curiosity 😊): Did you compare your leaderboard ranking to the ranking that you would obtain with MUSDB18 (test split)? It would be interesting to see the correlation for each song - maybe there are some songs more suited to predict the performance on MDXDB21.

1. I can't compare with MUSDB18 (test) because it was used for training of models in many cases (for example for training demucs). So I can't gurantee fair comparison of algorithms.
2. I actually made a comparison of different algorithms on Multisong dataset vs MDXDB21 (I did submissions on AICrowd leaderboard). I can create the table later. Multisong dataset has very good correlation with MDXDB21.

[ZFTurbo]

[StefanUhlich-sony]

Thanks a lot for the table - this is interesting. Just an idea for the presentation: it would be interesting to see this table as a scatter plot (to better judge the correlation).

[faroit]

@ZFTurbo we decided to not use the arxiv links on the side of the pdf so please make sure that your paper is cited inline

[ZFTurbo]

Ok. But I didn't understand if some action required from me now?

[faroit]

Sorry, I meant: if you want to cite your paper please mention it inline using the markdown syntax such as [@paperkey]

[faroit]

@ZFTurbo can you please add the reference to your submission by tomorrow?

[ZFTurbo]

@ZFTurbo can you please add the reference to your submission by tomorrow?

I didn't understand what I need to do. Can you please explain in more details?

[faroit]

@ZFTurbo sorry for not being precise. I would suggest you

1. add your paper to the bibtex references

@misc{solovyev2023benchmarks,
      title={Benchmarks and leaderboards for sound demixing tasks}, 
      author={Roman Solovyev and Alexander Stempkovskiy and Tatiana Habruseva},
      year={2023},
      eprint={2305.07489},
      archivePrefix={arXiv},
      primaryClass={cs.SD}
}

2. cite the paper in the abstract using [@solovyev2023benchmarks] instead of using the doi value

[ZFTurbo]

I did update. I hope I understood correctly )

[faroit]

Almost. Let me fix that with a PR ;)

[faroit]

@ZFTurbo i did a proposal for changes in #13. Please have a look there, maybe then its more clear what I meant. Also, please check the rendering on the urls, this doesn't look well formatted, you may just use a different bibtex entry so that it doesn't show the full url

[faroit]

Hi @ZFTurbo , as the workshop is coming up very soon, we are finalizing the programm. Stay tuned for the definite time-table for your presentations. In the meantime, we want to clarify the recording and broadcasting rights of the presentations, so please acknowledge the following:

I hereby authorize the right and permission to copyright and/or publish, reproduce or otherwise use my name, voice, and audio-visual recordings. I acknowledge and understand these materials about or of me may be used for both commercial and/or non-commercial purposes.

I understand that my image may be edited, copied, exhibited, published and/or distributed. There is no time limit on the validity of this release nor are there any geographic limitations on where these materials may be distributed.

I authorize that the video will be made available under the CC BY-SA 4.0 license on the conference website.

and comment on this by replying with acknowledge.

[ZFTurbo]

Hi @ZFTurbo , as the workshop is coming up very soon, we are finalizing the programm. Stay tuned for the definite time-table for your presentations. In the meantime, we want to clarify the recording and broadcasting rights of the presentations, so please acknowledge the following:

I hereby authorize the right and permission to copyright and/or publish, reproduce or otherwise use my name, voice, and audio-visual recordings. I acknowledge and understand these materials about or of me may be used for both commercial and/or non-commercial purposes.

I understand that my image may be edited, copied, exhibited, published and/or distributed. There is no time limit on the validity of this release nor are there any geographic limitations on where these materials may be distributed.

I authorize that the video will be made available under the CC BY-SA 4.0 license on the conference website.

and comment on this by replying with acknowledge.

acknowledge

[faroit]

looks good now

[faroit]

Hi @ZFTurbo,

the workshop is approaching soon, here are few info regarding your presentation:

• The program is up and you can find your presentation slot here: https://sdx-workshop.github.io/program
• If your presentation is virtual, please show up in the zoom webinar at least 10 minutes before your slot and use a distinct user-name so that we can identify you during the presentation
• If your presentation is on site in Milano, please send us your pdf/pptx/web in advance and let us know if you need audio output. You can also present from your own device, but then test the setup before the workshop starts or during the coffee break. We don't know much about the projection setup right now, so bring adapters for standard HDMI/VGA in that case.
• You have 15 minutes in total for your presentation including questions, so we suggest to prepare slides for about 12-13 minutes.
• Please let us know if there is any problem with your presentation by tagging us here in the respective PR

See you soon!