Hi!
First of all I would like to say thank you for making the world a far better place.
I have tears in the eyes contemplating the positive impact that your "simple website" can have on science and on scientists.
I had the idea, many years ago to make a website that centralize state of the art performance and give it transparency, visibility!
But I didn't make it, you did, and I'm happy for you.
Such a website, once it becomes mainstream can be transformative for science, because it make scientists in competition for state-of-the-art, while before they compared against "an opaque, old sota baseline" and finding the SOTA was a quest, people "guessed" this was the SOTA. Paperswithcode.com show it and save much time.
More than that, you easily allow scientists to read the direct competition and to inspire from it (maybe you could incentivise collaboration and reuse?) But this is already a massive improvement.
But please don't just save AI research!
Save all scientists!
Paper with code should have a category per science and applied science. Not just AI but
Algorithms per complexity and constant cost, databases performance, psychology papers and Empirical benchmarked effectiveness (the website would benefit to see reproduced results (but for AI too)), solar energy performance, Empirical political experiments, medecine per medicament or combinaison of medicament effectiveness to cure from X disease, etc the possibilities are fascinating.
So yes it would not always be papers "with code" but it would highlight reproducible, reproduced papers which is what really matters, code is contingent.
Please save science by increasing sota visibility, learning from others, collaborations and science epistemology (reproducibility, double blind, sample size visibility, etc)
Maybe you could send a letter to a rich philanthrope explaining him how you can make earth a better place.
Maybe you can ask funding from https://www.effectivealtruism.org/
or https://80000hours.org/
Hi!
First of all I would like to say thank you for making the world a far better place.
I have tears in the eyes contemplating the positive impact that your "simple website" can have on science and on scientists.
I had the idea, many years ago to make a website that centralize state of the art performance and give it transparency, visibility!
But I didn't make it, you did, and I'm happy for you.
Such a website, once it becomes mainstream can be transformative for science, because it make scientists in competition for state-of-the-art, while before they compared against "an opaque, old sota baseline" and finding the SOTA was a quest, people "guessed" this was the SOTA. Paperswithcode.com show it and save much time.
More than that, you easily allow scientists to read the direct competition and to inspire from it (maybe you could incentivise collaboration and reuse?) But this is already a massive improvement.
But please don't just save AI research!
Save all scientists!
Paper with code should have a category per science and applied science. Not just AI but
Algorithms per complexity and constant cost, databases performance, psychology papers and Empirical benchmarked effectiveness (the website would benefit to see reproduced results (but for AI too)), solar energy performance, Empirical political experiments, medecine per medicament or combinaison of medicament effectiveness to cure from X disease, etc the possibilities are fascinating.
So yes it would not always be papers "with code" but it would highlight reproducible, reproduced papers which is what really matters, code is contingent.
Please save science by increasing sota visibility, learning from others, collaborations and science epistemology (reproducibility, double blind, sample size visibility, etc)
Maybe you could send a letter to a rich philanthrope explaining him how you can make earth a better place.
Maybe you can ask funding from https://www.effectivealtruism.org/
or https://80000hours.org/