-
Notifications
You must be signed in to change notification settings - Fork 2.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Proposal to increase the tool bar for the list #383
Comments
Also, there exist some tools that show up many times in the list: As mentioned in #352 |
This is a really good idea, and I do like the concept, however there's a couple of poits discussed, answering each:
|
Thanks for your feedback. I wonder what it means to automatically validate this (ie do a quick automated check once we merge the release PR)? What do you have in mind? @axsaucedo |
I do know using the repo stars may not be the best criteria to differentiate impactful vs less/unimpactful tools but this is perhaps the easiest and most efficient way to achieve so. Considering the fast-changing pace of ML tools, it has the potential to eventually become de facto most appropriate way to decide whether or not to include a tool. Do you agree, @axsaucedo ? |
I don't see why not increasing it at least slightly, to 200 or 300, let's give it a try by this amount, I do agree that it's a good heuristic |
The core logic for why we need to set up a high bar (>500, or 1000) rather than a medium one (>200, or 300) is that: if an OSS tool is used for production-level ML deployment, then it usually draws enough attention from the industry. If not, we perhaps need to reevaluate this tool since not so many practitioners pay attention to (or use) this tool in real-world practices. In reality, we seldom think highly of an OSS tool nowadays when it is little known or used by practitioners (particularly beneath the fact that OSS culture is so popular worldwide and we can almost see the OSS community as a perfect competition market). The most common case is that, as far as we notice, when a tool is widely recognized and used by practitioners, the repo stars increase at a steady pace and eventually reach a high level (>>1k). Thus, I still recommend a high bar rather than a medium one. @axsaucedo |
Check this: dccuchile/wefe#58 @axsaucedo maybe 6 months is indeed a bit shorter than expectation? |
I recommend lifting the bar of the tools due to the bloating number of tools (~471) nowadays. We lift the bars and only keep the more impactful tools on our list since I notice a great number of tools (~13%) in our list are becoming unmaintained for several years (Of course, their repos' stars stop growing as well).
How about lifting the minimum requirements in terms of Git repo stars up to 500?
Why 500 stars rather than 300, or 200?
Empirically, I notice a great sum of tools are losing popularity and eventually becoming obsolete (or unmaintained) before they reach the ceiling of 500 stars.
What do you think? @axsaucedo
The text was updated successfully, but these errors were encountered: