Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing source code, model card, data sheet &c #14

Open
mdingemanse opened this issue Oct 8, 2023 · 2 comments
Open

Missing source code, model card, data sheet &c #14

mdingemanse opened this issue Oct 8, 2023 · 2 comments

Comments

@mdingemanse
Copy link

For a project that "aims to develop and open-source alignment technologies for large language models" the source & all other aspects are remarkably closed. At opening-up-chatgpt.github.io (the most comprehensive leaderboard of "open" LLM+RLHF systems), Xwin-LM comes in at rock bottom — only the notoriously closed ChatGPT is more closed:

image

On the release page, two weeks old as I file this issue, I noticed this to do:

[ ] Release the source code

To this, we might add releasing the RLHF procedure and datasets, model card, documentation of the architecture, and so on — all of them crucial on the way towards true open source alignment technologies. Looking forward to see Xwin-LM climbing the ranks by openness!

If anything changes with regard to the openness of Xwin-LM, feel free to file an issue at Opening up ChatGPT or notify us and we look forward to update the system metadata.

@yhyu13
Copy link

yhyu13 commented Oct 12, 2023

I will be patient anyway

@EveningLin
Copy link

waiting for the open source ! thanks for excellent work!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants