Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Contribution: Adding Falcon Models #1072

Closed
5 tasks
Ruqyai opened this issue Jun 8, 2023 · 4 comments
Closed
5 tasks

Contribution: Adding Falcon Models #1072

Ruqyai opened this issue Jun 8, 2023 · 4 comments
Assignees
Labels
type:feature New feature or request

Comments

@Ruqyai
Copy link

Ruqyai commented Jun 8, 2023

Is your feature request related to a problem? Please describe.

The feature request is related to contribution by adding the new pre-trained (Falcon LLM - 7b /40b) models to KerasNLP.

Describe the solution you'd like

The feature request is related to contribute by adding Falcon (7b and 40b) to pre-trained models in KerasNLP.
In 7th June, 2023 , Falcon 40B, the world’s top-ranked open-source AI model on the Hugging Face leaderboard for large language models (LLMs).
Falcon LLM models available under the Apache 2.0 software license.
More info here: https://huggingface.co/tiiuae

"Google Cloud credits are provided for this project."

@mattdangerw mattdangerw added the type:feature New feature or request label Jun 9, 2023
@mattdangerw
Copy link
Member

Thank you! I think you are already working on this correct? Just assigned you.

Looking forward to this!

@Ruqyai
Copy link
Author

Ruqyai commented Jun 10, 2023

Thank you! I think you are already working on this correct? Just assigned you.

Looking forward to this!

Yes I am already working.

@shivance
Copy link
Collaborator

@Ruqyai Please follow https://github.com/keras-team/keras-nlp/tree/master/tools/checkpoint_conversion

@Ruqyai
Copy link
Author

Ruqyai commented Jun 15, 2023

To fix CLA issue, I removed the old PR.
This is the new PR
Add FalconBackbone #1081

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type:feature New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants