Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove falcon from presets as it requires running untrusted code #3495

Merged
merged 1 commit into from
Aug 4, 2023

Conversation

tgaddair
Copy link
Collaborator

@tgaddair tgaddair commented Aug 2, 2023

No description provided.

@arnavgarg1
Copy link
Contributor

I know the current recommendation is to add a flag to make this work - is that not something we can do?

@arnavgarg1
Copy link
Contributor

Ycombinator news: https://news.ycombinator.com/item?id=36612627

I do believe this flag will be removed in the next transformers version

@arnavgarg1
Copy link
Contributor

Another idea:

Check if the model architecture is RWForCausalLM and then conditionally add the trust-remote_code=True flag to the load kwargs. That way it'll only be supported for Falcon models.

https://huggingface.co/tiiuae/falcon-40b/blob/main/config.json

@github-actions
Copy link

github-actions bot commented Aug 2, 2023

Unit Test Results

  6 files    6 suites   1h 3m 27s ⏱️
34 tests 29 ✔️   5 💤 0
88 runs  72 ✔️ 16 💤 0

Results for commit 9fd36b6.

@arnavgarg1 arnavgarg1 merged commit 6b9a5e4 into master Aug 4, 2023
16 checks passed
@arnavgarg1 arnavgarg1 deleted the no-falcon branch August 4, 2023 18:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants