Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Good First Issue]: Verify gemma-7b-it with GenAI text_generation #264

Open
p-wysocki opened this issue Mar 1, 2024 · 6 comments
Open
Assignees
Labels
good first issue Good for newcomers

Comments

@p-wysocki
Copy link
Collaborator

Context

This task regards enabling tests for gemma-7b-it. You can find more details under openvino_notebooks LLM chatbot README.md.

Please ask general questions in the main issue at #259

What needs to be done?

Described in the main Discussion issue at: #259

Example Pull Requests

Described in the main Discussion issue at: #259

Resources

Contact points

Described in the main Discussion issue at: #259

Ticket

No response

@VinayN18
Copy link

VinayN18 commented Mar 2, 2024

.take

@p-wysocki
Copy link
Collaborator Author

Hello @VinayN18, the ticket will be manually assigned to you shortly - the take feature hasn't been introduced to GenAI repo yet, but it will be today. :)

Thanks for taking a look at the issue!

@p-wysocki
Copy link
Collaborator Author

Hello @VinayN18, is there anything we could help you with?

@VinayN18
Copy link

Hello @p-wysocki I am working on it, I will let you know if I face any difficulties.

@VinayN18
Copy link

VinayN18 commented Mar 17, 2024

Hello @VinayN18, is there anything we could help you with?

Hello @p-wysocki I am facing memory issue when converting the gemma-7b-it model. I tried running the model in my local PC using Nvidia GeForce RTX 3050 Ti GPU and Google colab (free version) but due to the memory limit I was not able to convert it.
I will try some other platforms and keep you posted. Could you also suggest any other methods to overcome this issue

@p-wysocki
Copy link
Collaborator Author

cc @pavel-esir

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers
Projects
Status: Assigned
Development

No branches or pull requests

2 participants