[Good First Issue]: Verify gemma-7b-it with GenAI text_generation

[p-wysocki]

Context

This task regards enabling tests for gemma-7b-it. You can find more details under openvino_notebooks LLM chatbot README.md.

Please ask general questions in the main issue at #259

What needs to be done?

Described in the main Discussion issue at: #259

Example Pull Requests

Described in the main Discussion issue at: #259

Resources

• Contribution guide - start here!
• Intel DevHub Discord channel - engage in discussions, ask questions and talk to OpenVINO developers

Contact points

Described in the main Discussion issue at: #259

Ticket

No response

[VinayN18]

.take

[p-wysocki]

Hello @VinayN18, the ticket will be manually assigned to you shortly - the take feature hasn't been introduced to GenAI repo yet, but it will be today. :)

Thanks for taking a look at the issue!

[p-wysocki]

Hello @VinayN18, is there anything we could help you with?

[VinayN18]

Hello @p-wysocki I am working on it, I will let you know if I face any difficulties.

[VinayN18]

Hello @VinayN18, is there anything we could help you with?

Hello @p-wysocki I am facing memory issue when converting the gemma-7b-it model. I tried running the model in my local PC using Nvidia GeForce RTX 3050 Ti GPU and Google colab (free version) but due to the memory limit I was not able to convert it.
I will try some other platforms and keep you posted. Could you also suggest any other methods to overcome this issue

[p-wysocki]

cc @pavel-esir

[Wovchena]

@VinayN18 any updates here? You don't need a dedicated GPU memory. Only RAM is needed to run it on CPU.

[Wovchena]

I unassigned the issue. Feel free to take it again if you are still working on it.

[ali-john]

Hello,
I would like to work on this issue

[sky0walker99]

@ali-john Are you still working on this issue?
if not I would like to work on this.

[sky0walker99]

.take

[github-actions]

Thanks for being interested in this issue. It looks like this ticket is already assigned to a contributor. Please communicate with the assigned contributor to confirm the status of the issue.

[ali-john]

@sky0walker99 you can work on it