[Good First Issue]: Verify red-pajama-3b-instruct with GenAI text_generation

[p-wysocki]

Context

This task regards enabling tests for red-pajama-3b-instruct. You can find more details under openvino_notebooks LLM question answering README.md.

Please ask general questions in the main issue at #259

What needs to be done?

Described in the main Discussion issue at: #259

Example Pull Requests

Described in the main Discussion issue at: #259

Resources

• Contribution guide - start here!
• Intel DevHub Discord channel - engage in discussions, ask questions and talk to OpenVINO developers

Contact points

Described in the main Discussion issue at: #259

Ticket

No response

[AishwaryaDekhane]

.take

[github-actions]

Thank you for looking into this issue! Please let us know if you have any questions or require any help.

[p-wysocki]

Hello @AishwaryaDekhane, are you still working on this? Is there anything we could help you with?

[AishwaryaDekhane]

I'm working on it. Please allow me couple of days more.

[tushar-thoriya]

.take

[github-actions]

Thanks for being interested in this issue. It looks like this ticket is already assigned to a contributor. Please communicate with the assigned contributor to confirm the status of the issue.

[tushar-thoriya]

Hello @AishwaryaDekhane what is the status ?

[AishwaryaDekhane]

Hello @tushar-thoriya,

I've been actively working on multiple tasks related to this issue. I've thoroughly reviewed all the provided documentation for reference and have been attempting to execute the given C++ file. However, I've encountered some errors along the way and am currently working on resolving them.

[p-wysocki]

Hello @AishwaryaDekhane, are you still working on this? cc @pavel-esir

[akiseakusa]

.take

[github-actions]

Thank you for looking into this issue! Please let us know if you have any questions or require any help.

[kuanxian1]

.take

[github-actions]

Thank you for looking into this issue! Please let us know if you have any questions or require any help.

[Wovchena]

@kuanxian1 any updates here?

[Po-V]

.take

[github-actions]

Thank you for looking into this issue! Please let us know if you have any questions or require any help.

[Po-V]

Hi @Wovchena

I tried running the redPajama instruct model in OpenVino with the chat sample and the model seems to produce reasonable output after i added the chat template to tokenizer_config.json of model :

However, i am having issue running the pytest after adding the model to the nightly list for all the test cases as below:

I am wondering if you could assist me with this ? I tried rebuilding the project but got the same error.

[Wovchena]

Try running setuvars.sh. See the instruction for the details https://github.com/openvinotoolkit/openvino.genai/blob/master/src/docs/BUILD.md