Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inconsistancy with instruction for deploying llama2 #394

Open
bieniek opened this issue Jan 29, 2024 · 0 comments
Open

Inconsistancy with instruction for deploying llama2 #394

bieniek opened this issue Jan 29, 2024 · 0 comments

Comments

@bieniek
Copy link

bieniek commented Jan 29, 2024

In the README file for the llama2 deployment example:
https://github.com/oracle-samples/oci-data-science-ai-samples/blob/main/model-deployment/containers/llama2

there is an instruction to create container repository of name 'text-generation-interface-odsc'

while in the make file:

TGI_INFERENCE_IMAGE:=${CONTAINER_REGISTRY}/${TENANCY}/text-generation-interface:0.9.3-v

image is pushed to the different repository, which with default OCI settings will be created on the root level compartment.

not a huge deal but quite confusing for the beginners (especially when you create the model deployment and you cannot find your model, the scope of available repositories is limited to the compartment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant