Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Llama 3.2 1B] Unsupported Ops in Self-Attention Test (repeat_interleave) #938

Open
mstojkovicTT opened this issue Dec 19, 2024 · 0 comments
Assignees
Labels
Ops Support new op in tt-forge and tt-mlir

Comments

@mstojkovicTT
Copy link
Contributor

Steps to Reproduce:

To reproduce the error, run the following command:
pytest -svv forge/test/mlir/llama/tests/test_llama_self_attn.py::test_llama_self_attn["meta-llama/Llama-3.2-1B"]

Expected Behavior:

The test should pass without any errors, verifying the correct behavior of the self-attention mechanism.

Actual Behavior:

The test fails during the RUN_MLIR_COMPILER stage with the following error:

Unsupported Ops at: RUN_MLIR_COMPILER stage
repeat_interleave
                 Input_shape: [{1, 8, 1, 12, 64}, ]
                                         Attributes: repeat_interleave(1,0,){dim: 0, repeats: 1}
                                         Attributes: repeat_interleave(4,2,){dim: 2, repeats: 4}

Aditional info

The repeat_interleave operation is currently unsupported. However, ttnn.repeat_interleave support is available in Metal and awaiting uplift.

@mstojkovicTT mstojkovicTT added this to the [FFE - E2E] Llama 3.2 1B milestone Dec 19, 2024
@mstojkovicTT mstojkovicTT self-assigned this Dec 19, 2024
@mstojkovicTT mstojkovicTT added the Ops Support new op in tt-forge and tt-mlir label Dec 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Ops Support new op in tt-forge and tt-mlir
Projects
None yet
Development

No branches or pull requests

1 participant