Skip to content

Commit

Permalink
Fix missing internal dimension
Browse files Browse the repository at this point in the history
  • Loading branch information
vshampor committed Oct 16, 2024
1 parent 218c754 commit 2a172b2
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -1566,7 +1566,7 @@ struct AttentionExecutor : public PagedAttentionExecutor {
}

if (rotated_block_indices) {
rotation_coefficients.assert_dims({block_size * rotated_block_indices.size(0)});
rotation_coefficients.assert_dims({ H * rotated_block_indices.size(0) * block_size });
}
output_emb.assert_dims({B_token, H * S});
output_emb = output_emb.reshape({B_token, 1, H * S});
Expand Down

0 comments on commit 2a172b2

Please sign in to comment.