Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve hessian/invhessian collection #79

Open
YangWang92 opened this issue Oct 21, 2024 · 3 comments
Open

Improve hessian/invhessian collection #79

YangWang92 opened this issue Oct 21, 2024 · 3 comments
Assignees
@YangWang92
Labels
alogrithm

Comments

@YangWang92
Copy link
Contributor

No description provided.

@YangWang92 YangWang92 self-assigned this Oct 21, 2024
@laomao0
Copy link
Contributor

laomao0 commented Oct 29, 2024 •
edited
Loading

Hi, thanks for sharing quant codes.
I want to quant other llm model,
could you share the inverseHessian generate codes,
since the QUIP# does not generate it, as well as the perm and the zero_index data.

Thanks.

@YangWang92
Copy link
Contributor Author

try this one https://gist.github.com/YangWang92/ec98a86c3a33c573b601cf4348d0a0e7

@laomao0
Copy link
Contributor

laomao0 commented Oct 29, 2024

try this one https://gist.github.com/YangWang92/ec98a86c3a33c573b601cf4348d0a0e7

Awesome, thanks.

@YangWang92 YangWang92 mentioned this issue Nov 7, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@YangWang92 YangWang92

Labels
alogrithm
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@YangWang92 @laomao0