Skip to content

Issues: pytorch/torchtune

v0.5.0 tracker
#2008 by joecummings was closed Dec 28, 2024
Closed
Testing tracker
#1890 opened Oct 23, 2024 by felipemello1
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

238 Open 576 Closed
238 Open 576 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Add a page explaining quickly setting up with custom data in live docs
#2221 opened Jan 1, 2025 by RdoubleA
packed errors
#2218 opened Dec 31, 2024 by chg0901
[feature request] support input/output to fsspec path
#2217 opened Dec 31, 2024 by leoleoasd
Plans for fp8 tuning going forward? Eg Deepseek v3
#2216 opened Dec 30, 2024 by RonanKMcGovern
1
First example dataset for instruct datasets has no _component
#2215 opened Dec 30, 2024 by johnowhitaker
1
More Chat Loss Masking Strategies
#2214 opened Dec 30, 2024 by EugenHotaj
2
hotw to estimate gpu memory needed for knowledge distillation?
#2213 opened Dec 30, 2024 by chuangzhidan
[Question] what to do when model doesn't have tokenizer.model?
#2212 opened Dec 29, 2024 by steveepreston
2
[Feature] add mlflow metric_logging
#2211 opened Dec 28, 2024 by steveepreston
Nit: inconsistent linting in qwen2.5 tokenizer test
#2208 opened Dec 26, 2024 by krammnic
Support masking of partial dialogue in multi-turn chat datasets
#2207 opened Dec 25, 2024 by jiatong-yu
2
Custom losses redesign in alignment section
#2206 opened Dec 25, 2024 by krammnic
Llama3.1 models do not allow configuring max_seq_len bug Something isn't working triaged This issue has been assigned an owner and appropriate label
#2202 opened Dec 23, 2024 by akashc1
4
How to use float8 for training?
#2201 opened Dec 23, 2024 by vgoklani
7
NaN running official KD code on different dataset, with packing + compile
#2198 opened Dec 22, 2024 by thnkinbtfly
2
[Docs] Update Finetune your first LLM tutorial
#2193 opened Dec 20, 2024 by joecummings
Adaptive batching
#2191 opened Dec 20, 2024 by krammnic
2
Model request. Phi4 enhancement New feature or request triaged This issue has been assigned an owner and appropriate label
#2190 opened Dec 20, 2024 by krammnic
Add multiprocess dataset packing enhancement New feature or request triaged This issue has been assigned an owner and appropriate label
#2180 opened Dec 19, 2024 by bratao
@joecummings
18
load_in_8bit for model quantization
#2178 opened Dec 18, 2024 by SUMEETRM
2
Add sample packing for DPO, PPO enhancement New feature or request rlhf Anything related to reinforcement learning w/ human feedback
#2177 opened Dec 18, 2024 by SalmanMohammadi
@SalmanMohammadi
Federated fine-tuning recipes
#2170 opened Dec 18, 2024 by krammnic
@joecummings
GPU Middle Class? discussion Start a discussion distributed Anything related to distributed env (multi-GPU, multi-node) triaged This issue has been assigned an owner and appropriate label
#2161 opened Dec 16, 2024 by EugenHotaj
7
Move update_recipe_state to its own util best practice Things we should be doing but aren't triaged This issue has been assigned an owner and appropriate label
#2158 opened Dec 13, 2024 by joecummings
4
Add Multi-Dataset and streaming documentation
#2156 opened Dec 12, 2024 by andrewkho
@andrewkho
ProTip! Mix and match filters to narrow down what you’re looking for.