Skip to content

Pull requests: pytorch/torchtitan

New pull request New
229 Open 1,734 Closed
229 Open 1,734 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

add async activation offloading to CPU with pinned memory pool CLA Signed This label is managed by the Meta Open Source bot.
#2581 opened Mar 15, 2026 by dean-mccoppin Loading…
Add weight tying support for Llama3 CLA Signed This label is managed by the Meta Open Source bot.
#2580 opened Mar 15, 2026 by dean-mccoppin Loading…
1
3
Implement torch compile and mxfp8 for flux CLA Signed This label is managed by the Meta Open Source bot.
#2579 opened Mar 15, 2026 by hlahkar Loading…
Configurable Z Loss CLA Signed This label is managed by the Meta Open Source bot.
#2576 opened Mar 14, 2026 by francesco-bertolotti Loading…
[graph_trainer] Add CUDAGraph manager for centralized lifecycle management ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2572 opened Mar 13, 2026 by yiming0416 • Draft
[Module] Modularize MoE components ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2571 opened Mar 13, 2026 by acisseJZhong Loading…
2
[5/N] Support lora moe ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2569 opened Mar 13, 2026 by mori360 • Draft
[RL] Changes to enable compilation for trainer ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2568 opened Mar 13, 2026 by Lucaskabela Loading…
5
[mxfp8 training] add TP warning ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2562 opened Mar 12, 2026 by danielvegamyhre Loading…
[graph_trainer] Trace forward loss backward step with make_fx ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2561 opened Mar 12, 2026 by yiming0416 • Draft
Yield per-document RoPE position ids from dataset ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2560 opened Mar 12, 2026 by joecummings Loading…
1
3
Adopt Local Map Wrapper for Inner Attention ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2557 opened Mar 11, 2026 by acisseJZhong Loading… New Feature, Model, Misc
1
@acisseJZhong
25
[do not review] Add SFT experiment ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2556 opened Mar 11, 2026 by joecummings • Draft
2
Add nonstrict_tracer utility and unit tests CLA Signed This label is managed by the Meta Open Source bot.
#2553 opened Mar 11, 2026 by ydwu4 Loading…
17
fix(flux): handle corrupted EXIF images in FluxDataset to prevent training crashes CLA Signed This label is managed by the Meta Open Source bot.
#2550 opened Mar 11, 2026 by LIUYellowBlack Loading…
@wwwjn
11
[Qwen3.5 MoE] Add hybrid decoder model (GatedDeltaNet + full attention + MoE) CLA Signed This label is managed by the Meta Open Source bot.
#2545 opened Mar 11, 2026 by gali-leilei Loading…
2 tasks
2
Add Magi Attention for varlen + Context Parallelism CLA Signed This label is managed by the Meta Open Source bot.
#2543 opened Mar 11, 2026 by wangbinluo Loading…
3 of 5 tasks
1
1
[RFC][Module] Replace init_weights with StateInitializer pattern ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2540 opened Mar 10, 2026 by fegin Loading…
5
[TP] Enable/disable SP for TP ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2535 opened Mar 10, 2026 by pianpwk Loading…
8
[donotland] vllm benchmark branch ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2534 opened Mar 10, 2026 by pianpwk • Draft
[Flux] Refactor flux config: Add FluxTokenizerContainer, remove Validation class ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2533 opened Mar 10, 2026 by wwwjn Loading…
19
[donotland] vllm qwen3 perf ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2531 opened Mar 9, 2026 by pianpwk • Draft
[RL] Use gpu direct weight sync from torchstore ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2525 opened Mar 9, 2026 by daniellepintz Loading…
@daniellepintz
30
fix failed tests on upstream-2026-10-02
#2516 opened Mar 6, 2026 by xrsrke Loading…
1
[DRAFT][Not4Review] vLLM Native support ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2507 opened Mar 5, 2026 by Lucaskabela • Draft
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.