Add ChatDataset and ChatDataLoader for SFT training#2556

Merged

joecummings merged 12 commits intopytorch:mainfrom

joecummings:sft-experiment

Mar 30, 2026

Commits on Mar 11, 2026

Add SFT experiment for supervised fine-tuning
joecummings
committed

Commits on Mar 12, 2026

Fix SFT packing: add per-document RoPE positions and block_causal validation
joecummings
committed

Commits on Mar 25, 2026

Add ChatDataset and ChatDataLoader for SFT training
joecummings
committed

Commits on Mar 27, 2026

Revert dataset re-loop shuffle in HuggingFaceTextDataset
joecummings
committed

Commits on Mar 30, 2026