Skip to content

v2.1.26#684

Merged
joellidin merged 4 commits intomainfrom
dev
Jan 17, 2026
Merged

v2.1.26#684
joellidin merged 4 commits intomainfrom
dev

Conversation

@joellidin
Copy link
Collaborator

@joellidin joellidin commented Jan 17, 2026

  • (neurons) Switch anneal mode to shard 4
  • (hparams) Revert to pre-anneal checkpoint
  • (hparams) Adjust anneal schedule for new shard
  • Bump run version

Description

Related Issue(s)

  • Closes #[issue number]

Type of Change

  • Feature (adding new functionality)
  • Fix (resolving a bug or issue)
  • Docs (documentation updates)
  • Refactor (code changes that don't affect functionality)
  • Maintenance (dependency updates or other maintenance)
  • Tests (adding or improving tests)
  • Breaking change (fix or feature with incompatible API changes)
  • Other: _____

Branch Naming

  • My branch follows the project's naming convention (e.g., feature/add-new-capability)

Commit Messages

  • My commits are small, atomic, and have proper commit messages
  • Commit messages are in imperative mood with a capitalized summary under 50 chars

Code Quality

  • I've performed a self-review of my code
  • I've added appropriate docstrings following the project's conventions
  • I've added proper logging where necessary (without trailing periods)
  • I've applied linting and formatting with Ruff
  • My code generates no new warnings

Testing

  • I've added tests for new functionality or bug fixes
  • All tests pass locally with my changes
  • Test coverage has not decreased

Documentation

  • I've updated documentation to reflect my changes
  • I've updated comments in hard-to-understand areas

If this is a breaking change

Screenshots/Examples

Additional Notes

Summary by CodeRabbit

  • Chores
    • Version bumped to 2.1.26
    • Adjusted anneal-mode initialization and related hyperparameters
  • Documentation
    • Updated migration example to reference the corrected shard files

✏️ Tip: You can customize this high-level summary in your review settings.

@coderabbitai
Copy link

coderabbitai bot commented Jan 17, 2026

Walkthrough

Updates change the anneal startup shard from 2 to 4, adjust anneal-related hyperparameters and checkpoint init values, update docs to reference shard 4, and bump package version to 2.1.26.

Changes

Cohort / File(s) Summary
Version & Hyperparameters
src/tplr/__init__.py, hparams/hparams.json
Bumped __version__ 2.1.25 → 2.1.26; adjusted anneal_mode params (warmup_inner_steps 200→100, decay_outer_steps 550→120); updated checkpoint init (checkpoint_init_version 2.1.24→2.1.18, checkpoint_init_window 63571→62834).
Anneal shard startup (neurons)
neurons/miner.py, neurons/validator.py
Changed hardcoded anneal startup shard assignment from 24 and reset shard-epoch to 0 within anneal-mode initialization.
Documentation
docs/shared_sharded_dataset.md
Updated Partial Migration example rclone commands to reference anneal_000004.npy and sample_ids_anneal_000004.npy instead of shard 2 files.

Estimated code review effort

🎯 3 (Moderate) | ⏱️ ~20 minutes

Possibly related PRs

Suggested reviewers

  • shivam-MBZUAI
  • amiiir-sarfi

Poem

🐰 I hopped from two to shiny four today,
Tweaked steps and windows along the way,
Docs updated, version raised with cheer,
Anneal begins where the fourth shard is near. ✨

🚥 Pre-merge checks | ❌ 3
❌ Failed checks (2 warnings, 1 inconclusive)
Check name Status Explanation Resolution
Title check ⚠️ Warning The title 'v2.1.26' is purely a version bump and fails to describe the substantive changes (switching anneal mode to shard 4, reverting checkpoint, adjusting schedule). Use a descriptive title that summarizes the main change, e.g., 'Switch anneal mode to shard 4 and adjust hyperparameters' or 'Update anneal configuration for shard 4'.
Docstring Coverage ⚠️ Warning Docstring coverage is 0.00% which is insufficient. The required threshold is 80.00%. Write docstrings for the functions missing them to satisfy the coverage threshold.
Description check ❓ Inconclusive The description provides a bulleted summary of changes but lacks substantive detail in the Description section; most checklist items are unchecked without explanation. Expand the Description section with 'what' and 'why' context; fill in or uncheck relevant Type of Change items; clarify testing and documentation status.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing touches
  • 📝 Generate docstrings

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@codecov
Copy link

codecov bot commented Jan 17, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.

Impacted file tree graph

@@           Coverage Diff           @@
##             main     #684   +/-   ##
=======================================
  Coverage   57.69%   57.69%           
=======================================
  Files          27       27           
  Lines        4990     4990           
=======================================
  Hits         2879     2879           
  Misses       2111     2111           
Files with missing lines Coverage Δ
src/tplr/__init__.py 100.00% <100.00%> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Update anneal mode to use shard 4 instead of shard 2 for both miner and
validator. This change ensures consistency across the network as the
anneal schedule progresses.

- Update miner.py to use shard 4 in anneal mode
- Update validator.py to use shard 4 in anneal mode
- Update documentation with shard 4 migration examples
Roll back checkpoint_init_version to 2.1.18 and checkpoint_init_window
to 62834 to restore the bootstrapping configuration from before the
annealing phase began.
Update anneal mode parameters for the 22.8B token shard:
- warmup_inner_steps: 200 → 100
- decay_outer_steps: 550 → 120
@joellidin joellidin merged commit c0cf3fa into main Jan 17, 2026
7 of 8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant