forked from kmccleary3301/nested_learning
-
Notifications
You must be signed in to change notification settings - Fork 0
Open
Labels
enhancementNew feature or requestNew feature or requestexecution-boardExecution board ticket set for paper alignmentExecution board ticket set for paper alignmentphase-3Phase 3: differentiable online write pathPhase 3: differentiable online write pathquality-gateHas explicit acceptance criteria and test gatesHas explicit acceptance criteria and test gates
Milestone
Description
Purpose
Implement differentiable online-write mode so boundary-state gradients can flow through update steps.
Mandatory Reading (blocking)
First comment must summarize:
reports/NL_IMPLEMENTATION_ORACLE.mdsection 6.1.4docs/PAPER_COMPLIANCE.mdsemantic contract notessrc/nested_learning/training.pyonline loopsrc/nested_learning/titan/self_modifying.pyupdate sequencesrc/nested_learning/hope/block.pyupdate chunk functions
Required Code Anchors
src/nested_learning/training.pysrc/nested_learning/hope/block.pysrc/nested_learning/titan/self_modifying.pysrc/nested_learning/fast_state.py
Scope
- Add mode switch:
online_updates_mode=stopgrad|differentiable. - Keep stopgrad mode as default for backward compatibility.
- Add memory-control options for differentiable mode.
Test Requirements
- Explicit test proving later-chunk loss gradients affect earlier update states in differentiable mode.
- Stopgrad mode retains previous behavior.
Deliverables
- New mode implementation + config docs + tests.
Acceptance Criteria
- 2k differentiable smoke run stable.
- Boundary-gradient test passes in differentiable mode.
- First issue comment contains mandatory reading summary.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or requestexecution-boardExecution board ticket set for paper alignmentExecution board ticket set for paper alignmentphase-3Phase 3: differentiable online write pathPhase 3: differentiable online write pathquality-gateHas explicit acceptance criteria and test gatesHas explicit acceptance criteria and test gates