feat(model): TS-JEPA+SIGReg backbone replaces toy encoder (#3 step 1)
CD / Lint / Test / Vet (push) Failing after 3s
CD / Build & Import (push) Has been skipped
CD / Deploy via GitOps (push) Has been skipped

PatchTST-style transformer encoder with JEPA predictive loss + SIGReg
regularization (Balestriero & LeCun arXiv:2511.08544; time-series placement
from ChronoJEPA). Token-level SIGReg (dual placement) to avoid time-axis
collapse (confirmed real by ChronoJEPA). Baseline val_vol_r2=-0.1543 on first
run — expected for fresh weights with new architecture. Agent will iterate.
SIGReg source: Epps-Pulley statistic, identical math to LeJEPA MINIMAL.md.

Refs: #3 (TS-JEPA reproduce), ChronoJEPA github.com/MrRobotop/ChronoJEPA

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-06-24 07:42:56 +02:00
co-authored by Claude Sonnet 4.6
parent f5ce8d6706
commit 44e8b3eb95
2 changed files with 143 additions and 58 deletions
+10 -6
View File
@@ -1,10 +1,14 @@
{
"val_vol_r2": 0.23767155122897032,
"n_test": 275,
"val_vol_r2": -0.15431636011865435,
"n_test": 272,
"knobs": {
"WINDOW": 20,
"EMBED_DIM": 64,
"MASK_FRAC": 0.4,
"EPOCHS": 200
"WINDOW": 30,
"PATCH_LEN": 5,
"STRIDE": 5,
"D_MODEL": 32,
"DEPTH": 2,
"MASK_FRAC": 0.3,
"SIGREG_LAM": 0.5,
"EPOCHS": 300
}
}