3 posts tagged with "world-models"

LeWorldModel (LeWM) claims to be the first Joint-Embedding Predictive Architecture that trains stably end to end from raw pixels using only two loss terms: next-embedding prediction plus a single regularizer that forces the latent distribution to be an isotropic Gaussian. The claim mostly holds, and the reason it holds is the cleanest idea in the paper: replace the usual pile of anti-collapse heuristics (stop-gradient, EMA, frozen foundation encoders, seven-term VICReg objectives) with one distribution-matching penalty borrowed from LeJEPA. The headline "one hyperparameter" is real for the loss, but it quietly leans on architectural and quadrature choices that are themselves tuned. This is a close read of the paper from the first equation to the last.

The claim: train a representation to pull positive pairs together while forcing its embeddings to be an isotropic Gaussian, and (in a Gaussian world with Ornstein-Uhlenbeck transitions) the only way to win is to recover the true latent variables up to a rotation. The paper proves this is an if and only if: the Gaussian latent distribution is the unique choice for which LeJEPA is linearly identifiable. My verdict: the forward theorem is clean, correct, and genuinely illuminating; the converse and the "Lean-verified" framing are weaker than they sound, because the load-bearing analysis facts are assumed rather than proven, and the central Gaussian-world assumption is exactly the one their own robotics experiment violates.

stable-worldmodel (swm) argues that the bottleneck in world-model research is no longer ideas but plumbing: every lab re-implements the same encoder, predictor, CEM planner, and data loader, and the inconsistencies between those copies make published comparisons untrustworthy. The paper's fix is a single PyTorch and Gymnasium platform built on three abstractions (World, Policy, Solver), a Lance-based data layer that loads multimodal trajectories 3 to 4 times faster than HDF5 or MP4, and a factors-of-variation system that turns any environment into a controlled out-of-distribution (OOD) test. The infrastructure claims are concrete and well-supported. The scientific headline, that current world models are brittle under mild distribution shift, is real but rests almost entirely on a single environment (Push-T). This is a close read of the paper from the data layer to the last solver.