Demonstrations → frozen visual features → endpoint prediction → action consistency → joint training

Paused
Action Generation Action-Conditioned Latent Foresight 2026-11-03T00:53:01.535747 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ 2026-11-03T00:53:01.541405 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ Qwen3-VL Prediction 2026-11-03T00:53:01.544589 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ 2026-11-03T00:53:01.547689 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ Action DiT 2026-11-03T00:53:01.549457 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ 2026-11-03T00:53:01.551895 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ 2026-11-03T00:53:01.554477 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ 2026-11-03T00:53:01.563465 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ V-JEPA 2.1 2026-11-03T00:53:01.566349 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ 2026-11-03T00:53:01.601456 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ V-JEPA 2.1 2026-11-03T00:53:01.603631 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ Command encoder + 2026-11-03T00:53:01.605739 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ Endpoint predictor 2026-11-03T00:53:01.611889 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ Visual progress 2026-11-03T00:53:01.616635 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ 2026-11-03T00:53:01.619281 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ Joint temporal prior Temporal consistency 2026-11-03T00:53:01.620670 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ 2026-11-03T00:53:01.622591 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ 2026-11-03T00:53:01.625368 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ 2026-11-03T00:53:01.627190 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ Execute 2026-11-03T00:53:01.630059 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ Next observation 2026-11-03T00:53:01.636052 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ Action Consistency Regularization Training only 2026-11-03T00:53:01.640844 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ V-JEPA 2.1 2026-11-03T00:53:01.643792 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ 2026-11-03T00:53:01.646370 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ 2026-11-03T00:53:01.649552 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ 2026-11-03T00:53:01.652601 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ 2026-11-03T00:53:01.654641 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ Inverse action decoder 2026-11-03T00:53:01.656432 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ 2026-11-03T00:53:01.659531 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/ 2026-11-03T00:53:01.662903 image/svg+xml Matplotlib v3.9.4, https://matplotlib.org/

Swipe or scroll horizontally to explore the full architecture.

OVERVIEW

Training uses demonstrated commands. Current and future images are encoded separately; a shared inverse decoder reconstructs the first command from observed and predicted feature changes.