跳转至

简体中文 · English

OPD-Aha: From Linguistic Momentum to Visual Reflection in Multimodal On-Policy Distillation

L1 core mechanism diagnostic. The target reconstruction formula runs locally. No multimodal checkpoint was loaded.

Paper information

Field Details
Paper OPD-Aha: From Linguistic Momentum to Visual Reflection in Multimodal On-Policy Distillation
Institutions Arizona State University / University of Virginia / Stevens Institute of Technology (first author affiliations)
First public release 2026-09-15 (arXiv v1)
Original source code Yes: Echochef/OPD-Aha
Adapter/method opd-aha
Local reproduction code src/auto_research/post_training/latest_20260916.py

Original paper summary

Background and main changes

Reconstruct a visually preferred target from the difference between the teacher's distributions with actual and empty visual input. This counters momentum from an incorrect linguistic prefix.

The local reference kernel retains the defining gates, weights or state transitions and emits auditable intermediates for comparison under a shared budget.

flowchart LR
  I[Public inputs and state] --> M[OPD-Aha core mechanism]
  M --> A[Auditable intermediates]
  A --> O[Output or policy update]

Key figure from the paper

OPD-Aha Figure 2

Figure 2: Core architecture, components and connections. From the paper; copyright belongs to the authors. Click for the source.

Core mechanism

The implementation preserves the defining state transition and exposes relevant weight, gate, depth, stage or cache statistics. Fixed budgets and three seeds check mechanism invariants, not paper-scale training.

Offline and online results

Capability, speed and cost claims are attributed to the paper only. Local metrics are not directly compared or extrapolated to online gains.

Local reproduction

See metrics/mechanism-seeds42-44.json. The unified receipt marks diagnostic_only=true, so the public dashboard does not treat this as a complete capability gain.

Scope

The target reconstruction formula runs locally; no multimodal checkpoint was loaded.