跳转至

Individual P0/P1 review decisions

简体中文

This page records review decisions, not implementation. Explicitly declining an unaffordable full experiment closes its review; it is not a pending run. The domain receipts referenced by the complete register preserve reading methods, source locations, fingerprints, and cost evidence. Dates are first releases. Unknown first releases are explicit, never inferred from catalog dates.

Affordable review candidates: 14 (not implemented)

First releases in the window closed as too costly: 369

Expand a domain below. For every entry, the full paper-scale experiment was not reproduced and review is DONE: either the cost exceeded budget or the full cost remained materially uncertain after read-only checks. No local measured results or automatic retries, implementation, or Evolve promotion are claimed. Small fixtures, numerical unit tests, and registry labels do not substitute for capability comparisons.

Search, advertising, recommendation, and LLM applications: 5
Foundation models, multimodal, and JEPA: 208
Post-training, Agentic RL, and OPD: 80
Agent and RSI: 76

Retrospective discoveries, known revisions, and official identities: 13

These are not first releases in the current window. Only the current record's reproduction-cost decision is closed; older implementation evidence is not upgraded.

  • Google Earth AI Geospatial Reasoning Agent: Capabilities and a Systematic Evaluation · 2026-10-11 · P1

    Gemini powers modular geospatial skills and planning. Official development splits are available for two benchmarks. First arXiv publication was 2026-10-11; catalog/blog updates are not first releases. Full Gemini/tool budget unresolved; not reproduced, review DONE.

  • DRanker: A Transformer-Based Multi-Task Ranking Model for the Disney+ Homepage · 2026-10-11 · P0

    DRanker combines an approximately 7M encoder-only multitask ranker and causal debiasing. The body documents online A/B and global rollout, not only an abstract claim. Months of private Disney interactions and hundreds of millions of training examples cannot be replicated with public data and one card. First arXiv release 2026-10-11 is a retrospective discovery; review DONE.

  • Vela: User Behavior as Supervision Sparks LLM Intelligence · 2026-10-10 · P1

    Vela converts long-term behavior into tasks and trajectories, an LLM data/training method rather than qualifying industrial A/B. 35B-A3B, 131,072 length, 75K trajectories, two epochs; appendix RL uses 48 GPUs (32 train, 16 rollout). Too costly; review DONE.

  • Do LLMs Learn from Rewards in Context? : Rethinking the role of reward in In-Context RL · 2026-10-08 · P1

    v3 reward flips/randomization/removal and trajectory shuffling find direct ICRL benefits largely driven by ICL context, not a claim about all inference-time RL. The paper reports roughly 5h for ten ScienceWorld episodes and 3h for code on one A100. Full multi-model controls too costly; review DONE.

  • Self-Retrospection Distillation: Turning Post-hoc Experiences into Prior Foresight · 2026-10-06 · P1

    SRD v3 learns pre-action foresight from hindsight traces without generating foresight at inference. Hindsight supervision does not expose future to the evaluated agent. Appendix C.2 uses 4B/9B thinking-on, eight H200s, 128 trajectories per step, and ten agent tasks. Too costly; review DONE.

  • Imagine the Future, Internalize the Gist: Efficient VLA Reasoning via Internalized Spatiotemporal Imagination · 2026-10-02 · P1

    IG-VLA v3 predicts future SigLIP states before internalizing spatiotemporal reasoning into a gist, not repeating the current frame. §4.1: eight H100s for reasoning, four A6000s for gist, LIBERO 100K and VLABench 61K steps. Single-card latency does not verify training. Too costly; review DONE.

  • Token Utility for On-Policy Distillation via Local Trust-Region Optimization · 2026-10-01 · P1

    FUW/Token Utility uses Fisher-geometric token utility to weight distillation. 1.7B/4B students, 8B/14B/30B teachers, 279 steps × 256 sequences × 8,192 context are too costly. Review DONE. First arXiv release was 2026-10-01, a historical omission rather than October 14 first publication.

  • The Teacher Is a Direction, Not a Destination: Extrapolating RL-Induced Representation Residuals in On-Policy Distillation · 2026-09-29 · P1

    RIDE v2 uses layerwise hidden-state residuals of RL teacher versus base for extrapolated regression, requiring extra frozen-base forwards. Output-space probability extrapolation is not equivalent. Full teacher/base/student long rollouts and multi-task budget unresolved. Do not retrain; review DONE. Preserve prior L1 implementation and receipt without upgrading for revised metadata.

  • Rubric Dropout: A Simple Way to Mitigate Reward Hacking in Rubric-as-Reward RL · 2026-08-12 · P1

    Rubric Dropout v2 retains same-prompt same-step masks, discusses dropping related criteria in blocks, keeps at least three criteria, and evaluates with the full rubric. Independent gold judging is not absolute truth; most configurations use one run. 1.7B–8B, 16 rollouts, 600 steps, and dual API judges are too costly. Prior adapter does not cover v2 blocks.

  • SPARK: Learning from Verification in Speculative GRPO Rollouts · 2026-08-05 · P1

    v2 replaces SpecRoll with SPARK: low-rank logit correction shared in each prompt group and reset per rollout, updated from verifier top-16 plus tail feedback with projections learned across rollouts. Target verifier is unchanged. This is not just renaming fast/slow SpecRoll, and local legacy work is not SPARK. Twenty-one model/data configurations plus GRPO exceed budget; review DONE and old page warns about revisions.

  • UniRec: Bridging the Expressive Gap between Generative and Discriminative Recommendation via Chain-of-Attribute · 2026-04-14 · P0

    UniRec v5 confirms Shopee and includes capacity-constrained SID, CoA, CDC, and RFT+DPO. §4.2 production A/B qualifies on PVCTR/orders/GMV; do not mix business and offline token-hit metrics. Billions of private events across nine days and three settings prevent faithful full reproduction. Review DONE; old CoA experiments do not upgrade to v5.

  • AutoformBench: A Lean Formalization Benchmark for Advanced Mathematics · First release date unverified · P1

    Meta's Lean AutoformBench is distinct from document understanding paper 2603.29832. Official page 2026-10-13, manuscript 2026-10-05, and CITATION 2026-09-30 mean different things and cannot establish first public release. 341 tasks × nine frontier models and long traces with up to $200 per task (a cap, not uniform actual spend) exceed budget. Review DONE; retain result-import potential without claiming integration.

  • CATWILD: Compiler Autotuning For TPU workloads in the Wild · First release date unverified · P1

    Official source confirms CATWILD TPU-fleet compiler autotuning and five years of production, but only gives 2026, no downloadable paper or exact date. Exact-title and official checks could not place it in the window. TPU fleet unavailable on one A100/A30; no reproduction. Archive date exception outside accepted count.

Evaluation references, boundaries, and source exceptions: 3

Other P0/P1 decisions (none are capability implementations from this round)

See the domain JSON files and the complete register for all P2, out-of-scope, and historical-date dispositions, kept out of the default reading view.