跳转至

TIAO: Token Importance-Aware Policy Optimization for Text Summarization

简体中文

L1 core-mechanism diagnostic. Executes token dependency and two-scale credit, not 7B model training.

Paper information

Field Details
Paper TIAO: Token Importance-Aware Policy Optimization for Text Summarization
Organization First-author affiliation: National University of Defense Technology
First public release 2026-09-15 (arXiv v1)
Authors' code Public implementation
Adapter / method tiao
Local reproduction code src/auto_research/post_training/latest_20260916_followup.py

Original paper

Motivation and method

Estimate dependency from changes in token probabilities before and after masking the source document, then reshape trajectory advantages and concentrate updates on important tokens.

flowchart LR
  I[Public input and current state] --> M[TIAO mechanism]
  M --> A[Auditable intermediates]
  A --> O[Output or state update]

Key figure from the paper

TIAO, Figure 1

Figure 1: Overall method and components. From the original paper; copyright remains with the authors.

Core computation and code mapping

The reference kernel preserves the decisive ranking, gating, preference direction, credit weighting, or state transitions and exposes auditable statistics. Three-seed fixtures check invariants and edge cases, not paper capability.

Paper results

Accuracy, speed, training loss, and benchmarks are original paper results only. Local results are not directly compared with them or extrapolated to online gains.

Local reproduction

See the three-seed results. The common receipt marks diagnostic_only=true, ineligible for formal capability ranking.

CUDA ran on an NVIDIA A100; see the sanitized GPU receipt. The receipt omits hostnames, SSH aliases, and driver/build strings.

Reproduction boundaries

Token dependency and two-scale credit are implemented locally. No 7B model was trained.