Awesome-WAMs
GitHub
PAPER REPORTENAll readings ↗

FBFM: A Training-Free Asynchronous Feedback Mechanism for Flow-Matching in World-Action Models Execution

English reading report: Method, equations, original figures, experiments and reproducibility.

Authors: Peize Li; Ruimeng Zhang; Ru Zhang; Cong Huang; Kai Chen; Shanghang Zhang

Affiliations: DeepCybo; Zhongguancun Academy; Zhongguancun Institute of Artificial Intelligence; Peking University; Beijing Institute of Technology; Tsinghua University

Source: 2607.29235 ↗ · Catalog record

Reading: 104 / 558 · 6 original figures & tables · ~20 min ·

1. Paper overview

In one sentence: FBFM uses measured state discrepancies to steer a frozen WAM's active flow solver, improving some control outcomes while making timing, residual scale and latent compatibility critical. ev-problemev-guidanceev-stageev-jointev-ling-resultsev-dream-resultsev-coverage-failure

At a glanceWhat to know
Research problem
Source description

A generated future can become inconsistent with transitions that have already occurred while its action chunk is being executed. Updating history only before the next generation call cannot constrain individual slots of the active prediction. FBFM treats newly encoded observations as time-aligned measurements and inherited actions as commitments, while leaving unmeasured future content to the pretrained model. The encoded state need not itself be Markovian. ev-problemev-guidance

Core mechanism
Source description

A shared masked endpoint-residual correction supports both state-first/action-second generation and a joint state–action flow, without adding learned modules. ev-guidanceev-stageev-jointev-frozen-models

A key reported resultLingBot-VA task success on selected RoboTwin2.0 tasks: FBFM: Clean 83.3%, Randomized 82.9%, Overall 83.1%.

Success rate (%) and absolute percentage-point gain. 42 tasks, Clean and Randomized configurations; 10 or 20 episodes per cell; equal-weight task-configuration macro average.

Base: 80.5%, 79.8%, 80.1%; reported unrounded gains: +2.86, +3.10, +2.98 points. Broader improvement within this selected set; unequal episode counts are not pooled, and methods are not seed-paired. ev-ling-resultsev-ling-provenance

Reading caution
Reader analysis

Pseudo-asynchronous evaluation controls feedback timing independently of wall-clock latency. Added differentiation and feedback overhead remain barriers to physical control frequency; the paper establishes no real-time deployment result. ev-evaluationev-limitations

Core contributions

Figure 3. Where an incoming observation enters the solver depends on the WAM's factorization. Original paper, p. 7 ↗

Excerpt from the authors’ paper; cropped without altering the figure or table.

How to read it. Start with the blue state loop on the left. An encoded observation fills a target slot and activates a diagonal entry of the state mask; the discrepancy then passes leftward through the endpoint Jacobian transpose. The adjacent action loop retains a fixed overlap mask, while corrected state context conditions its predictor. On the green side, read the residual and mask at the right, then follow the new state entry through the full block Jacobian toward both outputs. Its lower-left block is the transposed predicted-state/noisy-action derivative. Equation (29) confirms this direction. Equation (19) additionally specifies modality scaling and guidance strength, which this schematic suppresses. ev-guidanceev-stageev-jointev-ling-runtimeev-dream-runtimeev-preconditioner

What it supports. Stage-wise feedback can influence actions through refreshed state context. Joint feedback also has a direct derivative path from a state discrepancy to action coordinates during one solver evaluation. A block-diagonal measurement mask therefore does not imply independent state and action corrections: coupling resides in the endpoint predictor.

Where the evidence stops. The diagram describes a possible correction path, not its strength or closed-loop stability. A nonzero Jacobian block need not give a nonzero response to every residual. Actual observation activation is constrained by the causal encoder and tested schedules.

2. Motivation

2.1 The problem and the proposed response

Source description

A generated future can become inconsistent with transitions that have already occurred while its action chunk is being executed. Updating history only before the next generation call cannot constrain individual slots of the active prediction. FBFM treats newly encoded observations as time-aligned measurements and inherited actions as commitments, while leaving unmeasured future content to the pretrained model. The encoded state need not itself be Markovian. ev-problemev-guidance

2.2 What this reading follows

A robot can discover that its predicted future is wrong while the next action chunk is still being generated. FBFM gives those observations an explicit place inside the ongoing computation: they become measurements of particular latent-state slots. Actions already committed by the previous chunk supply a separate, fixed constraint. This edition follows how the two residuals enter stage-wise and joint models, then separates benchmark success from evidence that feedback merely changes a prediction or an action. The reported gains are configuration-dependent, and the video diagnostics show why following observed motion does not by itself guarantee coherent future imagery. ev-problemev-guidanceev-stageev-jointev-ling-resultsev-dream-resultsev-coverage-failure

3. Research context

We place the paper in the collection through its world–action interface. The catalog labels and the reading’s assessment are shown separately.

Catalog dimensionRecorded classification
Major categoryWAMs
ArchitectureNot applicable
Prediction paradigmOther mechanisms
QuadrantOutside quadrants

3.1 Evidence-based assessment

Supports the recorded classification

Reader analysis

FBFM is an inference mechanism spanning stage-wise and joint WAMs, so a single architecture assignment is not applicable to the mechanism itself. The recorded Other mechanisms and Outside quadrants labels fit this feedback role. Efficient inference/real-time control and long-horizon modeling describe its motivation; measured latency reduction or robust longer-horizon deployment is not established. ev-stageev-jointev-frozen-modelsev-limitations

This is the collection’s architectural analysis, not a new related-work survey. Benchmark comparisons and their protocols appear in Section 6.

4. Problem formulation

4.1 Inputs and outputs

InputsOutputs
  • Task condition and solver-start observation–action history
  • Current noisy latent-state/action chunk and flow time
  • Time-aligned committed actions from the previous chunk
  • Causally available observations encoded into the model's latent coordinates
  • Feedback-guided future latent states
  • A generated action chunk whose fresh suffix becomes the next execution chunk

4.2 Equations and their role

Q^t,k1=QtτkQ+(1−τkQ)vˉt,kQ,vFBFMQ=vˉt,kQ+λτkQQ(Jt,kQ)⊤PQWt,kQ(Yt,kQ−Q^t,k1)\widehat{\mathbf Q}^{1}_{t,k}=\mathbf Q^{\tau_k^Q}_{t}+(1-\tau_k^Q)\bar{\mathbf v}^{Q}_{t,k},\qquad \mathbf v_{\mathrm{FBFM}}^{Q}=\bar{\mathbf v}^{Q}_{t,k}+\lambda_{\tau_k^Q}^{Q}(\mathbf J^{Q}_{t,k})^\top\mathbf P^{Q}\mathbf W^{Q}_{t,k}(\mathbf Y^{Q}_{t,k}-\widehat{\mathbf Q}^{1}_{t,k})
Equation (19): Q selects state Z, action A or joint X. Environment time is t; k indexes solver evaluations and τ is flow time. The bar denotes native velocity, Y the lifted target, W support/confidence weights, P modality scaling, J the clean-endpoint Jacobian with respect to the current sample, and λ guidance strength. ev-guidance
et,kA=0 ⟹ gt,kA=JZA⊤et,kZ,JZA=∂Z^t,k1∂AtτkX\mathbf e^A_{t,k}=0\ \Longrightarrow\ \mathbf g^A_{t,k}=\mathbf J_{ZA}^{\top}\mathbf e^Z_{t,k},\qquad \mathbf J_{ZA}=\frac{\partial\widehat{\mathbf Z}^{1}_{t,k}}{\partial\mathbf A^{\tau_k^X}_{t}}
Equation (29) isolates the joint state-to-action route. Here e is the preconditioned masked discrepancy and g its Jacobian-transpose correction. A state discrepancy can change actions even when committed actions have zero residual. This model derivative does not include physical environment dynamics. ev-jointev-preconditioner
eexact=eapprox−δt,δt=Wt ⁣[h† ⁣(h(X^t1))−X^t1]\mathbf e_{\mathrm{exact}}=\mathbf e_{\mathrm{approx}}-\boldsymbol\delta_t,\qquad \boldsymbol\delta_t=\mathbf W_t\!\left[h^\dagger\!\left(h(\widehat{\mathbf X}^{1}_t)\right)-\widehat{\mathbf X}^{1}_t\right]
Appendix B defines δ as masked encoder–decoder reconstruction error. The aligned-coordinate approximation is exact only when the measurement map h and generalized lifting map h† compose to the identity on selected coordinates. Arbitrary nonlinear codecs need not satisfy this condition. ev-approximation

5. Method in detail

5.1 1. Keep the two timelines and two kinds of target separate

Source description

Environment time indexes executed actions and resulting observations; flow time indexes successive refinements of a still-noisy prediction. FBFM connects them only when a causally available observation can be encoded into an aligned latent slot. The previous action chunk supplies commitments, so its overlap mask stays fixed even after some actions have executed. State targets instead change as measurements become available. The general formulation refreshes feedback before solver evaluations, but the evaluated encoder schedules are much coarser than per-action state updates. LingBot's first complete target arrives after action 16, just before its final numerical video update. DreamZero updates its first latent slot after actions 3 and 6, leaving the second slot unmasked. Understanding those timings is essential to interpreting what asynchronous correction actually accomplished. ev-guidanceev-stageev-ling-runtimeev-dream-runtime

5.2 2. Trace a state residual into the action sample

Source description

The correction starts from a predicted clean endpoint, because the measurement describes a state or committed action rather than Gaussian noise. A mask chooses the measured coordinates, and a preconditioner sets their relative numerical scale. The endpoint Jacobian transpose then converts that discrepancy into a change of the current solver sample. In stage-wise generation, corrected state context becomes input to a separate action predictor. In joint generation, Equation (29) exposes a direct state-to-action derivative. DreamZero balances 9,600 active state coordinates against 56 action coordinates using P_Z=56/9600, then applies a separately selected proportional gain. Appendix E's unstable alternatives show why scale matters. The model Jacobian represents local generative sensitivity; it does not include the delayed, nonlinear physical transition returning the next observation. ev-guidanceev-stageev-jointev-dream-runtimeev-preconditioner

5.3 3. Ask which claim each experiment can support

Reader analysis

Reader analysis: the benchmark tables answer whether a particular inference configuration completes more simulator tasks, whereas the cache intervention answers whether corrected state context changes actions. Those are complementary questions. RoboTwin's equal-weight macro improvement cannot be treated as a seed-paired episode effect, and DreamZero's small pooled gain includes two declining suites. The recorded robot sequence asks whether incoming measurements constrain visual prediction; its images also expose conspicuous artifacts. Finally, the auxiliary coverage experiment asks what happens when that measurement support ends. Together these results make a credible case that the correction path operates, but provide a narrower case for reliable control. A stronger evaluation would isolate state feedback from action continuity, test independently selected gains, and measure behavior under actual observation and inference delays. ev-ling-resultsev-ling-provenanceev-dream-resultsev-cache-diagnosticev-robot-videoev-coverage-failureev-evaluationev-gain-searchev-limitations

5.4 Training and inference

During training

Source description

FBFM has no training stage or new loss. The paper describes the underlying flow-matching objective but uses frozen pretrained modules. LingBot's checkpoint is post-trained on RoboTwin2.0; DreamZero uses the RLinf LIBERO SFT checkpoint at step 26,000. The paper does not provide a complete reconstruction of those models' training data or training compute. ev-flowev-frozen-models

During inference

Source description

LingBot predicts two latent slots and 32 actions with 16 committed overlap actions. Its 25 video and 50 action updates each have an additional cache-only call. In the evaluated schedule, the first complete state target arrives after action 16 and affects only the final numerical video update before corrected context reaches the action stage. ev-ling-runtime

Source description

DreamZero uses 16 UniPC updates but eight native velocity/Jacobian refreshes. At intervening updates it recomputes current endpoint residuals and guidance, reusing only native quantities. State targets refresh after actions 3 and 6; the second latent slot remains unmeasured. The effective state scale combines P_Z=56/9600 with k_p=0.0486968. ev-dream-runtime

5.5 Implementation flow

  1. Align measurements and commitments

    Keep solver-start history fixed. As preceding actions execute, install each available encoded observation in its aligned state target and activate its mask. The inherited action target covers the whole aligned overlap and stays fixed even as execution advances. ev-guidanceev-stage

  2. Correct the endpoint through the frozen model

    Predict the clean endpoint from the current noisy sample. Mask its discrepancy from feedback targets, balance modality scales, and propagate the residual through the endpoint Jacobian transpose. Add the scaled correction to the native flow velocity; differentiating the sample does not update model weights. ev-guidanceev-frozen-models

  3. Respect the host architecture

    LingBot guides video generation, then supplies corrected state context to action generation, which also receives committed-action guidance. DreamZero transports states and actions together; its cross-modal Jacobian allows a state residual to affect action coordinates in the same update. ev-stageev-joint

  4. Preserve causal histories and execute the suffix

    Dynamic feedback is kept separate from native history. DreamZero refreshes only causally supported latent targets; after its eight-action overlap, generated action positions 8–15 become the next execution chunk. Predicted video remains a model output, while actions drive actual simulator transitions. ev-dream-runtimeev-evaluation

6. Experiments & results

FBFM inserts observation feedback into a frozen world-action model's active flow solver. It combines changing state measurements with fixed commitments from the preceding action chunk, improving selected RoboTwin task averages and producing a small, heterogeneous LIBERO gain. Its strongest contribution is the explicit correction path; deterministic timing and recorded-video diagnostics leave real-time physical control unestablished.

6.1 Read the original evidence

Table 1. Selected RoboTwin tasks improve under both scene configurations. Original paper, p. 7 ↗

Excerpt from the authors’ paper; cropped without altering the figure or table.

How to read it. Read the Clean and Rand. columns as two evaluations of the same selected set of 42 tasks. Each task-configuration cell first becomes a success fraction; the paper then averages those fractions with equal weight. This matters because the appendix contains cells with either 10 or 20 trials. The Overall column summarizes both configurations using this macro convention. The table rounds values to one decimal place, so its displayed subtraction is less precise than the gains stated in Section 5.1. Tables 6 and 7 retain the original integer counts, and Appendix D explains their mixed CPU/GPU provenance. ev-ling-resultsev-ling-provenanceev-evaluationev-frozen-models

What it supports. Overall macro success rises from 80.1% to 83.1%; the paper reports an unrounded 2.98-percentage-point gain. Clean improves from 80.5% to 83.3%, and Randomized from 79.8% to 82.9%. These are improvements in executed simulator-task completion under the reported evaluation protocol.

Where the evidence stops. The methods are not seed-paired, and some Base cells retain only task-level counts. Longer tasks outside the selected set are excluded. The table provides no confidence intervals and does not isolate state feedback from action-overlap guidance.

Table 2. A small pooled gain conceals opposite effects across LIBERO suites. Original paper, p. 8 ↗

Excerpt from the authors’ paper; cropped without altering the figure or table.

How to read it. Compare Base and FBFM vertically within each suite before looking at Total. Each suite contains ten tasks and 200 evaluation episodes, so the pooled total weights the four suites equally here. Both methods use the same delayed pseudo-asynchronous overlap protocol and 480-step horizon; Base is not DreamZero's native synchronous rollout. The arrows mark only the improving cells. The printed 70.1% and 70.8% totals are rounded: Table 9 supplies the exact 561/800 and 566/800 counts. Read the suite declines alongside the two improvements, rather than interpreting a bold total as a uniform response. ev-dream-resultsev-evaluationev-dream-runtimeev-gain-searchev-limitations

What it supports. Goal and LIBERO-10 each improve by 2.5 percentage points, while Spatial and Object decline by 1.5 and 1.0 points. Pooling all 800 episodes gives 70.125% versus 70.75%, a gain of 0.625 points. Five net successes separate the totals across this evaluation record.

Where the evidence stops. The selected feedback gain was calibrated on task/reset ranges also present in evaluation. The authors suggest cached Jacobian reuse may weaken corrections, but the table does not test that explanation or establish statistical significance for its pooled gain.

Figure 4. Tracking measured motion and preserving clean imagery are different outcomes. Original paper, p. 8 ↗

Excerpt from the authors’ paper; cropped without altering the figure or table.

How to read it. Read each block by column: the rows show the recorded reference, Wan2.2 Base and FBFM at the same timestamp. The upper block spans 0 to 1 second; the lower block samples 2 through 5 seconds. Follow the orange ball relative to the robot and tabletop, then inspect the scene texture. Both methods share the starting image, prompt, seed and 50-step solver, but only FBFM receives subsequent recorded observations. Those 120 frames are causally encoded as 30 latent measurements. The crop preserves the visible corruption: the comparison concerns observation-conditioned prediction, not an entirely clean visual reconstruction. ev-robot-videoev-evaluationev-limitations

What it supports. The authors report full-frame MAE improving from 9.63 to 9.27 and PSNR from 20.06 to 23.10 dB. The frames show the intended use of measured motion, alongside substantial artifacts in FBFM's scene appearance. Aggregate image metrics and recognizable ball tracking capture only part of that visual tradeoff.

Where the evidence stops. This is one recorded physical-robot trial. FBFM receives later measurements that Base lacks, and no policy is tested for improved ball-stopping success here. These images establish neither open-loop forecasting superiority nor real-time physical control.

6.2 Results and evaluation conditions

Task & protocolReported resultComparison & interpretation
LingBot-VA task success on selected RoboTwin2.0 tasks

42 tasks, Clean and Randomized configurations; 10 or 20 episodes per cell; equal-weight task-configuration macro average.

FBFM: Clean 83.3%, Randomized 82.9%, Overall 83.1%.

Success rate (%) and absolute percentage-point gain

Base: 80.5%, 79.8%, 80.1%; reported unrounded gains: +2.86, +3.10, +2.98 points.

Broader improvement within this selected set; unequal episode counts are not pooled, and methods are not seed-paired. ev-ling-resultsev-ling-provenance

DreamZero task success across four LIBERO suites

Spatial/Object/Goal/LIBERO-10, ten tasks each, reset IDs 0–19, 480-step horizon; matched delayed overlap protocol.

566/800 = 70.75%; suites 77.0%, 72.0%, 71.0%, 63.0%.

Pooled success rate and suite success rates (%)

Base 561/800 = 70.125%; suites 78.5%, 73.0%, 68.5%, 60.5%.

The +0.625-point pooled gain combines two +2.5-point suite improvements with −1.5/−1.0-point declines. This is not comparison to native synchronous DreamZero. ev-dream-resultsev-evaluation

LingBot state-feedback and cache-to-action diagnostic

Four paired randomized task–trial units; RTC/FBFM comparison and controlled CacheCut intervention.

MSE 0.6751; cache-switch action RMS 0.00890; velocity AUC ratio 2.52.

Latent MSE; normalized fresh-action RMS; velocity-RMS AUC ratio

RTC MSE 0.6828; cache-switch action change is 7.39 times the same-cache repeat floor.

Supports computational influence of feedback on action generation; four trials do not establish a task-success mechanism or broad effect size. ev-cache-diagnostic

Recorded physical-robot observation prediction

One ball-stopping sequence, frozen Wan2.2-TI2V-5B, matched anchor/prompt/seed and 50-step solver; FBFM receives all 30 measured future latent slots.

FBFM MAE 9.27, PSNR 23.10 dB.

Full-frame MAE (lower better); PSNR in dB (higher better)

Base MAE 9.63, PSNR 20.06 dB; Base receives no later frames.

Measures assimilation of recorded observations with persistent artifacts, rather than improved physical robot task success. ev-robot-video

DreamZero state-preconditioner screening

Spatial/Object, reset IDs 0–4, 100 paired episodes per setting on the same A6000.

L1-mass balancing: 73/100; maximum action norm 1.608.

Successes/episodes; maximum action norm

RMS balancing: 59/100, 9.03×10^3; unattenuated feedback: 0/100, 2.55×10^7.

State scaling materially affects this configuration's numerical behavior; it supplies no general closed-loop stability guarantee. ev-preconditioner

6.3 Ablations and diagnostic examples

Read component removals and qualitative examples within their stated evaluation conditions.

Figure 5. A controlled cache switch tests whether corrected state context reaches action generation. Original paper, p. 8 ↗

Excerpt from the authors’ paper; cropped without altering the figure or table.

How to read it. Panel a compares next-state latent errors in four paired trials: two on adjust_bottle and two on pick_diverse_bottles. Notice that its vertical axis starts at 0.5, so bar-height differences should be read against the labeled scale. Panel b changes only the installed RTC versus FBFM cache while holding history, noise, constraints and the solver schedule fixed. Repeating the same cache supplies the numerical floor; the axis reports fresh-action RMS in units of 10 to the minus three. Panel c follows the corresponding velocity changes across the 51 recorded evaluations. Appendix C distinguishes 50 numerical action updates from the additional cache-only call. ev-cache-diagnosticev-ling-runtime

What it supports. Mean next-state MSE decreases from 0.6828 to 0.6751. The cache intervention changes fresh actions by normalized RMS 0.00890, 7.39 times the repeat floor; the velocity curve has a 2.52-times AUC ratio. These measurements support the intended computational route from corrected state context to action output.

Where the evidence stops. An action perturbation demonstrates influence, not improved action quality. Four task–trial units provide a narrow mechanism diagnostic. This figure cannot attribute the broader benchmark-success gain to state feedback or quantify robustness across tasks.

Figure 6. What happens after the measurements stop is a separate test of the generated future. Original paper, p. 28 ↗

Excerpt from the authors’ paper; cropped without altering the figure or table.

How to read it. Follow time on the horizontal axis and table-region mean absolute error on the vertical axis; lower is better. Black is Base without state feedback. Blue, orange and red use 10, 20 and 30 measured latent slots on the auxiliary ball-collision sequence. The vertical lines mark the ends of the shorter measured prefixes, around 1.67 and 3.33 seconds. Blue rises sharply after the first boundary, and orange rises after the second. Red receives measurements across the evaluated horizon. Figure 7 supplies the corresponding frame grid, where the shorter-prefix settings develop large areas of incoherent imagery. ev-coverage-failureev-approximationev-robot-video

What it supports. Extending the measured prefix delays the observed error surge. With all 30 slots, the appendix reports table-region MAE 6.34 versus Base 21.77 and ball-center error 3.05 versus 173.84 pixels. The temporal association identifies a failure boundary that full-coverage tracking metrics alone would miss.

Where the evidence stops. This auxiliary collision sequence is separate from the robot-arm trial. The plot associates corruption with feedback ending but does not identify its cause. Codec/backbone mismatch remains an author hypothesis, and full coverage does not evaluate an unobserved continuation.

7. Analysis & limitations

7.1 What the evidence leaves open

Reader analysis

Pseudo-asynchronous evaluation controls feedback timing independently of wall-clock latency. Added differentiation and feedback overhead remain barriers to physical control frequency; the paper establishes no real-time deployment result. ev-evaluationev-limitations

Reader analysis

RoboTwin excludes longer tasks and mixes renderer provenance, with some Base records lacking episode identity. Main success tables provide point estimates without confidence intervals. ev-ling-provenanceev-ling-resultsev-dream-results

Reader analysis

The selected DreamZero gain has the best expanded point estimate, but neither paired comparison is significant at 0.05. Tuning uses task/reset ranges also present in evaluation, so the results do not constitute an independent held-out gain-selection test. ev-gain-searchev-evaluation

Reader analysis

Finite-prefix video feedback can cause severe post-prefix corruption. Appendix F's codec/backbone mismatch explanation remains hypothetical; better observed-frame tracking alone does not demonstrate reliable unobserved futures. ev-coverage-failureev-approximation

7.2 Questions for discussion

  1. How much of task-success improvement comes from state feedback beyond committed-action continuity?
  2. Does feedback remain useful when causal encoding and wall-clock latency delay its arrival?
  3. Can codec-consistent latent feedback preserve unobserved futures after measurements stop?

8. Reproducibility audit

8.1 Requirements and known gaps

Source description

Obtain the specified checkpoints and corrected implementation revisions: DreamZero cb08c9e with audit 0f2cc4f, and gain standardization a051933. LingBot's launcher/task-manifest changes remain unfrozen. Preserve BF16, native caches, action normalization, causal target windows and mask-only NONE/RTC/FBFM controls. Exact training compute and end-to-end latency are not documented. ev-frozen-modelsev-code-statusev-ling-runtimeev-dream-runtimeev-limitations

Reader analysis

Proposed checks: compare RTC with full FBFM under identical timing and seeds while measuring state error and fresh-action changes; separately test finite feedback prefixes while measuring latent reconstruction error and post-prefix corruption. Both should preserve solver budgets and record target activation, correction norms and nonfinite outputs. ev-cache-diagnosticev-safeguardsev-coverage-failureev-approximation

8.2 Proposed reproduction checks

The following checks are proposals motivated by the paper. They have not been run as part of this reading.

Check 1: Isolate state feedback beyond the committed-action prefix

Reader-proposed check, not performed: run matched NONE, RTC and FBFM modes with the same checkpoint, task/reset pairs, initial noise, solver budget and deterministic release schedule. Select gains on disjoint calibration trials. Record latent endpoint error, fresh-suffix action RMS against a same-cache repeat, and paired task outcomes. Repeat the CacheCut intervention to distinguish state-context influence from ordinary numerical variation. If state error improves without an above-floor action change, the claimed state-to-action route is not reproduced; if actions change without success gains, computational influence is reproduced but its control benefit remains unsupported. ev-cache-diagnosticev-frozen-modelsev-code-statusev-ling-runtimeev-dream-runtimeev-gain-searchev-safeguards

Check 2: Test whether finite-prefix corruption tracks latent incompatibility

Reader-proposed check, not performed: repeat the auxiliary sequence with zero, 10, 20 and 30 measured slots, keeping the anchor, prompt, initial noise and solver budget identical across conditions. At the prefix boundary, measure the masked encoder–decoder reconstruction discrepancy from Appendix B, then track unmeasured-region latent error, table-region MAE and visible corruption. Add a decode/re-encode diagnostic on the same generated endpoint without changing the trajectory. The codec-mismatch hypothesis predicts a relationship between reconstruction discrepancy and post-prefix failure. Corruption without that relationship would weaken this explanation and motivate a separate test of guidance dynamics. ev-coverage-failureev-approximationev-safeguards

8.3 Reading coverage

Visual audit: Visually inspected the title/author page, all seven figures, all twelve tables, main formulation and evaluation pages, and appendices A–F, including implementation revisions, scheduling, gain-search hardware provenance and numerical safeguards. Figure 3's mask behavior and transposed cross-modal blocks were checked against Eqs. (19), (22), and (29); no claim-relevant conflict was found. The reported 51 diagnostic evaluations were read alongside the 50 numerical action updates plus cache-only call in Appendix C. All six final original crops were inspected. All eight supplied text chunks were read, including reference pages 11–13, which were not rendered. Separate supplementary videos, preprocessing metadata, raw ledgers and code were outside the supplied material.

PDF pages inspected for this edition: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29. Appendix coverage: reviewed.

Original figures and tables remain the work of the source’s authors. Extractions preserve their scientific content; any HTML wrapper layout is disclosed with each figure. The surrounding reading notes are our own.

Text reading scope & known omissions
  • Title and author page; arXiv:2607.29235v1, 31 July 2026
  • Abstract and Sections 1–2: motivation, interaction model and flow matching
  • Sections 3.1–3.5: masked guidance, stage-wise and joint generation, frozen inference
  • Sections 4–5: evaluation protocols, benchmark results and physical-observation prediction
  • Sections 6–7: related work, conclusion and limitations
  • References, PDF pp. 11–13
  • Appendix A: notation tables
  • Appendix B.1–B.4: pseudoinverse assumptions and few-step guidance
  • Appendix C.1–C.4: implementation revisions, alignment, solver schedules and safeguards
  • Appendix D.1–D.2: complete task-count tables
  • Appendix E.1–E.5: preconditioning, gain search and record eligibility
  • Appendix F: auxiliary video-codec diagnostic

Outside the original text pass

  • Text extraction does not reconstruct figure images; inspect the retained PDF for figures and equation/table layout.
  • Separate supplemental material availability has not been fully verified.
  • The extraction's image limitation was addressed by inspecting all seven figures and all twelve tables in the supplied PDF. Reference pages were read as text.
  • Separate supplementary videos, preprocessing metadata, raw episode ledgers and code were not supplied for this reading; none were inspected, and no experiments were reproduced.
  • Identity/version note: the supplied v1 title and all six authors match the catalog. The catalog abstract summarizes over-5% gains in favorable settings, whereas this PDF reports broader 3.0-point and 0.6-point aggregates. No other PDF edition or primary revision chain was supplied; the reports describe only this verified artifact.

The visual audit above records the subsequent illustrated pass.

8.4 Traceable evidence

ev-identityPDF p. 1, title, author/affiliation block, contribution footnote and arXiv marginInspect

The exact title and six authors match the catalog. The PDF identifies arXiv:2607.29235v1, 31 July 2026; Peize Li and Ruimeng Zhang contributed equally, and Kai Chen and Shanghang Zhang are corresponding authors. Six institutions are listed.

Go to primary source ↓
ev-problemPDF pp. 1–2, Abstract, Section 1 and Section 2.1, Eqs. (3)–(6)Inspect

New encoded observations are measurements of time-aligned future slots. History refresh between chunks and committed-action continuity address different constraints. Latents can be partial observations; rewards and value functions are outside the formulation.

Go to primary source ↓
ev-flowPDF p. 3, Section 2.2, Eqs. (10)–(15)Inspect

The linear path interpolates Gaussian noise and a target chunk; training matches velocity to target minus noise. Inference integrates a conditional vector field. Remaining-noise time reverses the velocity sign.

Go to primary source ↓
ev-guidancePDF pp. 3–4, Sections 3.1–3.2, Eqs. (16)–(19)Inspect

The preceding action overlap is fixed; newly available states update feedback targets and masks. Equation (19) adds a preconditioned, masked endpoint-residual VJP to the frozen native velocity.

Go to primary source ↓
ev-stagePDF pp. 4–5, Figure 1 and Section 3.3, Eqs. (20)–(24)Inspect

Stage-wise generation predicts states before actions. State feedback guides the state flow; later feedback can refresh the state context passed to the ongoing action flow. The full aligned committed-action overlap stays fixed.

Go to primary source ↓
ev-jointPDF pp. 5–7, Section 3.4, Eqs. (25)–(29), Figures 2–3 and captionsInspect

Joint generation uses a block state/action mask and the full endpoint Jacobian. The action correction includes the transpose of the predicted-state/noisy-action Jacobian block multiplying the state discrepancy. Figure 3 contrasts this with separate stage-wise corrections.

Go to primary source ↓
ev-approximationPDF pp. 16–17, Appendix B.1–B.4, Eqs. (30)–(46)Inspect

Binary coordinate selection yields an exact Moore–Penrose projection; confidence weighting generally does not. The aligned-coordinate residual approximation differs from exact lifting by masked encoder–decoder reconstruction error. VJPs use reverse-mode differentiation; the guidance schedule is clipped.

Go to primary source ↓
ev-frozen-modelsPDF p. 5, Section 3.5; p. 6, Sections 4.1–4.2; p. 18, Appendix C.1Inspect

FBFM adds no learned module and freezes the WAM and encoders. LingBot-VA uses the official RoboTwin2.0-post-trained checkpoint; DreamZero uses RLinf LIBERO SFT step 26,000. Native solvers, caches and classifier-free guidance are retained; both routes use BF16.

Go to primary source ↓
ev-ling-runtimePDF pp. 18–19, Table 5 and Appendix C.2Inspect

LingBot predicts two latent slots and 32 actions, with a fixed 16-action overlap; it retains 25 numerical video updates and 50 numerical action updates, each followed by a nonintegrated cache-only call. Four observation packages produce the first feedback latent after action 16, just before the final numerical video update. Feedback and real-history caches remain separate.

Go to primary source ↓
ev-dream-runtimePDF pp. 19–20, Appendix C.3, Eqs. (47)–(50)Inspect

DreamZero uses 16 actions, an eight-action overlap, 16 UniPC updates and eight native DiT/Jacobian refreshes. Current residuals and guidance are recomputed even when native velocity and Jacobian are reused. Targets refresh after actions 3 and 6 in the first latent slot; the second stays unmasked. Active state/action coordinates number 9,600/56; P_Z=56/9600 and k_p=0.0486968.

Go to primary source ↓
ev-evaluationPDF p. 6, Sections 4.1–4.2; pp. 8–9, Section 5.3; p. 20, Appendix C.3Inspect

A deterministic pseudo-asynchronous clock controls feedback timing independently of wall-clock latency. LIBERO evaluates ten tasks in each of four suites, reset IDs 0–19, and a 480-step horizon. Base shares the delayed overlap protocol and is distinct from native synchronous DreamZero. Success uses environment predicates.

Go to primary source ↓
ev-ling-resultsPDF p. 7, Table 1 and Section 5.1; pp. 22–23, Tables 6–7, all task rows and macro rowInspect

Across 42 selected tasks in Clean and Randomized configurations, macro success changes from 80.5/79.8/80.1% to 83.3/82.9/83.1% (Clean/Randomized/Overall). Section 5.1 gives unrounded gains of 2.86, 3.10 and 2.98 percentage points.

Go to primary source ↓
ev-ling-provenancePDF p. 21, Appendix D introductory paragraph and D.1Inspect

RoboTwin cells contain 10 or 20 episodes and are not seed-paired across methods. Longer tasks outside the selected set are excluded. The ledger combines CPU/GPU sources; 32 Base cells retain task-level counts without episode identity. Equal-weight task-cell rates are macro-averaged.

Go to primary source ↓
ev-cache-diagnosticPDF p. 6, Section 4.2 mechanism diagnostic; p. 8, Figure 5 and Section 5.2Inspect

Four paired trials on randomized adjust_bottle and pick_diverse_bottles compare RTC with FBFM. Mean next-state MSE changes from 0.6828 to 0.6751. CacheCut holds history, noise, constraints and schedule fixed. Cache switching changes fresh-action RMS by 0.00890, 7.39 times repeat noise; velocity RMS is above that floor at 51 evaluations, with AUC ratio 2.52.

Go to primary source ↓
ev-dream-resultsPDF p. 8, Table 2 and Section 5.3; pp. 24–25, Tables 8–9, suite subtotals and total rowInspect

Base/FBFM successes are Spatial 157/154, Object 146/144, Goal 137/142, and LIBERO-10 121/126, each out of 200. Pooled totals are 561/800 (70.125%) and 566/800 (70.75%), a 0.625-point increase. LIBERO-90 is excluded.

Go to primary source ↓
ev-robot-videoPDF p. 7, Section 4.3; p. 8, Figure 4 and caption; p. 9, Section 5.4Inspect

The recorded RealSense D435i robot-arm ball-stopping trial uses frozen Wan2.2-TI2V-5B with matched anchor, prompt, seed and 50-step solver. FBFM receives 120 subsequent frames as 30 latent measurements over a five-second, 121-frame horizon; Base receives no later image. Full-frame MAE is 9.63/9.27 and PSNR 20.06/23.10 dB, with visible FBFM artifacts.

Go to primary source ↓
ev-limitationsPDF p. 10, Section 7 limitations paragraph; p. 9, Section 5.3 discussionInspect

The authors identify cached velocity/Jacobian reuse, nonlinear encoder–decoder approximation, and added differentiation/feedback overhead as limitations. Real-time robot control frequency still requires engineering. Cached reuse is offered as a likely explanation for limited DreamZero gains.

Go to primary source ↓
ev-preconditionerPDF p. 26, Appendix E.1–E.2, Eqs. (51)–(52), Table 10Inspect

A 100-episode-per-setting sweep on Spatial/Object initial states 0–4 uses the same A6000 and protocol. Unattenuated, RMS-balanced and L1-mass-balanced state feedback achieve 0/100, 59/100 and 73/100 successes, with maximum action norms 2.55×10^7, 9.03×10^3 and 1.608. The physical feedback loop is not contained in the endpoint Jacobian; empirical scaling is not a stability proof.

Go to primary source ↓
ev-gain-searchPDF pp. 26–27, Appendix E.3–E.5, Tables 11–12 and eligibility paragraphsInspect

Logarithmic gain screening uses four tasks and reset IDs 0–4; the k_p=1 control is historical A6000, while new screening runs use Pro6000. The planned 0.0392419 point was not executed. Eight-task expansion uses ten initial states per task and counts reused screening records once. Gains 0.0316228/0.0486968/0.0749894 yield 56/64/60 successes out of 80; neither comparison establishes superiority at 0.05. Sixty LIBERO-90 trials are excluded.

Go to primary source ↓
ev-code-statusPDF p. 18, Appendix C.1; p. 27, Appendix E.5Inspect

DreamZero's corrected numerical integration is identified by cb08c9e, with audit revision 0f2cc4f, superseding a7dcd4a; the default main branch lacks that path. Gain search is later standardized at a051933 after runs on a dirty revision. LingBot is based on e482dcc, but launcher/task-manifest changes are not frozen into a published commit.

Go to primary source ↓
ev-safeguardsPDF p. 20, Appendix C.4Inspect

Diagnostics track masks, feedback offsets, endpoint errors, correction norms, guidance weights and Jacobian refreshes. Nonfinite outputs are rejected; trust-region, norm-clipping and native-update fallback safeguards remain unevaluated.

Go to primary source ↓
ev-coverage-failurePDF pp. 28–29, Appendix F, Figures 6–7 and captionsInspect

The separate auxiliary ball-collision sequence tests state-only feedback covering 10, 20 or 30 latent slots. Error rises after measured prefixes end at about 1.67/3.33 seconds. Full coverage reduces table-region MAE from 21.77 to 6.34 and ball-center error from 173.84 to 3.05 pixels. Codec/backbone mismatch is a hypothesis, not an established cause.

Go to primary source ↓

8.5 Primary sources

Scroll across the image to inspect details. Press Esc to close.