GigaBrain-0: A World Model-Powered Vision-Language-Action Model
1. Paper overview
In one sentence: GigaBrain-0 turns world-model generation into diverse VLA training data, improving tested visual robustness while leaving the full generation and deployment recipes underspecified. e02e03e04e13e15e16e17e18e19
| At a glance | What to know |
|---|---|
| Research problem | Source description Physical robot demonstrations are costly and repetitive. The paper asks whether synthetic visual and behavioral diversity can improve real-world manipulation when task-specific physical demonstrations are scarce, while retaining language understanding, spatial precision and feasible inference costs. e02 |
| Core mechanism | |
| A key reported result | On-device table bussing: Small: 80%; 0.13 s; 1.9 GB; 402M; 840 GFLOPs. Success; inference latency; inference VRAM; parameters; FLOPs. Jetson AGX Orin; Small and pi0 fine-tuned on 1K G1 bussing episodes. Evaluation count unspecified. pi0: 80%; 1.28 s; 17.5 GB; 3.2B; 4400 GFLOPs. Same reported success with lower reported resource costs; this compares Small with pi0, not full GigaBrain-0. e18 |
| Reading caution |
Core contributions
Figure 2. Intermediate embodied predictions and continuous actions occupy distinct expert branches. Original paper, p. 4 ↗
Excerpt from the authors’ paper; cropped without altering the figure or table.
How to read it. Read from the bottom inputs toward the top predictions. RGBD tokens carry visual geometry; prompt and state provide task and robot context. The trajectory tokens are learnable inputs, whose outputs feed a GRU for coordinate regression. The top-left group also contains subgoal language and discrete actions, which Section 3 says use autoregressive prediction. On the right, the action expert consumes noisy actions and predicts continuous action chunks. The Knowledge Insulation label refers to training interference control. Cross-check with Section 3 and Eq. (1): trajectory attention is non-causal, but language/action-token prediction is autoregressive. This graphic does not supply a full attention mask or gradient-routing specification. e03e04e09e19
What it supports. The architecture supports a division between semantic/embodied intermediate predictions and continuous motor output. It does not show a shared future-video-and-action predictor. GigaWorld supplies data outside this diagram, so the existence of intermediate trajectory predictions should not be read as evidence of world-model rollout planning during deployment.
Where the evidence stops. The dashed action paths do not establish the solver schedule or feedback cadence. Knowledge Insulation is named without enough detail to reconstruct its gradients; Eq. (1) also leaves a trajectory-token/keypoint notation ambiguity.
2. Motivation
2.1 The problem and the proposed response
Physical robot demonstrations are costly and repetitive. The paper asks whether synthetic visual and behavioral diversity can improve real-world manipulation when task-specific physical demonstrations are scarce, while retaining language understanding, spatial precision and feasible inference costs. e02
2.2 What this reading follows
Imagine teaching a robot to fold using demonstrations of only a white garment. GigaBrain-0 broadens that narrow experience by generating visually altered demonstrations, then trains a policy that combines language understanding, depth perception and continuous action prediction. Its world model works upstream as a data engine; the deployed controller is a VLA with separate vision-language and action experts. This distinction matters when reading both the architecture and the experiments. The strongest mechanism-relevant evidence varies synthetic-data sampling during fine-tuning and measures real robot success. The figures also expose limits: one task ties the baseline, some prose disagrees with the bars, and the lightweight deployment result uses a separate model. e02e03e04e13e15e16e17e18e19
3. Research context
We place the paper in the collection through its world–action interface. The catalog labels and the reading’s assessment are shown separately.
| Catalog dimension | Recorded classification |
|---|---|
| Major category | VLA |
| Architecture | Dual-system |
| Prediction paradigm | Not applicable |
| Quadrant | Not applicable |
3.1 Evidence-based assessment
Supports the recorded classification
The VLA/data-augmentation classification fits. Distinct vision-language and action experts support the recorded dual-system description, without establishing asynchronous execution. A single end-to-end name or joint loss does not establish a One Model world-action architecture. IDM labels synthetic videos offline; the deployed policy does not jointly predict future observations and actions. Not-applicable world-action quadrant labels are therefore reasonable. e03e04e09e19
This is the collection’s architectural analysis, not a new related-work survey. Benchmark comparisons and their protocols appear in Section 6.
4. Problem formulation
4.1 Inputs and outputs
| Inputs | Outputs |
|---|---|
|
|
4.2 Equations and their role
5. Method in detail
5.1 First separate the data engine from the deployed controller
GigaWorld and GigaBrain-0 solve different parts of the pipeline. GigaWorld broadens the demonstrations available for learning: it can change appearances, re-render camera views, translate simulations, replace human hands with robot geometry, or generate a video that an inverse dynamics model labels with actions. These routes do not all recover labels in the same way. Real2Real aims to preserve the original motion; view and human transfer use explicit geometric retargeting; generated videos require inferred actions. The resulting examples are filtered and used to train a VLA. At deployment, that policy predicts action chunks from observations and instructions. Section 6 explicitly reserves interactive world-model reinforcement learning and direct world-model policy generation for future work. The correct reading is therefore an offline data-augmentation contribution with real-robot policy evaluations. e06e07e08e09e10e19
Figure 4. Real2Real transfer changes the visual context of an existing demonstration. Original paper, p. 7 ↗
Excerpt from the authors’ paper; cropped without altering the figure or table.
How to read it. Compare horizontally within each row. The first column is the recorded scene; the following columns change colors, surface materials or lighting while keeping broadly similar object layouts. The cloth row is particularly relevant to the appearance-generalization experiment, which starts from white-garment demonstrations. The source describes depth from VideoDepthAnything and Canny edges as structural conditions supplied through ControlNet. Those controls are intended to constrain the diffusion generator while text prompts vary appearance. Although this figure displays three transferred examples per row, Section 4.2 reports generating approximately ten variants per real clip. That per-clip count does not specify the final training corpus size. e06e10e15
What it supports. The visual makes the augmentation mechanism tangible: a demonstration can expose the learner to more visual contexts without another physical recording. Section 5.4 tests this idea through real garment folding under changed appearances. The crop itself demonstrates appearance variation; the robot success evidence comes from the separate data-mixture study.
Where the evidence stops. These are selected stills, which cannot verify temporal consistency, contact physics or action-label correctness. The stated quality-filter dimensions are supplied, but score weights, acceptance thresholds and rejection rates are not.
5.2 Then distinguish the three intermediate targets from motor output
The phrase embodied CoT groups several supervision channels that use different prediction mechanisms. Manipulation trajectories are ten sampled image-plane points, produced with learnable tokens, non-causal visual attention and a GRU decoder. Subgoal language and discrete action tokens instead use autoregressive next-token prediction. Continuous action chunks come from a separate flow-matching DiT. Equation (1) combines the corresponding token, action and trajectory terms, while Knowledge Insulation is intended to prevent conflicting optimization. The real-data pipeline explains where supervision originates: gripper transitions partition subtasks, constrained Qwen-VL-2.5 produces descriptions, and projected end-effector coordinates provide image-plane paths. Only some data carry these annotations. This describes a training design, but does not specify how frequently subgoals refresh during execution or how much each intermediate target independently improves robot success. e03e04e05e11e12e13
5.3 Finally read alpha as a controlled sampling intervention
The mixture experiments hold the small real demonstration set and fine-tuning update budget fixed while changing how often synthetic samples enter training. This is more directly informative about augmentation than the full-model comparison with pi0, whose pretraining history differs. Even so, the intervention changes a bundle: generated examples bring new visual distributions and potentially new behaviors or label errors, depending on the pipeline. The middle panel illustrates that more synthetic sampling need not always help. A reader should also distinguish the aggregate test set from a strictly unseen-only split: the original garment, placement or viewpoint remains in each evaluation set. My interpretation is that these curves support robustness to the particular tested shifts, but neither quantify a general replacement rate for physical data nor isolate photorealism as the reason for improvement. e11e12e15e16e17
5.4 Training and inference
During training
Pretraining combines the data sources; downstream tasks then receive task-specific fine-tuning. The joint objective combines masked next-token loss, flow matching and trajectory regression, with trajectory weight 1. Knowledge Insulation is intended to prevent conflicting optimization between the vision-language and action branches; detailed gradient masks are not supplied. e04e05e11e12
Each generalization sweep fixes 50 real demonstrations, batch 128 and 20K fine-tuning steps, varying the probability alpha of sampling generated data. Alpha changes sampled data composition, not a disclosed total generated-corpus size. e15e16e17
During inference
Observations, instruction and state condition intermediate predictions and action-chunk generation for robot execution. Depth may be absent. The paper does not give the action horizon, denoising-step count, precise subgoal-refresh schedule or execution feedback cadence; Figure 2 is not a complete deployment algorithm. No inference-time world-model rollout search is described. e03e04e19
5.5 Implementation flow
- Encode geometry and semantics
PaliGemma2 provides the vision-language expert. SigLIP gains a zero-initialized depth-channel kernel; its RGB weights are preserved at initialization, then the encoder remains trainable. Random depth dropout replaces depth with zeros. e03
- Predict embodied intermediate structure
Ten learnable trajectory tokens attend bidirectionally to visual context. A lightweight GRU regresses ten sampled 2D end-effector keypoints. Subgoal language and discrete actions use autoregressive prediction, whereas the action DiT predicts continuous chunks. These targets are distinct from predicted future video. e03e04
- Prepare real demonstrations
AgiBotWorld, RoboMind and Open X-Embodiment supplement 1182 proprietary hours. Missing depth uses MoGe; gripper transitions segment subtasks for constrained Qwen-VL-2.5 labeling. Projected end-effector positions supervise trajectories. Fully, partially and unannotated data are mixed; corpus deduplication caps each unique task at 50 demonstrations. e05
- Expand the training distribution
Real2Real uses depth and edges through ControlNet to change appearance. View transfer reprojects depth, inpaints gaps and adjusts robot geometry with IK/URDFs. Sim2Real visually transfers simulated scenes; human transfer replaces EgoDex hands with rendered robot arms. Image-conditioned videos receive IDM action labels. Multiview generation concatenates view noise maps. e06e07e08e09
- Filter generated examples
Composite quality checks assess geometry, cross-view agreement, instruction alignment and physical plausibility, assigning videos to pretraining, fine-tuning or rejection. The scoring recipe is deferred, so apparent realism alone cannot certify correct action labels. e10
6. Experiments & results
GigaBrain-0 trains a robot VLA on real demonstrations and GigaWorld-generated variants, combining RGBD perception, embodied intermediate predictions and a flow-matching action expert. Controlled data-mixture studies support improved robustness; several prose claims conflict with plotted results. GigaWorld serves as a training-data engine, while Small targets edge execution.
6.1 Read the original evidence
Figure 10. The full model improves five plotted task outcomes and ties the sixth. Original paper, p. 13 ↗
Excerpt from the authors’ paper; cropped without altering the figure or table.
How to read it. Use the legend: pale bars are pi0 and darker bars are GigaBrain-0. The axis says percent but is ticked from 0 to 1, so a bar at 0.9 corresponds to about 90% success. Read each pair with its printed platform label; G1 and PiPER tasks are not one common deployment protocol. Sections 5.1–5.3 report task-specific demonstration counts and training steps, with matching fine-tuning settings for pi0. Those settings range from 100 to 489 demonstrations and 20K to 40K updates. The source provides neither test-trial counts nor error bars for this figure. Values inferred from bar heights should therefore remain approximate. e11e12e13
What it supports. The plotted full-model success rates are approximately 60%, 50%, 90%, 90%, 90% and 30%, in left-to-right order. Table bussing rises from about 65% to 90%, while juice preparation stays at about 90% for both methods. The low basket-moving result also limits any broad claim of uniformly reliable mobile manipulation.
Where the evidence stops. Section 5.1 assigns 30% and 10% dexterous gains in the opposite order from the plotted 10- and 30-point gaps. Section 5.2 describes superiority, but juice ties. Neither comparison isolates the causal contribution of CoT or depth.
Table 2. Small trades model capacity for substantially lower reported Orin resource use on one bussing task. Original paper, p. 17 ↗
Excerpt from the authors’ paper; cropped without altering the figure or table.
How to read it. Read the model names first: this table concerns GigaBrain-0-Small, not the full model in Figure 10. Section 5.5 says both rows are fine-tuned on 1K table-bussing episodes from the G1 robot, then compared on Jetson AGX Orin. Small replaces the vision-language backbone with SmolVLM2 and uses an approximately 100M-parameter action expert. The implementation also removes redundant transfers/conversions, uses autocast, caches RoPE tables and compiles key forward/denoising components. Compare the latency and VRAM columns alongside success rather than using parameter count alone. The table reflects the combined architecture and implementation changes, not a controlled breakdown of each optimization. e18
What it supports. Both rows report 80% success. Small reports 0.13 seconds inference latency and 1.9 GB VRAM, compared with 1.28 seconds and 17.5 GB for pi0. Its 402M parameters and 840 GFLOPs are also lower. This supports the reported deployment tradeoff for the stated bussing experiment, without establishing identical capability across the other tasks.
Where the evidence stops. Test counts, uncertainty, power mode, input configuration, warmup and software versions are not supplied. Latency should not be converted into a robot control frequency without the missing action-chunk and execution schedule.
6.2 Results and evaluation conditions
| Task & protocol | Reported result | Comparison & interpretation |
|---|---|---|
| Dexterous manipulation Laundry folding: G1, 300 demos, 40K steps; paper towels: PiPER, 100 demos, 20K steps; batch 128. Test counts unspecified. | Figure 10 estimates: folding 60%; towels 50%. Real-robot success rate | pi0: approximately 50% and 20%, respectively; matched fine-tuning. Approximate gains are 10 and 30 percentage points. Section 5.1 instead assigns 30% and 10%; unresolved conflict. e11e13 |
| Long-horizon manipulation Bussing: PiPER, 100 demos, 20K steps; juice: G1, 489 demos, 35K steps; batch 128. Test counts unspecified. | Figure 10 estimates: bussing 90%; juice 90%. Real-robot success rate | pi0: approximately 65% and 90%; matched fine-tuning. Bussing improves, but juice ties. These comparisons do not isolate CoT. e12e13 |
| Mobile manipulation Boxes: G1, 300 demos, batch 128; baskets: PiPER, 378 demos, batch 192; both 30K steps. Test counts unspecified. | Figure 10 estimates: boxes 90%; baskets 30%. Real-robot success rate | pi0: approximately 80% and 20%; matched fine-tuning. Both gains are about 10 percentage points; basket success remains low. e12e13 |
| Laundry folding appearance generalization 50 white-garment demos plus Real2Real data; 10 garments including the collected appearance, five trials each; batch 128, 20K steps. | Approximately 83% at alpha=90%; about 75% at alpha=75%. Real-robot success rate versus generated-data sampling probability | Approximately 24% at alpha=0. Supports appearance augmentation under this protocol; plots do not support above 80% at alpha=75%. e15 |
| Table bussing placement generalization 50 fixed-layout demos plus Sim2Real data; 10 layouts including the collected layout, five trials each; batch 128, 20K steps. | Approximately 91% at alpha=75%; 89% at alpha=90%. Real-robot success rate versus generated-data sampling probability | Approximately 25% at alpha=0. More generated sampling is not monotonically better; diversity and visual transfer vary together. e16 |
| Table bussing viewpoint generalization 50 fixed-view demos plus view-transfer data; nine views including the collected view, five trials each; batch 128, 20K steps. | Approximately 87% at alpha=90%. Real-robot success rate versus generated-data sampling probability | Approximately 33% at alpha=0. Evidence concerns the tested camera shifts; the aggregate includes the original viewpoint. e17 |
| On-device table bussing Jetson AGX Orin; Small and pi0 fine-tuned on 1K G1 bussing episodes. Evaluation count unspecified. | Small: 80%; 0.13 s; 1.9 GB; 402M; 840 GFLOPs. Success; inference latency; inference VRAM; parameters; FLOPs | pi0: 80%; 1.28 s; 17.5 GB; 3.2B; 4400 GFLOPs. Same reported success with lower reported resource costs; this compares Small with pi0, not full GigaBrain-0. e18 |
6.3 Ablations and diagnostic examples
Read component removals and qualitative examples within their stated evaluation conditions.
Figure 17. Increasing synthetic sampling helps all three tested shifts, with a placement peak before the largest mixture. Original paper, p. 15 ↗
Excerpt from the authors’ paper; cropped without altering the figure or table.
How to read it. Read each panel as a separate fine-tuning experiment. Alpha on the horizontal axis is the probability of sampling generated data, not a measured generation-quality score. Every sweep uses 50 real demonstrations, 20K updates and batch 128. The left panel adds Real2Real data for folding appearances; the middle adds Sim2Real data for bussing placements; the right adds view-transfer data for bussing camera shifts. Sections 5.4 and Figures 18–20 specify ten garments, ten layouts and nine views, respectively, each tested five times. Each set includes its original collected condition. Compare bars within a panel before comparing across panels because the tasks and test distributions differ. e15e16e17
What it supports. At alpha=90%, appearance success is roughly 83% and viewpoint success roughly 87%, versus approximately 24% and 33% without generated sampling. Placement success peaks around 91% at alpha=75%, then falls slightly at 90%. The evidence supports these augmentation settings, while the middle panel rules out a universally monotonic benefit from increasing alpha.
Where the evidence stops. The bars have no numeric labels, uncertainty or seed breakdown. Appearance at alpha=75% is about 75%, despite broader above-80% prose on p. 16. This is a data-mixture diagnostic, not an ablation isolating RGBD, CoT or generator quality.
7. Analysis & limitations
7.1 What the evidence leaves open
No separate depth/CoT/insulation ablation or seed uncertainty is reported. Matched downstream fine-tuning does not match pretraining data. Generalization tests include the original configuration, and bar charts lack numeric labels and confidence intervals. e11e12e13e15e16e17
GigaWorld training details are explicitly deferred. Synthetic-data volume, quality cutoffs, IDM accuracy, annotation fractions, full pretraining compute and optimizer settings remain unspecified; the over-50-fold generation-speed claim lacks a detailed timing protocol. e03e04e05e09e10
The dexterous gains and some appearance prose conflict with plots. Figure 15 also captions a mobile box sequence as paper towel preparation. These discrepancies prevent treating every prose assertion as an independently verified result. e11e13e14e15
World-model reinforcement learning, direct policy generation and self-improvement loops are future directions. e19
7.2 Questions for discussion
- Which synthetic-data benefit survives equal-data and equal-compute augmentation controls? [e06, e15, e16]
- Does intermediate trajectory/subgoal supervision improve executed actions independently of the data mixture? [e04, e13]
8. Reproducibility audit
8.1 Requirements and known gaps
A full reproduction needs the proprietary demonstrations, generated corpora, calibration, annotation vocabulary, generator/IDM checkpoints and missing optimization details. For deployment, request action horizon, solver schedule and feedback timing; for Orin, request power mode, input shapes, warmup and software versions. e03e04e05e09e10e18
Reader-proposed checks: compare Real2Real against ordinary visual augmentation at fixed demonstrations and updates; separately ablate trajectory/subgoal supervision with identical data and action expert. Predeclare unseen test conditions, log failures and report seed/trial uncertainty. These checks are proposals, not completed reproductions. e04e06e15e16
8.2 Proposed reproduction checks
The following checks are proposals motivated by the paper. They have not been run as part of this reading.
Check 1: Does generated appearance diversity beat ordinary augmentation?
Reader-proposed, not run: start from the same checkpoint and 50 white-garment demonstrations. Compare real-only training, conventional color/texture augmentation, and Real2Real at alpha=50% and 90%. Match batch 128, 20K updates and the number of sampled examples; track synthesis cost separately. Evaluate a preregistered set of unseen garments, reporting the original white garment separately. Keep task instructions and success criteria identical, repeat training seeds and robot trials, and report failure categories and uncertainty. If Real2Real fails to outperform the matched conventional-augmentation control, the claim that its structured generation provides additional benefit would be weakened, even if both improve on real-only training. e06e10e15
Check 2: Does intermediate supervision improve actions beyond the data mixture?
Reader-proposed, not run: with one fixed bussing dataset and generated-data mixture, train the full policy, a version without trajectory regression, a version without subgoal supervision, and a version without both. Hold the backbone, depth inputs, action expert, discrete-action objective, initialization and update budget constant. Preserve the corresponding token slots to reduce capacity changes, documenting any unavoidable differences. Evaluate held-out layouts with identical action execution settings, measuring success, subtask-order errors and latency across repeated seeds. No reliable degradation after removing these losses would weaken the proposed causal role of embodied intermediate supervision. This check depends on resolving the missing gradient-routing and deployment specifications first. e03e04e05e12e16
8.3 Reading coverage
Visual audit: Visually inspected the title/author/version page and every body page, 1–18, including Figures 1–20, Tables 1–2, Eq. (1), all experimental protocols, on-device configuration statements and future-work boundaries. Inspected all five final original crops. Figure 2 was cross-checked against Section 3 and Eq. (1); detailed attention/gradient routing remains unspecified. Preserved the Figure 10/prose discrepancies, the Figure 17(a) appearance discrepancy, and the Figure 15 caption mismatch in the evidence record. Figure 17 supplies a data-mixture diagnostic; the source contains no separate depth/CoT/insulation ablation. References on pages 19–25 were fully read as supplied text, without visual rendering or opening cited works. No separate supplement was supplied or verified; code and experiments were not inspected or reproduced.
PDF pages inspected for this edition: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18. Appendix coverage: not present.
Original figures and tables remain the work of the source’s authors. Extractions preserve their scientific content; any HTML wrapper layout is disclosed with each figure. The surrounding reading notes are our own.
Text reading scope & known omissions
- Title and Abstract (p. 1)
- 1. Introduction (p. 2)
- 2. Related Works, including 2.1–2.2 (pp. 2–3)
- 3. GigaBrain-0 Model (pp. 3–5)
- 4. GigaBrain-0 Data, including 4.1–4.2 (pp. 5–10)
- 5. Experiment, including 5.1–5.5 (pp. 10–17)
- 6. Conclusion and Future Work (p. 18)
- References (pp. 19–25)
Outside the original text pass
- Text extraction does not reconstruct figure images; inspect the retained PDF for figures and equation/table layout.
- Identity/version: the matching title and all 26 named team members are verified on p. 1 (e01). This report reviews arXiv v3, marked 4 Dec 2025, with a 2025-12-5 header. The catalog submission date is 2025-10-22; earlier editions were not supplied or compared, so their scientific differences remain unknown.
- Text extraction does not reconstruct figure images; the retained PDF was visually inspected on every body page, pp. 1–18, including all figures and tables. References, pp. 19–25, were read as text.
- Separate supplemental material availability has not been fully verified.
- Code, linked projects and cited papers were not inspected; no experiments were reproduced.
The visual audit above records the subsequent illustrated pass.
8.4 Traceable evidence
e01PDF p. 1, title block and arXiv margin
Title matches the catalog. The page credits GigaAI and GigaBrain Team with the same 26 named members as the supplied catalog. The margin states arXiv:2510.19430v3, 4 Dec 2025; the header reads 2025-12-5.
Go to primary source ↓e02PDF pp. 1–2, Abstract, Figure 1 and Section 1
The authors identify expensive, insufficiently diverse physical demonstrations as a bottleneck and propose world-model-generated training data, RGBD perception and embodied CoT.
Go to primary source ↓e03PDF pp. 3–4, Section 3 and Figure 2
PaliGemma2 and a flow-matching action DiT form a mixture of transformers. SigLIP receives zero-initialized additional depth kernels, stays trainable, and uses random depth dropout. Figure 2 labels RGBD, trajectory tokens, prompt, state, discrete actions, action noise and Knowledge Insulation.
Go to primary source ↓e04PDF pp. 4–5, Section 3, Eq. (1) and its definitions
Ten learnable trajectory tokens use non-causal visual attention and a GRU coordinate decoder. Subgoals and discrete actions use autoregressive supervision. The objective combines masked token likelihood, flow matching and trajectory regression with lambda=1. Knowledge Insulation is invoked, but detailed gradient routing and deployment scheduling are not specified.
Go to primary source ↓e05PDF pp. 5–6, Section 4.1, Data Source and Data Annotation & Processing
Public sources are AgiBotWorld, RoboMind and Open X-Embodiment. Proprietary data totals 1182 hours: 199 Agilex Cobot Magic and 983 AgiBot G1. MoGe supplies missing depth; gripper transitions segment subtasks; constrained Qwen-VL-2.5 labels subgoals. End-effector coordinates are projected into the head camera. Annotation coverage is partial; deduplication retains at most 50 demonstrations per unique task.
Go to primary source ↓e06PDF pp. 6–7, Section 4.2, Real2Real Transfer; p. 7, Figure 4
VideoDepthAnything depth and Canny edges condition a diffusion generator through ControlNet. Approximately ten appearance variants are generated per real clip. Figure 4 presents original scenes beside changed colors, textures, lighting and materials; preservation of motion and layout is an author-stated goal.
Go to primary source ↓e07PDF pp. 7–8, Section 4.2, View Transfer and Figure 5
Depth-based reprojection, video inpainting, IK-adjusted joint angles and URDF-rendered structure support view transfer. A differentiable physics step is optional. The images show original/transferred view pairs.
Go to primary source ↓e08PDF pp. 8–10, Section 4.2, Sim2Real Transfer, Human Video Transfer and Figures 6–7
Isaac Sim scenes use EmbodiedGen or ArtVIP assets, URDFs and IK; depth conditions visual transfer. EgoDex hands are masked with SAM2, wrist positions become robot targets, and rendered robot geometry conditions generation. These are synthetic demonstration pipelines, not reported execution tests of every generated trajectory.
Go to primary source ↓e09PDF p. 9, Section 4.2, Video Generation with Inverse Dynamics Modeling and Multiview Video Generation; pp. 11–12, Figures 8–9
Image-and-text-conditioned videos receive inferred robot actions from an IDM for training. Multiview generation concatenates view noise maps. Figures show prompt-dependent futures and multiview examples; IDM architecture, accuracy and full training recipe are not provided here.
Go to primary source ↓e10PDF pp. 9–10, Section 4.2, Generation Efficiency and Generated Data Quality Inspection
NATTEN, single-step distillation and FP8 are said to yield over 50-fold generation acceleration without a detailed timing benchmark. Composite checks cover geometry, multiview consistency, text alignment and physical plausibility; model/training details are deferred to a future GigaWorld report, and score weights and cutoffs are absent.
Go to primary source ↓e11PDF p. 11, Section 5.1, Experiment Setup and Experiment Results
Laundry folding: G1, 300 demonstrations, batch 128, 40K steps. Paper towel preparation: PiPER, 100 demonstrations, batch 128, 20K steps. The official-code pi0 baseline uses matched fine-tuning configurations. Prose assigns gains of 30% and 10% in that order, conflicting with Figure 10.
Go to primary source ↓e12PDF pp. 11–12, Sections 5.2–5.3, Experiment Setup and Experiment Results
Table bussing: PiPER, 100 demonstrations, batch 128, 20K steps; juice preparation: G1, 489 demonstrations, batch 128, 35K steps. Boxes moving: G1, 300 demonstrations, batch 128, 30K steps; laundry baskets moving: PiPER, 378 demonstrations, batch 192, 30K steps. pi0 receives matched fine-tuning. Evaluation counts and uncertainty are not given.
Go to primary source ↓e13PDF p. 13, Figure 10, panels (a)–(f), both bars and legend
Approximate plotted GigaBrain-0/pi0 success percentages are 60/50, 50/20, 90/90, 90/65, 90/80 and 30/20. The axis is labeled percent but ticked 0–1. Bars have no numeric labels or uncertainty; juice preparation is tied.
Go to primary source ↓e14PDF pp. 13–14, Figures 11–16 and captions; pp. 12 and 15, Section 5.3
Deployment montages illustrate folding, towel preparation, bussing, juice preparation and mobile manipulation. Figure 15 shows a G1 mobile box sequence, but its caption says paper towel preparation, inconsistent with the surrounding boxes-moving discussion.
Go to primary source ↓e15PDF pp. 15–16, Section 5.4, Appearance Generalization; p. 15, Figures 17(a) and 18
Folding uses 50 white-garment demonstrations, Real2Real augmentation, 20K steps and batch 128. Ten garments, including the original appearance, receive five trials each. Figure 17(a) rises from about 24% at alpha=0 to about 83% at alpha=90%; alpha=75% is about 75%, despite broader prose describing gains above 80%.
Go to primary source ↓e16PDF p. 16, Section 5.4, Placement Generalization and Figure 19; p. 15, Figure 17(b)
Bussing uses 50 fixed-layout demonstrations plus Sim2Real data, 20K steps and batch 128. Ten layouts include the collected layout, with five trials each. Success is about 25% at alpha=0, 91% at 75%, and 89% at 90%, estimated from bars.
Go to primary source ↓e17PDF p. 16, Section 5.4, Viewpoint Generalization; p. 15, Figure 17(c); p. 17, Figure 20
Bussing uses 50 fixed-view demonstrations plus view transfer, 20K steps and batch 128. Nine views include the collected view, with five trials each. Figure 17(c) rises from about 33% at alpha=0 to about 87% at 90%. Figure 20 displays the tested camera changes.
Go to primary source ↓e18PDF p. 17, Section 5.5 and Table 2, all columns, both model rows
Small uses SmolVLM2 and an approximately 100M-parameter action expert, with memory-transfer, autocast, cached RoPE and compilation optimizations. Both models fine-tune on 1K G1 bussing episodes. On Jetson AGX Orin, Small/pi0 are 840/4400 GFLOPs, 402M/3.2B parameters, 1.9/17.5 GB, 0.13/1.28 seconds, and 80%/80% success. Trial counts and detailed timing configuration are not stated.
Go to primary source ↓e19PDF p. 18, Section 6, Conclusion and Future Work
World models are currently data engines. Interactive reinforcement-learning environments, direct policy generation and iterative policy/world-model improvement are proposed future work, not demonstrated capabilities.
Go to primary source ↓8.5 Primary sources
GigaBrain-0: A World Model-Powered Vision-Language-Action Model ↗
PDF · 9,853 extracted words
Source fingerprint
4673b5d81775b06943f4912f60d7125b79926067c290466e5e4cbdf38a170668