Official repo of VLABench, a large scale benchmark designed for fairly evaluating VLA, Embodied Agent, and VLMs.
Python · active 2025-02-19 → 2026-05-25 (UTC)
Activity over time
Daily event counts in the loaded window
Line chart, 461 days from 2025-02-19 to 2026-05-25. Pushes: 27 total, peak 4 in a day. Pull requests: 11 total, peak 5 in a day. Issues: 59 total, peak 7 in a day. Comments: 57 total, peak 10 in a day. Stars: 131 total, peak 7 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| Shiduo-zh | 71 | 17 | 8 | 28 |
| jingjing-gong | 6 | 6 | 0 | 0 |
| XilunZhangRobo | 6 | 0 | 0 | 2 |
| Facebear-ljx | 5 | 0 | 0 | 2 |
| SiHhangChen | 5 | 0 | 0 | 5 |
| LukeLIN-web | 4 | 0 | 0 | 0 |
| Phospheneser | 4 | 4 | 0 | 0 |
| Jiang-Yuxuan123 | 4 | 0 | 0 | 1 |
| JYounngS | 4 | 0 | 0 | 2 |
| langxinspieder | 4 | 0 | 0 | 1 |
| PKU-ShanYachun | 3 | 0 | 0 | 1 |
| 4078730 | 3 | 0 | 0 | 1 |
| YunOh21 | 2 | 0 | 0 | 1 |
| ailuropodaWu | 2 | 0 | 2 | 0 |
| EmbodiedAI-Group | 2 | 0 | 0 | 0 |
| Rubiksman78 | 2 | 0 | 0 | 2 |
| lzl2040 | 2 | 0 | 0 | 1 |
| 8leooel8 | 2 | 0 | 0 | 2 |
| abliao | 2 | 0 | 0 | 0 |
| zhiying318 | 1 | 0 | 0 | 0 |
Recent activity
Latest issues, pull requests and releases
- Issue#87robosciyzq2026-04-23 06:05can not generate episode in many task
- Issue#84JuilieZ2026-02-15 15:18each episodes faild when pi05_ft_vlabench_primitive
- Issue comment#78YunOh212026-01-18 11:13How to know specific prompt used for results video
- Issue comment#19nansun54102026-01-12 11:55Abs EEF Action Space or Abs Joint Action Space
- Issue#78YunOh212025-12-28 17:00How to know specific prompt used for results video
- Issue#76hemin08062025-12-02 05:23how to evaluate pi0-fast-ft-primitive-10task-deltachunk ckpt
- Issue#75Xj15675893542025-11-21 01:45PDDL file writing issues for scenarios
- Issue#74Saberlve2025-11-15 09:27How to evaluate other VLA model in VLABench?
- Issue#73Jiang-Yuxuan1232025-11-12 07:46Data generation ends early
- Issue#73Jiang-Yuxuan1232025-11-12 07:38Data generation ends early
- Issue#73Jiang-Yuxuan1232025-11-12 07:35Data generation ends early
- Issue comment#56Shiduo-zh2025-11-11 03:48The task video result is only one frame
- Issue#44Shiduo-zh2025-11-11 03:41Question about evaluating models like VoxPoser and CoPa in VLABench
- Issue comment#26Shiduo-zh2025-11-11 03:40Experimental reproduction of Table 2
- Issue#24Shiduo-zh2025-11-11 03:39pi0 inference in VLABench's mujoco environment
- Issue comment#24Shiduo-zh2025-11-11 03:38pi0 inference in VLABench's mujoco environment
- Issue#22Shiduo-zh2025-11-11 03:37Six Benchmark results
- Issue comment#69Shiduo-zh2025-11-11 03:36Inquiry about the release timeline for VLABench evaluation pipeline
- Issue#66Shiduo-zh2025-11-11 03:33About Task Generation
- Issue comment#66Shiduo-zh2025-11-11 03:33About Task Generation
- Issue comment#55Shiduo-zh2025-11-11 03:30Question about the implementation of progress score
- Issue comment#65Shiduo-zh2025-11-11 03:26about the results of Interactive Evaluation
- Issue comment#62Shiduo-zh2025-11-11 03:23Integrate CLIP-RT policy into VLABench
- Issue comment#67Shiduo-zh2025-11-11 03:21questions about the lora checkpoint of openvla
- Issue comment#49Jiang-Yuxuan1232025-11-11 01:44environment incompatibility issue
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 131 stars here means stars gained during the window, not the repo's star count.