Issues

• load_env does not expose the composer seed for reproducible random-init scenes

  OpenMOSS/VLABench#91 · Filter by author kiwi142857 opened on Sep 19, 2026

• select_mahjong and select_painting instructions disagree with their success checkers and expert actions

  OpenMOSS/VLABench#90 · Filter by author kiwi142857 opened on Sep 19, 2026

• get_ee_open_state returns a closed-state predicate; published state preserves legacy polarity

  OpenMOSS/VLABench#88 · Filter by author sawhney17 opened on Aug 10, 2026

• can not generate episode in many task

  OpenMOSS/VLABench#87 · Filter by author robosciyzq opened on Apr 23, 2026

• Unable to generate trajectories of some tasks under physical series

  OpenMOSS/VLABench#86 · Filter by author andreazhangyh opened on Mar 19, 2026

• VLABench evaluation with GR00T policy

  OpenMOSS/VLABench#85 · Filter by author ryuji-oi-artic opened on Mar 11, 2026

• each episodes faild when pi05_ft_vlabench_primitive

  OpenMOSS/VLABench#84 · Filter by author JuilieZ opened on Feb 15, 2026

• Jupyter notebook Kernel Died

  OpenMOSS/VLABench#83 · Filter by author Yixun-Hu opened on Feb 10, 2026

• The evaluation code has serious issues

  OpenMOSS/VLABench#82 · Filter by author nansun5410 opened on Feb 4, 2026

• Reproduce results pi0-primitive-10task

  OpenMOSS/VLABench#81 · Filter by author zehao-wang opened on Jan 28, 2026

• Potential discrepancy in action execution: Robot moves despite action being set to current ee_state

  OpenMOSS/VLABench#80 · Filter by author Likeooo opened on Jan 9, 2026

• README evaluate openpi link directs to 404

  OpenMOSS/VLABench#79 · Filter by author YunOh21 opened on Dec 30, 2025

• Bug Report: ”total_score“ calculation ignores partial metrics in ”get_final_score“

  OpenMOSS/VLABench#77 · Filter by author Evan-Joseph opened on Dec 6, 2025

• how to evaluate pi0-fast-ft-primitive-10task-deltachunk ckpt

  OpenMOSS/VLABench#76 · Filter by author hemin0806 opened on Dec 2, 2025
  1

• PDDL file writing issues for scenarios

  OpenMOSS/VLABench#75 · Filter by author Xj1567589354 opened on Nov 21, 2025

• How to evaluate other VLA model in VLABench?

  OpenMOSS/VLABench#74 · Filter by author Saberlve opened on Nov 15, 2025

• Data generation ends early

  OpenMOSS/VLABench#73 · Filter by author YuxuanJIANG123 opened on Nov 12, 2025

• Discrepancy Between State and Action in Dataset (i+1’th state != i’th action)

  OpenMOSS/VLABench#70 · Filter by author Leesangoh opened on Oct 12, 2025
  1

• Inquiry about the release timeline for VLABench evaluation pipeline

  OpenMOSS/VLABench#69 · Filter by author daoshi1593 opened on Oct 4, 2025
  1

• Plans to support additional robots (e.g., Hello Robot Stretch)?

  OpenMOSS/VLABench#68 · Filter by author shinmohuang opened on Sep 13, 2025
  1

• questions about the lora checkpoint of openvla

  OpenMOSS/VLABench#67 · Filter by author yanan1116 opened on Sep 8, 2025
  2

• about the results of Interactive Evaluation

  OpenMOSS/VLABench#65 · Filter by author yanan1116 opened on Sep 3, 2025
  1

• The version of lerobot

  OpenMOSS/VLABench#64 · Filter by author xiaokang-99 opened on Aug 31, 2025
  3

• Data reading issues caused by code version changes

  OpenMOSS/VLABench#63 · Filter by author Doo-mon opened on Aug 28, 2025
  1

• Integrate CLIP-RT policy into VLABench

  OpenMOSS/VLABench#62 · Filter by author Dimitar1809 opened on Aug 13, 2025
  1