Issues

• [BENCHMARK BUG] A 200 error reply drops the scenario from the viewer pass rate

  facebookresearch/meta-agents-research-environments#119 · Filter by author swf1996120 opened on Oct 30, 2026

• External submissions to the Gaia2 leaderboard — custom (non-OpenClaw) harness + GLM-5.3-Flash

  facebookresearch/meta-agents-research-environments#118 · Filter by author Aeolion-mu opened on Oct 28, 2026

• Optional host-side signed ACTION gate/attest for agent tool execution

  facebookresearch/meta-agents-research-environments#107 · Filter by author AffixIO opened on Sep 18, 2026

• Interop: export ScenarioValidationResult as EvalPort resultset.json (results-side only)

  facebookresearch/meta-agents-research-environments#105 · Filter by author adhabnr-ux opened on Aug 23, 2026

• No multi-turn user interactions observed in Gaia2 HF traces

  facebookresearch/meta-agents-research-environments#83 · Filter by author cyche23 opened on Jun 16, 2026

• Dependencies prevent usage of library

  facebookresearch/meta-agents-research-environments#33 · Filter by author cemde opened on Feb 5, 2026

• Question : How much time does the --config mini take with local vllm?

  facebookresearch/meta-agents-research-environments#32 · Filter by author Shivansh-1234 opened on Feb 4, 2026
  1

• Bug: Case-sensitive parsing in LLMChecker causes 100% failure rate with gpt-5-mini judge

  facebookresearch/meta-agents-research-environments#29 · Filter by author bhavishya-pohani opened on Dec 22, 2025
  3

• [BENCHMARK BUG] Gaia2: Gemini‑2.5‑Pro scores far below paper

  bug
  facebookresearch/meta-agents-research-environments#25 · Filter by author tshu-w opened on Nov 10, 2025

• [BUG] Output.jsonl does not match benchmark_stats.json

  facebookresearch/meta-agents-research-environments#21 · Filter by author bhavishya-pohani opened on Oct 24, 2025

• [BUG] Check model availability before running benchmark

  facebookresearch/meta-agents-research-environments#20 · Filter by author bhavishya-pohani opened on Oct 24, 2025
  3

• [API BUG]

  bug
  facebookresearch/meta-agents-research-environments#19 · Filter by author bhavishya-pohani opened on Oct 22, 2025
  4

• Runs too slow

  facebookresearch/meta-agents-research-environments#18 · Filter by author bhavishya-pohani opened on Oct 21, 2025
  1

• [UI BUG] When I tried to build docker image，it report error.

  bug
  facebookresearch/meta-agents-research-environments#16 · Filter by author WilliamRocketRen opened on Oct 21, 2025

• Environment Events Not Triggering in scenario_universe_23_tbrkm7

  bug
  facebookresearch/meta-agents-research-environments#14 · Filter by author ROGERDJQ opened on Oct 15, 2025

• [BENCHMARK BUG] Failed to load dataset

  bug
  facebookresearch/meta-agents-research-environments#12 · Filter by author mabuyun opened on Oct 10, 2025

• [BENCHMARK BUG] The configured endpoint is not taking effect.

  bug
  facebookresearch/meta-agents-research-environments#11 · Filter by author mabuyun opened on Oct 10, 2025

• Convert scenario to json.

  facebookresearch/meta-agents-research-environments#9 · Filter by author krish240574 opened on Oct 5, 2025
  1

• FEATURE: Support alternative agent scaffolds

  facebookresearch/meta-agents-research-environments#1 · Filter by author pseudotensor opened on Sep 23, 2025
  6