ORCA Benchmark

What is ORCA?

Evaluates LLMs on data science code translation across curated tasks and project-level translations. Benchmark Radar tracks ORCA, cited by 1 source documents…

Released

2026-09-25

Evaluates

General AI, Robot manipulation, Robotics, Robotics & Embodied AI

Openness

unknown

Importer

Claire Radar

Review status

ai-name-audit-deferred

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2609.30749

ORCA paper

• Paper https://arxiv.org/abs/2609.30749

Which sources cite ORCA?

• ORCA

Related General AI, Robot manipulation, Robotics, Robotics & Embodied AI benchmarks

• $\tau^\tau$-Bench: An Environment for End-To-End, Realistic Agent Construction
• 2d-fet-bench
• 360CityArena
• 3DCodeBench
• 4DSynth-Nav
• 5-Dialects-BN
• A Real-World CAD Segmentation Benchmark
• A3S-Bench