repo-context-ambiguity Benchmark

What is repo-context-ambiguity?

Measures whether code generation models violate implicit repository conventions, using automatic AST oracles for constraint and security violations.

Released

2026-08-23

Evaluates

Language & Knowledge, Software & AI Compute, cs.AI

Openness

unknown

Importer

Claire Radar

Review status

ai-name-audit-deferred

Reported scores

0

Source provenance

• Original evidence https://github.com/Parfait18/repo-context-ambiguity

repo-context-ambiguity code

• Code https://github.com/Parfait18/repo-context-ambiguity

Which sources cite repo-context-ambiguity?

• repo-context-ambiguity

Related Language & Knowledge, Software & AI Compute, cs.AI benchmarks

• 5-Dialects-BN
• A Large-Scale Dataset and Benchmark
• AARRI-Bench
• ABC-Bench
• Active-SWE
• ActiveSciBench
• AdaMem-Bench
• AdvancedMathBench