Skip to content
Methodology

GDPval

GDPval — Methodology. definition: Expert tasks benchmark — models reach 40-49% of human expert level, but require *extensive human framing* — the metric itself is underspecified · method: Experts with 14 years of experience, blind evaluation · scope: Finance, law, retail, software development

Type
Methodology
definition
Expert tasks benchmark — models reach 40-49% of human expert level, but require *extensive human framing* — the metric itself is underspecified
method
Experts with 14 years of experience, blind evaluation
scope
Finance, law, retail, software development
relations
5
Cited in
2 fiches

Adoption measures

Neighborhood

44 occupations humai… Jagged Frontier des …

→ measures

44 occupations humaines CONCEPT high confidence stable Source ↗
Jagged Frontier des capacités IA CONCEPT high confidence stable Source ↗

Cited in (2)