METHODOLOGIE

GDPval

A benchmark measuring AI models on expert-level professional tasks across fields such as finance, law, retail, and software, graded blind by specialists with years of experience. Reported scores reach 40-49% of expert level but require extensive human framing, so the metric itself is seen as under-specified.

definition

Expert tasks benchmark — models reach 40-49% of human expert level, but require *extensive human framing* — the metric itself is underspecified

method

Experts with 14 years of experience, blind evaluation

scope

Finance, law, retail, software development

Fiches (2)