View metadata
| dc.title | Documenting Differences Between Humans and AI in High-Stakes Decisions: A Labor Market Turing Test |
| dc.contributor.author | Abril Arteaga, Andres Sebastian |
| dc.contributor.author | Rangel, Marcos |
| dc.contributor.author | Zanoni, Wladimir |
| dc.contributor.orgunit | Country Department Andean Group |
| dc.coverage | Ecuador |
| dc.date.available | 2025-09-29T00:09:00 |
| dc.date.issue | 2025-09-29T00:09:00 |
| dc.description.abstract | We developed a Labor Market Turing Test (LMTT) to measure human-AI decision alignment using data from 277 human recruiters engaged in a field experiment set in Quito, Ecuador. We augmented the pool of recruiters by creating AI teams, each of which with differing impersonation of human-like traits, and compared their choices to humans and a benchmark AI model. While AI teams were more consistent, they selected candidates with a pattern that markedly different from human choices. In fact, random decisions mir- rored human choices more closely than our most human-like AI agents. These findings reveal a fundamental tension between algorithmic consistency and human judgment. That humans were closer to a random process when com- paring candidates with equal productivity might be seen as a fairer outcome. Our LMTT framework, which involves isolating and estimating a machina la- tent trait, provides a quantitative tool for assessing human-AI alignment which can be employed across critical domains, such as healthcare, justice, and edu- cation, thereby informing the design and AI governance. |
| dc.format.extent | 53 |
| dc.identifier.doi | http://dx.doi.org/10.18235/0013729 |
| dc.identifier.url | https://publications.iadb.org/publications/english/document/Documenting-Differences-Between-Humans-and-AI-in-High-Stakes-Decisions-A-Labor-Market-Turing-Test.pdf |
| dc.language.iso | en |
| dc.publisher | Inter-American Development Bank |
| dc.subject | Artificial Intelligence |
| dc.subject | Labor Market |
| dc.subject | Population Aging |
| dc.subject | Higher Education |
| dc.subject | Migrant |
| dc.subject | Women |
| dc.subject | Knowledge |
| dc.subject.jelcode | J71 - Discrimination |
| dc.subject.jelcode | M51 - Firm Employment Decisions • Promotions |
| dc.subject.jelcode | C91 - Laboratory, Individual Behavior |
| dc.subject.keywords | Algorithmic Fairness;Human-AI Alignment;Latent Trait Analysis |
| dc.type | Working Papers |
| idb.identifier.pubnumber | IDB-WP-01740 |
| idb.operation | RG-T4369 |