Can artificial intelligence (AI) augment human legal reasoning?
To find out, we designed a novel experiment administering law school
exams to students with and without access to GPT-4, the best-performing
AI model currently available. We found that assistance from GPT-4
significantly enhanced performance on simple multiple-choice questions
but not on complex essay questions.