Blair-Stanek, Andrew; Carstens, Anne-Marie; Goldberg, … - 2023
GPT-4 performs vastly better than ChatGPT or GPT-3.5 on legal tasks like the bar exam and statutory reasoning. To test GPT-4’s abilities, we ran it on our final exams this semester and graded its output alongside students’ exams. We found that it produced smoothly written answers that failed...