A new study, conducted by legal AI platform LawGeex in consultation with law professors from Stanford University, Duke University Schoo...
A new study, conducted by legal AI platform LawGeex in consultation with law professors from Stanford University, Duke University School of Law, and University of Southern California, pitted twenty experienced lawyers against an AI trained to evaluate legal contracts.
Competitors were given four hours to review five non-disclosure agreements (NDAs) and identify 30 legal issues, including arbitration, confidentiality of relationship, and indemnification. They were scored by how accurately they identified each issue.
Unfortunately for humanity, we lost the competition — badly.
The human lawyers achieved, on average, an 85 percent accuracy rate, while the AI achieved 95 percent accuracy. The artificial intelligence also completed the task in 26 minutes, while the human lawyers took 92 minutes on average. The AI also achieved 100 percent accuracy in one contract, on which the highest-scoring human lawyer scored only 97 percent. In short, the human lawyers were trounced.
Intellectual property attorney Grant Gulovsen, one of the lawyers who competed against the AI in the study, said the task was very similar to what many lawyers do every day.
“The majority of documents, whether it’s wills, operating agreements for corporations, or things like NDAs…they’re very similar,” Gulovsen told Mashable in a phone interview.
So does this spell the end of humanity? Not at all. On the contrary, the use of AI can actually help lawyers expedite their work, and free them up to focus on tasks that still require a human brain.
