Jumbled-up sentences show that AIs still don’t really understand language
By Will Douglas Heaven,
MIT Technology Review
| 01. 12. 2021
Many AIs that appear to understand language and that score better than humans on a common set of comprehension tasks don’t notice when the words in a sentence are jumbled up, which shows that they don’t really understand language at all. The problem lies in the way natural-language processing (NLP) systems are trained; it also points to a way to make them better.
Researchers at Auburn University in Alabama and Adobe Research discovered the flaw when they tried to get an NLP system to generate explanations for its behavior, such as why it claimed different sentences meant the same thing. When they tested their approach, they realized that shuffling words in a sentence made no difference to the explanations. “This is a general problem to all NLP models,” says Anh Nguyen at Auburn University, who led the work.
The team looked at several state-of-the-art NLP systems based on BERT (a language model developed by Google that underpins many of the latest systems, including GPT-3). All of these systems score better than humans on GLUE (General Language Understanding Evaluation)...
Related Articles
By Tristan Manalac, BioSpace | 04.02.2024
Verve Therapeutics has suspended enrollment in the Phase Ib Heart-1 study evaluating its lead gene editing program VERVE-101 following a serious adverse event, the company announced Tuesday.
A patient, who received a 0.45-mg/kg dose of VERVE-101, developed a grade 3...
By Timnit Gebru and Émile P. Torres, First Monday | 04.14.2024
The stated goal of many organizations in the field of artificial intelligence (AI) is to develop artificial general intelligence (AGI), an imagined system with more intelligence than anything we have ever seen. Without seriously questioning whether such a system can...
By Harold Brubaker, The Philadelphia Inquirer | 04.04.2024
Acompany started by University of Pennsylvania scientist Jim Wilson has received FDA approval to test a form of gene editing in infants for the first time in the United States, the company said Thursday.
The Plymouth Meeting company, iECURE, is...
By Judith Levine, The Intercept | 04.04.2024
WHEN THE ALABAMA Supreme Court ruled that fertilized embryos were “extrauterine children,” it did more than imperil the future of in vitro fertilization in Alabama and, potentially, the U.S. The ruling, on the claimed “wrongful death” of frozen embryos...