Jumbled-up sentences show that AIs still don’t really understand language
By Will Douglas Heaven,
MIT Technology Review
| 01. 12. 2021
Many AIs that appear to understand language and that score better than humans on a common set of comprehension tasks don’t notice when the words in a sentence are jumbled up, which shows that they don’t really understand language at all. The problem lies in the way natural-language processing (NLP) systems are trained; it also points to a way to make them better.
Researchers at Auburn University in Alabama and Adobe Research discovered the flaw when they tried to get an NLP system to generate explanations for its behavior, such as why it claimed different sentences meant the same thing. When they tested their approach, they realized that shuffling words in a sentence made no difference to the explanations. “This is a general problem to all NLP models,” says Anh Nguyen at Auburn University, who led the work.
The team looked at several state-of-the-art NLP systems based on BERT (a language model developed by Google that underpins many of the latest systems, including GPT-3). All of these systems score better than humans on GLUE (General Language Understanding Evaluation)...
Related Articles
By Jonathan Matthews, GMWatch | 12.11.2025
In our first article in this series, we investigated the dark PR tactics that have accompanied Colossal Bioscience’s de-extinction disinformation campaign, in which transgenic cloned grey wolves have been showcased to the world as resurrected dire wolves – a...
By Jenny Lange, BioNews | 12.01.2025
A UK toddler with a rare genetic condition was the first person to receive a new gene therapy that appears to halt disease progression.
Oliver, now three years old, has Hunter syndrome, an inherited genetic disorder that leads to physical...
By Simar Bajaj, The New York Times | 11.27.2025
A common cold was enough to kill Cora Oakley.
Born in Morristown, N.J., with virtually no immune system, Cora was diagnosed with severe combined immunodeficiency, a rare genetic condition that leaves the body without key white blood cells.
It’s better...
By Rachel Hall, The Guardian | 11.30.2025
Couples are needlessly going through IVF because male infertility is under-researched, with the NHS too often failing to diagnose treatable causes, leading experts have said.
Poor understanding among GPs and a lack of specialists and NHS testing means male infertility...
