Jumbled-up sentences show that AIs still don’t really understand language
By Will Douglas Heaven,
MIT Technology Review
| 01. 12. 2021
Many AIs that appear to understand language and that score better than humans on a common set of comprehension tasks don’t notice when the words in a sentence are jumbled up, which shows that they don’t really understand language at all. The problem lies in the way natural-language processing (NLP) systems are trained; it also points to a way to make them better.
Researchers at Auburn University in Alabama and Adobe Research discovered the flaw when they tried to get an NLP system to generate explanations for its behavior, such as why it claimed different sentences meant the same thing. When they tested their approach, they realized that shuffling words in a sentence made no difference to the explanations. “This is a general problem to all NLP models,” says Anh Nguyen at Auburn University, who led the work.
The team looked at several state-of-the-art NLP systems based on BERT (a language model developed by Google that underpins many of the latest systems, including GPT-3). All of these systems score better than humans on GLUE (General Language Understanding Evaluation)...
Related Articles
GeneWatch UK has prepared a briefing on the genetic modification of nature for the International Union for Conservation of Nature (IUCN) Congress in October 2025
The upcoming Congress claims to be “where the world comes together to set priorities and drive conservation and sustainable development action.” A major concern for those on the outside is that the Congress may advance plans to develop and encourage the use of synthetic biology in nature conservation. This could at first glance sound like...
By Aaron Ginn, The Washington Post | 09.12.2025
Earlier this year, I had dinner in D.C. with Jensen Huang, the president and chief executive of Nvidia. At one point, he said something that struck me: “Why is everyone here so negative?”
He wasn’t referring to the economy...
By Roni Caryn Rabin, The New York Times | 08.25.2025
Scientists have dreamed for centuries about using animal organs to treat ailing humans. In recent years, those efforts have begun to bear fruit: Researchers have begun transplanting the hearts and kidneys of genetically modified pigs into patients, with varying degrees...
The Center for Genetics and Society is delighted to recommend the current edition of GMWatch Review – Number 589. UK-based GMWatch, a long-standing ally, was founded in 1998 by Jonathan Matthews as an independent organization seeking to counter the enormous corporate political power and propaganda of the GMO industry and its supporters. Matthews and Claire Robinson are its directors and managing editors.
CGS works to ensure that social justice, equity, human rights, and democratic governance are front...
