Aristo, an AI developed by the Allen Institute for Artificial Intelligence, passed an eighth-grade science test with a score of 90%. They used BERT.
At Google, researchers built a system called Bert that combed through thousands of Wikipedia articles and a vast digital library of romance novels, science fiction and other self-published books.
Through analyzing all that text, Bert learned how to guess the missing word in a sentence. By learning that one skill, Bert soaked up enormous amounts of information about the fundamental ways language is constructed. And researchers could apply that knowledge to other tasks.
The Allen Institute built their Aristo system on top of the Bert technology. They fed Bert a wide range of questions and answers. In time, it learned to answer similar questions on its own.
A Breakthrough for A.I. Technology: Passing an 8th-Grade Science Test