GPT-3 is very good at memorizing facts and stringing words together. But once you zero-in on its flaws, the illusion of understanding falls apart.
Kevin Lacker gives GPT-3 the Turing Test:
Q: How many eyes does a blade of grass have?
A: A blade of grass has one eye.