So starts a great article on DNN’s and learning shortcuts:
Recently, researchers trained a deep neural network to classify breast cancer, achieving a performance of 85%. When used in combination with three other neural network models, the resulting ensemble method reached an outstanding 99% classification accuracy, rivaling expert radiologists with years of training.
The result described above is true, with one little twist: instead of using state-of-the-art artificial deep neural networks, researchers trained “natural” neural networks – more precisely, a flock of four pigeons – to diagnose breast cancer.
Shortcuts: How Neural Networks Love to Cheat
Sometimes the learning is clever; sometimes the learning is a problem. Mostly though, it’s hard to make sure an AI learns what you want it to learn.