Trillions of parameters

Maria Deutscher, writing for Silicon Angle:

Microsoft Corp. has released a new version of its open-source DeepSpeed tool that it says will enable the creation of deep learning models with a trillion parameters, more than five times as many as in the world’s current largest model.

Microsoft AI tool enables ‘extremely large’ models with a trillion parameters

That’s a lot of transformations. If there’s a pattern, a trillion parameters should be able to find and store it.