Maria Deutscher, writing for Silicon Angle:
Microsoft Corp. has released a new version of its open-source DeepSpeed tool that it says will enable the creation of deep learning models with a trillion parameters, more than five times as many as in the world’s current largest model.
Microsoft AI tool enables ‘extremely large’ models with a trillion parameters
That’s a lot of transformations. If there’s a pattern, a trillion parameters should be able to find and store it.