“We proceed to see hyperscaling of AI models leading to greater efficiency, with seemingly no close in sight,” a pair of Microsoft scientists wrote in Oct in the weblog write-up announcing the company’s substantial Megatron-Turing NLG model, built-in collaboration with Nvidia.8MB of SRAM, the Apollo4 has over enough compute and storage to ha