Google says it's found a sweet spot between power and efficiency by employing the 'distillation' of neural nets.

Google has introduced Gemma 3, a collection of lightweight, state-of-the-art open models built from the same research and technology that powers our Gemini 2.0 models

Dubbed the “world’s best single-accelerator model” to date, Gemma 3 joins the Gemmaverse as Google’s latest open model to be released to the public.