The Llama 4 series is the first to use a “mixture of experts (MoE) architecture,” where only a few parts of the neural network, the “experts,” are used to respond to an input.

Meta has debuted the first two models in its Llama 4 family, its first to use mixture of experts tech. A Saturday post from the social media giant announced the release of two models:

Meta unveiled its latest family of generative AI model on Saturday. You can give the Llama 4 models a test drive now through Meta AI's website, and Llama 4 will soon power the many Meta AI features on the company's Instagram,