Gemma 4 26B-A4B
Gemma 4 26B-A4B is Google DeepMind's Mixture-of-Experts multimodal model with 26 billion total parameters and 3.8 billion activated parameters per token, with a 256K context window. Ranks #6 among open models on Arena AI, outcompeting models 20x its size. Achieves an estimated LMArena text score of 1441. Supports image and text inputs.
Context 256K