Google unveils open source Gemma 3 model with 128k context window

Mar 12 (edited) • 💬 General

Google has released the latest version of its small model, Gemma, which features expanded context windows, larger parameters and more multimodal reasoning capabilities.

Gemma 3, which has the same processing power as larger Gemini 2.0 models, remains best used by smaller devices like phones and laptops. The new model has four sizes: 1B, 4B, 12B and 27B parameters.

With a larger context window of 128K tokens — by contrast, Gemma 2 had a context window of 80K — Gemma 3 can understand more information and complicated requests. Google updated Gemma 3 to work in 140 languages, analyze images, text and short videos and support function calling to automate tasks and agentic workflows.

https://venturebeat.com/ai/google-unveils-open-source-gemma-3-model-with-128k-context-window/

https://blog.google/technology/developers/gemma-3/

4 comments