Gemma 3 - An AI model that can run on a single GPU

Google has introduced the next generation of its open-source models called Gemma 3. It is a family of lightweight open models built with the same technology that powers Gemini 2.0 models.

Image with the writing Gemma 3
Generated with Grok

The detailsPermalink

  • According to Google, the new models are designed to run fast (on just a single GPU or TPU) and directly on devices like phones, laptops, and workstations. Gemma 3 comes in four sizes (1B, 4B, 12B, and 27B parameters).
  • In addition, Gemma 3 has a 128K token context window and supports 140 languages. It also offers multimodal abilities like analyzing images and videos.
  • Gemma 3 also supports function calling and structured output. This way, you can use Gemma 3 efficiently in multi-agent workflows. If you are interested in building multi-agent systems, we recommend reading our introduction article about AG2.
  • Alongside Gemma 3, Google also launched ShieldGemma 2, a powerful 4B image safety checker. ShieldGemma 2 can identify images with safety concerns. It categorizes images into three groups: dangerous content, sexually explicit, and violent.

Our thoughts

Gemma 3 is another powerful open-source model for local use and you can run it on a single GPU! It is fast and multimodal, making it ideal for AI developers worldwide. We are excited to see the AI applications developers will create with this model.

In addition, ShieldGemma 2 is very helpful for responsible AI application development.

More information: 🔗 Google Blog | HuggingFace | Ollama


Magic AI toolPermalink

Today, it is essential to work in a structured and organized way. There are many tools that you can use to increase your productivity at work. However, finding the right tool for your needs can be overwhelming.

One of the best tools we have ever used is Notion in combination with its comprehensive AI features. Notion combines the functions of a note-taking app, a document editor, a project management tool, and an AI assistance.

Notion AI can help you to complete your tasks faster and more efficiently. This tool can boost your productivity from day one!

👉🏽 Try Notion for free!*


Hand-picked articlesPermalink


😀 Do you enjoy our content? If so, why not support us with a small financial contribution? This helps us fund our work to ensure we can stick around long-term.