Llama 4 doesn’t meet the expectations of the AI community
A week ago, we talked about the release of Llama 4. Now, the first critical voices are coming from the AI world. And this is justified for several reasons.
The details
- The models are very large (Llama 4 Scout: 109B total parameters, Llama 4 Maverick: 400B total parameters, Llama 4 Behemoth: 2T total parameters).
- Many AI developers have expected smaller models, including us. Similar to Llama 3. These large models are not suitable for many use cases. Maybe smaller models will come, but Meta doesn’t mention it in the blog article about Llama 4.
- In addition, Meta cheated with the results of Llama 4 in the Chatbot Arena. In the Chatbot Arena, people evaluate the results of the chatbots. This results in the ELO score. According to the Chatbot Arena, Llama 4 Maverick achieved a score of 1417. This score is better than GPT-4o. However, this is a special Llama 4 version and not the one that Meta released.
- Meta released Llama 4 on a Saturday, very unusual. The current model size selection suggests that Meta released the model hastily. In addition, a reasoning model is missing. According to Yan LeCun, it comes later.
Our thoughts
We are a fan of the Llama 3 models, especially for local execution. Llama 4 disappointed us because there are no small models. Additionally, according to the license, individuals or companies based in the EU are not allowed to use the multimodal features of Llama 4.
It’s also interesting to know that Meta’s AI chief, Joelle Pineau, is leaving Meta after eight years. Reportedly, there were internal issues with the training of Llama 4.
More information: 🔗 Meta AI | Heise Online | AP News
Magic AI tool of the week
The popular language learning app Duolingo offers video calls with an AI avatar. So, you can talk with an AI avatar in real-time. Duolingo uses the GPT-4o model from OpenAI for this functionality.
Take a look at the following demo video 👇🏽
AI is making its way into the education sector and creating real added value. We use the Duolingo app every day to improve our English skills. The new AI feature is available as a paid subscription.
Hand-picked articles of the week
- Build a Local AI Agent to Chat with Financial Charts Using Agno
- Build a Local RAG App to Chat with Earnings Reports
- Build an OpenAI-Compatible API for Open-Source LLMs from Scratch
😀 Do you enjoy our content? If so, why not support us with a small financial contribution? This helps us fund our work to ensure we can stick around long-term.
