Meta Llama 3.1 405B - The Most Sophisticated Open Source Model

5 minute read

More topics: More topics: Mistral AI releases Mistral Large 2, and OpenAI tests AI search engine SearchGPT

Magic AI News

Hi AI Enthusiasts,

Welcome to this week’s Magic AI News, where we present you the most exciting AI news of the week. This week was BIG of open-source AI. We have organized the top news for you!

This week’s Magic AI tool is perfect for online writers and productivity junkies. Imagine you can organize all your work in a single app! And best of all, you have an AI assistant at your side. Stay curious! 😎

Let’s explore this week’s AI news together. 👇🏽


Top AI news of the week

🤖 Meta Llama 3.1 405B: The Most Sophisticated Open Source Model

Meta continues its open-source AI strategy and released Llama 3.1 as open-source with 8B, 70B, and 405B parameters! According to Meta, Llama 3.1 can compete with GPT-4o in various tests but is significantly cheaper.

The details:

  • The new models have a context length of 128K tokens and support eight languages.
  • Llama 3.1 405B can compete with the best closed-source models.
  • According to Meta, Llama 3.1 405B is the world’s largest and most capable openly available foundation model.
  • Available via HuggingFace and various cloud providers.

According to Meta, the Llama 3.1 405B model outperforms state-of-the-art models like GPT-4o in several benchmarks.

Benchmark results Llama 3.1 405B (Image by Meta AI)
Benchmark results Llama 3.1 405B (Image by Meta AI)

Our thoughts

The release of Llama 3.1 is a big moment for the open-source AI community. Llama 3.1 405B is the first-ever open-source frontier large language model (LLM). Now, developers worldwide can access a comparable model to the best closed-source models!

Thanks to the open-source approach, the model can be further developed and become an industry standard. And that’s exactly what Meta and Mark Zuckerberg want! In addition, an open-source approach enables more secure development of AI than closed-source approaches.

More information

👩🏽‍💻 Large Enough: Mistral AI releases Mistral Large 2

Mistral AI launched its new flagship LLM “Large 2” just one day after Meta’s Llama 3.1. According to Mistral, Large 2 will set new standards in terms of cost efficiency, speed, and performance.

The details:

  • Large 2 is a model with 123B parameters. It has a context window of 128K tokens.
  • It supports 12 languages and 80 coding languages.
  • Large 2 outperforms Meta’s Llama 3.1 405B in code generation and math.
  • The model is available on major cloud providers, and Le Chat.

Our thoughts

With Meta’s Llama 3.1 and Mistral’s Large 2, there are now two open-source models that are competitive with GPT-4! The pressure on providers such as OpenAI and Google is now increasing!

Why should companies pay for closed-source models when they can run comparable open-source models much more cheaply on their own infrastructure? We think this was a BIG week for open-source AI! Very impressive what Meta and Mistral have delivered!

✍🏽 What is your opinion on the open-source developments in large language models?

More information

💭 OpenAI tests AI search engine SearchGPT

This week, OpenAI released a prototype of an AI-powered search engine, called SearchGPT. SearchGPT combines the power of AI models with real-time information from the internet to provide users with an appropriate answer! It is a competitor to Google Search.

A small group currently has access to SearchGPT. In addition, OpenAI plans to integrate SearchGPT into a future version of ChatGPT! If you want to try the new way to search, you can sign up for the waitlist (ChatGPT account is required!).

Our thoughts

In our opinion, AI models in search engines are the future! Let us show you why we think so! AI models are great for finding relevant information in large datasets. This strength can be used in search engines!

In addition, you can ask follow-up questions! It’s like a conversation with a real person! We think this makes the search more intuitive! However, it will be difficult for OpenAI to compete with Google Search, as Google is working on similar functions!

We also have written an article about how language models can improve keyword search! If you’re interested in this topic, check it out.

More information


Hand-picked AI tool list


Magic AI tool of the week

This week’s Magic AI tool is Notion AI*, which can simplify your workflows with AI. It is a feature of Notion* that helps you write and create content using artificial intelligence (AI). AI can support you with several tasks:

  • Generate from page: In this category, you will find, for example, functions for summarizing or translating texts.

  • Edit or review page: The features of this category help you to improve your writing. For example: Fix spelling and grammar, change tone, or simplify your language.

  • Draft with AI: The AI can help you to write Social Media. This is a game changer in content creation.

  • Insert AI blocks: You can also insert AI blocks. AI blocks are predefined instructions that you can execute later. These blocks are useful for Notion templates.

AI features of Notion (GIF by authors)
AI features of Notion (GIF by authors)

👉🏽 Try Notion AI today to take your productivity to the next level!*


Articles of the week


💡 Do you enjoy our content and want to read super-detailed articles about AI? If so, subscribe to our blog and get our popular data science cheat sheets for FREE.


Thanks for reading, and see you next time.

- Tinz Twins

Leave a comment