Article complete

Meta Set to Release Two Small Versions of Llama 3 Next Week

It is speculated that the largest version of Llama 3 could exceed 140 billion parameters

A white alpaca against a pink background with a blue Meta logo design behind it.

Key takeaways

  • Meta will release two smaller versions of Llama 3 next week as a precursor to the largest model.
  • The biggest version of Llama 3 is expected to exceed 140 billion parameters and be multimodal.
  • Smaller models are favored for their cost-effectiveness and faster processing speeds in AI applications.
  • Meta's Llama 3 aims to compete with OpenAI’s GPT-4 and other emerging open-source LLMs.
  • Llama 2's previous variants ranged from 7 billion to 70 billion parameters, informing future model designs.

Takeaways drafted with AI from the article text.

The release of these smaller models is aimed at generating excitement for the forthcoming Llama 3, which is scheduled to debut roughly a year after Llama 2 was launched last July. This move comes as several companies, including Google, Elon Musk’s xAI, Databricks and Mistral, have already introduced open-source LLMs. 

The Llama 3 project is part of Meta's strategy to compete with OpenAI’s GPT-4, known for its ability to answer questions based on user-uploaded images. The upcoming biggest version of Llama 3 is expected to be multimodal, capable of processing both text and images. In contrast, the two smaller models set for release next week will lack multimodal capabilities, as per the Information report.

Smaller models are increasingly valued in the industry due to their cost-effectiveness and faster processing speeds compared to larger counterparts. They are particularly attractive for developers aiming to integrate artificial intelligence software into mobile devices.

Previously, Meta released three variants of Llama 2, ranging from 7 billion to 70 billion parameters, which encode the learning acquired during model training. 

It is speculated that the largest version of Llama 3 could exceed 140 billion parameters, as reported by The Information.

Meta utilises Llama 2 to power its AI assistant across its apps. Recent efforts within Meta's generative AI department have focused on making Llama 3 more adept at addressing controversial queries, following concerns that Llama 2 was overly conservative in its responses.

Published

Spotted an error? Tell our editors. Read our editorial standards and corrections.

More in this story

Meta · 5 stories
  1. You are here: Meta Set to Release Two Small Versions of Llama 3 Next Week
  2. Meta Plans $65 Bn Investment to Build a 2GW+ Data Center in Manhattan
  3. Meta’s AI Research Head Joelle Pineau Announces Resignation
  4. Meta Launches Muse Spark 1.1 Challenges GPT-5.5 & Opus 4.8
  5. Meta Wants $95 Billion Through Stock Sales to Fund AI Infrastructure
About the author

Tech Journalist

Siddharth is a media graduate who loves to explore tech through journalism and putting forward ideas worth pondering about in the era of artificial intelligence.

All stories
Belamy · Daily

The day’s AI news, before your first meeting.