Meta Releases Code Llama 70B

Meta has released Code Llama 70 B. The new iteration, available for download at https://bit.ly/48QeOs7, maintains an open license, aligning with its predecessors—Llama 2 and prior Code Llama models—aimed at supporting research and commercial innovation.

One notable addition to the suite is CodeLlama-70B-Instruct, a finely tuned version specifically designed for instruction-based tasks. This model achieves an impressive 67.8 on HumanEval, solidifying its status as one of the highest-performing open models currently available. 

Code Llama 70B provides three free versions for research and commercial use: foundational code (CodeLlama - 70B), Python specialisation (CodeLlama - 70B - Python), and fine-tuned for natural language instructions (Code Llama - 70B - Instruct 70B).

“We're open sourcing a new and improved Code Llama, including a larger 70B parameter model. Writing and editing code has emerged as one of the most important uses of AI models today,” said Meta chief, Mark Zuckerberg. 

“The ability to code has also proven to be important for AI models to process information in other domains more rigorously and logically. I'm proud of the progress here, and looking forward to including these advances in Llama 3 and future models as well,” he added. 

Meta released its code generation model called Code Llama, last August, which generates code based on both code and natural language prompts. The best part is that just like Llama 2, Code Llama is open source and also available for commercial use. 

Code Llama is built upon the foundation of Llama 2, which has been fine-tuned with specialised code-related datasets. The company announced four versions of Code Llama — Code Llama, Code Llama Instruct, Code Llama Python, and Unnatural Code Llama, each with varying capacities: 7B, 13B, and 34B parameters.