Article complete

Meta open sources OPT-66B

This completes a full release of logbooks detailing the development of all the OPT models.

Meta's logo and text about open-sourcing OPT-66B, emphasizing accessibility for researchers and societal benefits.

Key takeaways

  • Meta has released OPT-66B, the largest unrestricted open-sourced model to date.
  • The release includes comprehensive logbooks detailing the development of all OPT models.
  • Meta's approach marks a significant step in transparency within the AI industry.
  • The company previously launched OPT-175B, known for its low carbon footprint compared to competitors.
  • Access to these models is provided under a non-commercial licence for various research entities.

Takeaways drafted with AI from the article text.

On June 23, 2022, Meta announced the release of the Open Pretrained Transformer(OPT-66B), the largest unrestricted open-sourced model to date. The tech giant has also released the logbooks used for training all their baselines: 125M through 66B. This completes a full release of logbooks detailing the development of all the OPT models and marks the first time in the AI industry that such extensive notes are released with the models and associated paper.

During the launch of OPT-175B, Meta announced it would be releasing the baseline models as well as notes and logbooks of the whole development and training process. As promised Meta has now released baselines  - OPT-125M, OPT-350M, OPT-1.3B, OPT-2.7B, OPT-6.7B, OPT-13B, OPT-30B, OPT-66B on GitHub, 

For more details, click here.

Published

Spotted an error? Tell our editors. Read our editorial standards and corrections.