Anthropic Launches Claude 3.5 Sonnet, Crushes OpenAI GPT-4o

Anthropic has launched  Claude 3.5 Sonnet, the first release in the forthcoming Claude 3.5 model family.

Claude 3.5 Sonnet outperforms OpenAI’s GPT-4o, Google Gemini 1.5 Pro, and its predecessor, Claude 3 Opus, in various evaluations, combining enhanced intelligence with the speed and cost efficiency of mid-tier models. 

​​

The model  is available for free on Claude.ai and the Claude iOS app, with higher rate limits for Claude Pro and Team plan subscribers. The model can also be accessed via the Anthropic API, Amazon Bedrock, and Google Cloud’s Vertex AI, priced at $3 per million input tokens and $15 per million output tokens, featuring a 200K token context window.

Claude 3.5 Sonnet excels in graduate-level reasoning, undergraduate-level knowledge, and coding proficiency, with a significant performance boost operating at twice the speed of Claude 3 Opus. This makes it ideal for complex tasks like context-sensitive customer support and multi-step workflow orchestration. In internal coding evaluations, Claude 3.5 Sonnet solved 64% of problems, surpassing Claude 3 Opus’s 38%, demonstrating advanced reasoning and troubleshooting capabilities.

The new model also excels in vision tasks, outperforming Claude 3 Opus on standard vision benchmarks and effectively handling tasks requiring visual reasoning, such as interpreting charts and graphs. It can accurately transcribe text from imperfect images, benefiting industries like retail, logistics, and financial services.

Anthropic has introduced a new feature called Artifacts on Claude.ai, allowing users to interact with Claude-generated content in real-time. This feature enables users to see, edit, and build upon Claude’s creations, evolving the platform from a conversational AI to a collaborative work environment.

Committed to safety and privacy, Claude 3.5 Sonnet has undergone rigorous testing, maintaining ASL-2 safety standards. External experts, including the UK’s Artificial Intelligence Safety Institute (UK AISI) and the US AI Safety Institute (US AISI), have been involved in evaluating the model's safety mechanisms. Anthropic ensures no user-submitted data is used for training without explicit permission, upholding a core principle of privacy.

Looking ahead, Anthropic plans to release Claude 3.5 Haiku and Claude 3.5 Opus later this year, alongside developing new features like Memory for personalised user experiences. The company encourages users to submit feedback directly in-product to help shape future developments and improve user experience.