Article complete

OpenAI Launches GPT-4 Turbo with Vision in API

This new version comes with enhanced capabilities, including support for JSON mode and function calling for Vision requests.

A glowing green background with a blurred circular object featuring the OpenAI logo in the center.

Key takeaways

  • OpenAI launches GPT-4 Turbo with Vision, enhancing API capabilities for users.
  • Utilize new JSON mode and function calling for improved Vision request handling.
  • Experience optimized performance with reduced costs for input and output tokens.
  • Leverage the model's 128k context window for extensive text comprehension.
  • Await the public release of Voice Engine, generating natural-sounding speech from minimal audio input.

Takeaways drafted with AI from the article text.

https://twitter.com/OpenAI/status/1777772582680301665

GPT-4 Turbo is a robust multimodal model capable of processing both text and image inputs, delivering accurate outputs thanks to its extensive general knowledge and advanced reasoning abilities. 

OpenAI introduced GPT-4 Turbo last November during DevDay, showcasing its enhanced capabilities and expanded knowledge base up to April 2023. With a 128k context window, this model can accommodate over 300 pages of text in a single prompt, providing users with a comprehensive understanding of diverse topics.

One of the notable highlights of GPT-4 Turbo is its optimized performance, leading to a substantial reduction in costs for users. Input tokens are now priced at three times less, while output tokens are available at half the cost compared to the previous GPT-4 model, making this upgrade both efficient and cost-effective for customers.

OpenAI recently announced Voice Engine, built to generate natural-sounding speech from text input and a mere 15-second audio sample. Notably, Voice Engine can create emotive and realistic voices using this brief audio input. However, it hasn’t been made available to the public yet.

OpenAI has indicated that its next model GPT-5 is coming soon with better reasoning skills. OpenAI’s chief operating officer Brad Lightcap, OpenAI's COO, mentioned in an interview with the Financial Times that GPT-5 will focus on tackling tough problems, especially in the area of reasoning.

Published

Spotted an error? Tell our editors. Read our editorial standards and corrections.

More in this story

OpenAI · 5 stories
  1. OpenAI’s Srinivas Narayanan Lauds Bhashini’s Efforts
  2. You are here: OpenAI Launches GPT-4 Turbo with Vision in API
  3. OpenAI Releases Agentic Codex Model That Can Work for More Than 24 Hours
  4. Microsoft Adds Critique Multi-Model AI to Copilot Researcher
  5. A Mysterious AI Model Called Ox Alpha Is Winning Over Developers
About the author

Tech Journalist

Siddharth is a media graduate who loves to explore tech through journalism and putting forward ideas worth pondering about in the era of artificial intelligence.

All stories
Belamy · Daily

The day’s AI news, before your first meeting.