OpenAI Launches GPT-4 Turbo with Vision in API

OpenAI has unveiled the latest addition to its AI arsenal with the release of GPT-4 Turbo with Vision, now available in the API. This new version comes with enhanced capabilities, including support for JSON mode and function calling for Vision requests. The upgraded GPT-4 Turbo model promises improved performance and is set to roll out in ChatGPT as well.

GPT-4 Turbo is a robust multimodal model capable of processing both text and image inputs, delivering accurate outputs thanks to its extensive general knowledge and advanced reasoning abilities. 

OpenAI introduced GPT-4 Turbo last November during DevDay, showcasing its enhanced capabilities and expanded knowledge base up to April 2023. With a 128k context window, this model can accommodate over 300 pages of text in a single prompt, providing users with a comprehensive understanding of diverse topics.

One of the notable highlights of GPT-4 Turbo is its optimized performance, leading to a substantial reduction in costs for users. Input tokens are now priced at three times less, while output tokens are available at half the cost compared to the previous GPT-4 model, making this upgrade both efficient and cost-effective for customers.

OpenAI recently announced Voice Engine, built to generate natural-sounding speech from text input and a mere 15-second audio sample. Notably, Voice Engine can create emotive and realistic voices using this brief audio input. However, it hasn’t been made available to the public yet.

OpenAI has indicated that its next model GPT-5 is coming soon with better reasoning skills. OpenAI’s chief operating officer Brad Lightcap, OpenAI's COO, mentioned in an interview with the Financial Times that GPT-5 will focus on tackling tough problems, especially in the area of reasoning.