Article complete

‘ChatGPT is Cosmos DB’s Largest User'

The focus on robust data infrastructure aligns with its broader strategy, including a $3 billion investment in Azure data centres across India.

A speaker gesturing on stage in front of a large screen displaying graphs, with an audience in the foreground.

Key takeaways

  • ChatGPT is the largest user of Microsoft's Cosmos DB, emphasizing its scalability for AI applications.
  • Microsoft invests $3 billion in Azure data centers in India to enhance its data infrastructure.
  • Cosmos DB supports high-throughput, low-latency demands essential for real-time AI interactions.
  • Nadella highlights the importance of cloud-native databases in modern AI workloads.
  • Merging operational and analytical databases is crucial for effective AI training and inference.

Takeaways drafted with AI from the article text.

Microsoft CEO Satya Nadella revealed at the Microsoft AI Tour in Bengaluru that OpenAI’s ChatGPT is the largest user of Cosmos DB, Microsoft's database service, designed to build scalable and AI-ready apps. 

“If you look at ChatGPT, they are some of the biggest users of Cosmos because [it] serves as a stateful application,” Nadella said. This underscores Cosmos DB’s role in managing extensive real-time interactions and session data required by ChatGPT, a chatbot that handles millions of simultaneous conversations.

Cosmos DB’s scalable architecture supports high-throughput, low-latency demands during both AI training and inference, thereby ensuring responsive and stateful interactions for applications like ChatGPT.

Linking AI’s progress to Moore’s Law, Nadella noted that scaling laws remain strong for both training and inference and highlighted the significance of test-time compute”, where databases like Cosmos DB must handle high-throughput and low-latency demands post-training. 

He pointed out that merging operational and analytical data in the cloud enables AI-driven apps to access high-volume data reliably and in real time.

Nadella attributed ChatGPT’s success to the foundational role of databases in AI and said that Cosmos DB integrates operational and analytical data to provide reliable, high-volume access in real time. 

According to the company, this focus on robust data infrastructure aligns with its broader strategy, including a $3 billion investment in Azure data centres across India, where the aim is to expand global capacity to meet rising AI demands. 

These investments reinforce Cosmos DB’s position as a backbone for next-generation AI applications.

At last year's Microsoft Build, the company introduced Microsoft Fabric, real-time intelligence to its AI analytics platform. This update integrated SQL Server into Fabric databases and merged operational and analytical data within a single unified platform.Moreover, the data API builder for Azure Cosmos DB was released to the public. This open-source tool requires no coding to set up secure GraphQL endpoints.

Published Updated

Spotted an error? Tell our editors. Read our editorial standards and corrections.

About the author

Contributor

I hold a degree in political science, and am interested in how AI and online culture intersect. I am at & x.com/aditisuresh12

All stories
Belamy · Daily

The day’s AI news, before your first meeting.