Bengaluru-based startup Portkey.ai today announced a $3 million seed-funding round empowering engineering teams to build and launch generative AI apps faster. The funding round was led by Lightspeed with participation from angel investors, including prominent figures from AWS, OpenAI, Cloudflare, Postman, and Asana. 

Portkey.ai has built tools that allow businesses to monitor their language model operations (LLMOps), connect to multiple large language models (LLMs) efficiently, experiment, improve, and manage prompts effectively. It also offers deep integrations with players like OpenAI, Anthropic, LangChain, LlamaIndex and more. They already serve millions of requests a day for innovative GenAI companies like Postman, Jio Haptik, Springworks and more through their full-stack LLMOps solution. 

“Tech chiefs are facing a rush of demand from teams for AI apps that will save money without too much delay. But they cannot say yes to all their requests. There’s so much work to be done that there are often competing priorities and Portkey wants to help solve these dilemmas for tech teams.

“Our vision for Portkey has been to enable teams and companies to deploy GenAI apps and features with confidence,” Rohit Agarwal, co-founder, Portkey.ai, said.

An enterprise building GenAI features could use Azure & Llama2 with intelligent routing, save over 25% in budget spent with smart caching, and monitor all their requests for accuracy & latency. Building this platform internally would take months of work, and various iterations and requires significant experience with LLMs, while getting all this ready with Portkey takes 2 minutes.