Microsoft Introduces Multimodal Large Language Model Kosmos-1

Microsoft released their research paper, titled - Language Is Not All You Need: Aligning Perception with Language Models. The model introduces a multimodal large language model (MLLM) called Kosmos-1.
Listen to this story

Following the recent developments in large language models using Transformers, an attention-based mechanism developed by Google in 2017, Microsoft released its research paper, Language Is Not All You Need: Aligning Perception with Language Models. The model introduces a multimodal large language model (MLLM) called Kosmos-1.

The paper talks about the importance of integrating language, action, multimodal perception, and world modelling for stepping towards AGI. The research explores Kosmos-1 in various settings like zero-shot, few-shot, and multi-modal chain of thoughts, on several tasks without fine-tuning or gradient updates.

Check out the research paper here

Subscribe to our Newsletter

Join our editors every weekday evening as they steer you through the most significant news of the day, introduce you to fresh perspectives, and provide unexpected moments of joy
Your newsletter subscriptions are subject to AIM Privacy Policy and Terms and Conditions.

The model shows promising capabilities on various generation tasks by perceiving general modalities such as OCR-free NLP, visual QA, and perception-language tasks, and vision tasks




The Microsoft research team also introduced the model to a dataset of Raven IQ test for analysing and diagnosing the non-verbal reasoning capabilities of MLLMs.

Below is the example of multimodal chain-of-thought prompting. This enables the model to deal with complex questions and reasoning tasks, by generating a rationale before tackling the problem.

The team believes that moving from LLMs to MLLMs is better for achieving new capabilities and opportunities for language and multimodal tasks. 

Though it hasn’t been updated yet, you can check out the Github repository here for future updates. 

Mohit Pandey
Mohit dives deep into the AI world to bring out information in simple, explainable, and sometimes funny words. He also holds a keen interest in photography, filmmaking, and the gaming industry.

Download our Mobile App

MachineHack

AI Hackathons, Coding & Learning

Host Hackathons & Recruit Great Data Talent!

AIM Research

Pioneering advanced AI market research

Request Customised Insights & Surveys for the AI Industry

The Gold Standard for Recognizing Excellence in Data Science and Tech Workplaces

With Best Firm Certification, you can effortlessly delve into the minds of your employees, unveil invaluable perspectives, and gain distinguished acclaim for fostering an exceptional company culture.

AIM Leaders Council

World’s Biggest Community Exclusively For Senior Executives In Data Science And Analytics.

3 Ways to Join our Community

Telegram group

Discover special offers, top stories, upcoming events, and more.

Discord Server

Stay Connected with a larger ecosystem of data science and ML Professionals

Subscribe to our Daily newsletter

Get our daily awesome stories & videos in your inbox
MOST POPULAR