Microsoft Introduces Multimodal Large Language Model Kosmos-1

Microsoft released their research paper, titled - Language Is Not All You Need: Aligning Perception with Language Models. The model introduces a multimodal large language model (MLLM) called Kosmos-1.
Listen to this story

Following the recent developments in large language models using Transformers, an attention-based mechanism developed by Google in 2017, Microsoft released its research paper, Language Is Not All You Need: Aligning Perception with Language Models. The model introduces a multimodal large language model (MLLM) called Kosmos-1.

The paper talks about the importance of integrating language, action, multimodal perception, and world modelling for stepping towards AGI. The research explores Kosmos-1 in various settings like zero-shot, few-shot, and multi-modal chain of thoughts, on several tasks without fine-tuning or gradient updates.

Check out the research paper here

AIM Daily XO

Join our editors every weekday evening as they steer you through the most significant news of the day, introduce you to fresh perspectives, and provide unexpected moments of joy
Your newsletter subscriptions are subject to AIM Privacy Policy and Terms and Conditions.

The model shows promising capabilities on various generation tasks by perceiving general modalities such as OCR-free NLP, visual QA, and perception-language tasks, and vision tasks

The Microsoft research team also introduced the model to a dataset of Raven IQ test for analysing and diagnosing the non-verbal reasoning capabilities of MLLMs.


Download our Mobile App



Below is the example of multimodal chain-of-thought prompting. This enables the model to deal with complex questions and reasoning tasks, by generating a rationale before tackling the problem.

The team believes that moving from LLMs to MLLMs is better for achieving new capabilities and opportunities for language and multimodal tasks. 

Though it hasn’t been updated yet, you can check out the Github repository here for future updates. 

Sign up for The Deep Learning Podcast

by Vijayalakshmi Anandan

The Deep Learning Curve is a technology-based podcast hosted by Vijayalakshmi Anandan - Video Presenter and Podcaster at Analytics India Magazine. This podcast is the narrator's journey of curiosity and discovery in the world of technology.

Mohit Pandey
Mohit dives deep into the AI world to bring out information in simple, explainable, and sometimes funny words. He also holds a keen interest in photography, filmmaking, and the gaming industry.

Our Upcoming Events

24th Mar, 2023 | Webinar
Women-in-Tech: Are you ready for the Techade

27-28th Apr, 2023 I Bangalore
Data Engineering Summit (DES) 2023

23 Jun, 2023 | Bangalore
MachineCon India 2023 [AI100 Awards]

21 Jul, 2023 | New York
MachineCon USA 2023 [AI100 Awards]

3 Ways to Join our Community

Telegram group

Discover special offers, top stories, upcoming events, and more.

Discord Server

Stay Connected with a larger ecosystem of data science and ML Professionals

Subscribe to our Daily newsletter

Get our daily awesome stories & videos in your inbox
MOST POPULAR

Council Post: From Promise to Peril: The Pros and Cons of Generative AI

Most people associate ‘Generative AI’ with some type of end-of-the-world scenario. In actuality, generative AI exists to facilitate your work rather than to replace it. Its applications are showing up more frequently in daily life. There is probably a method to incorporate generative AI into your work, regardless of whether you operate as a marketer, programmer, designer, or business owner.