MITB Banner

Researchers Release Multimodal MiniGPT-4 before OpenAI

MiniGPT-4 is an open-source model performing complex vision-language tasks like GPT-4

Share

Listen to this story

GPT-4 has been the most advanced development in the world of AI so far with its multimodal capabilities. Most recently, a group of researchers have announced MiniGPT-4-an open-sourced model performing complex vision-language tasks like GPT-4. The code, demos, and training instructions are available on Github. 

While OpenAI announced that GPT-4 is indeed multimodal, the ability of the model to process images has not been made available yet. However, MiniGPT-4 can process images.

The researchers have also revealed that MiniGPT has many capabilities similar to those exhibited by GPT-4 like detailed image description generation and website creation from hand-written drafts.

To build MiniGPT-4, the researchers have used Vicuna, which is built on LLaMA, as a language decoder and the BLIP-2 Vision Language Model, as a visual decoder. Interestingly, both Vicuna and BLIP-2 are open source. 

Given OpenAI has not revealed much details about the architecture (including model size), hardware, training compute, dataset construction, training method used for GPT-4, the open source mini version of the powerful LLM could prove to be significant in terms of research.

Share
Picture of Pritam Bordoloi

Pritam Bordoloi

I have a keen interest in creative writing and artificial intelligence. As a journalist, I deep dive into the world of technology and analyse how it’s restructuring business models and reshaping society.
Related Posts

CORPORATE TRAINING PROGRAMS ON GENERATIVE AI

Generative AI Skilling for Enterprises

Our customized corporate training program on Generative AI provides a unique opportunity to empower, retain, and advance your talent.

Upcoming Large format Conference

May 30 and 31, 2024 | 📍 Bangalore, India

Download the easiest way to
stay informed

Subscribe to The Belamy: Our Weekly Newsletter

Biggest AI stories, delivered to your inbox every week.

AI Courses & Careers

Become a Certified Generative AI Engineer

AI Forum for India

Our Discord Community for AI Ecosystem, In collaboration with NVIDIA. 

Flagship Events

Rising 2024 | DE&I in Tech Summit

April 4 and 5, 2024 | 📍 Hilton Convention Center, Manyata Tech Park, Bangalore

MachineCon GCC Summit 2024

June 28 2024 | 📍Bangalore, India

MachineCon USA 2024

26 July 2024 | 583 Park Avenue, New York

Cypher India 2024

September 25-27, 2024 | 📍Bangalore, India

Cypher USA 2024

Nov 21-22 2024 | 📍Santa Clara Convention Center, California, USA

Data Engineering Summit 2024

May 30 and 31, 2024 | 📍 Bangalore, India

Subscribe to Our Newsletter

The Belamy, our weekly Newsletter is a rage. Just enter your email below.