Advertisement

These new innovations are being built on top of Stable Diffusion 

A month later, Stable Diffusion has established itself to be the worthy opponent of image generators like DALL E2 and Midjourney. In this article, we’ve outlined some interesting developments going around it. 
Listen to this story

Stable Diffusion is expected to be the one of the most powerful AI art generators; it’s been nearly a month since its release and yet the application continues to gain enormous traction. 

In our previous discussions, we have covered developments around Stable Diffusion—plugins like Figma, Photoshop and Krita were mentioned among several others. Features like img2img and possibilities of Stable Diffusion in Canva and WordPress were also highlighted. 

Let’s talk about the latest developments around Stable Diffusion as it celebrates the 1 million users milestone on its DreamStudio platform.

https://twitter.com/EMostaque/status/1571572181976465417

Stable Diffusion X Blender

Recently, a Reddit user claimed to have developed a Stable Diffusion Blender Shader Editor plugin. Further, they claim that users may utilise written prompts to generate images and that templates can be used to create prompts that are more descriptive. The created photos can also be used right away in the current node tree by users.

A user on Twitter has also shared a texture generator for Blender which enables users to generate unique textures free of cost. 

Stable Diffusion X Cinema 4D

Another Reddit user created a plugin that uses Stable Diffusion to render the Cinema 4D scene natively. The user claims that, “the plugin’s purpose is to employ steady diffusion to breathe life into a ‘basic’ scene that is lacking in realism, expressiveness, etc.”

The layout is based on the scene as a starting point. Stable Diffusion adds details and higher quality to it. As an input to Stable Diffusion, this blends the picture from Cinema with a text input.

Stable Diffusion X Photoshop

The Photoshop plugin has been discussed at length, but this one is believed to be comparatively easier to use. Although it doesn’t allow for image extension, it does support img2img. According to the creator, it is expected to have capabilities of inpainting/outpainting soon. 

Stable Diffusion X Hollywood

Filmmaker and Cinematic Artist Scott Lighthiser produced a new collection of blood-curdling, humanoid creatures.

Lighthiser was able to pull off this feat by combining real-world video recordings with image-to-image functionality from NOP and WAS’ Stable Diffusion Colab and EbSynth, Secret Weapons—which can change a movie by painting over a single frame.

Stable Diffusion X Canva! 

We had discussed the probability of Canva introducing a text-to-image generator, but didn’t expect the launch this soon. Yes you heard it right—Now everyone’s favourite tool Canva, too, has Stable Diffusion. The online graphic design tool took to Twitter to announce the introduction of its text-to-image generator on the platform. 

https://twitter.com/canva/status/1570109627785744384

Stable Diffusion X GIMP

A Twitter user shared an announcement regarding the introduction of Stable Diffusion plugin in open-source raster graphics editor GIMP.

GIMP is a free image editor that runs on several operating systems, including Windows, macOS, GNU/Linux, and others. The addition of Stable Diffusion to GIMP may make it possible for low-end machines to locally execute the text-to-image module.

Also See

A Reddit user recently shared a video of generating animation with the help of Stable Diffusion and AfterEffects. This video offers a bright perspective on the future of the animation industry. According to the creator, the frame generation for cartoons has become relatively easier now.  

Download our Mobile App

Lokesh Choudhary
Tech-savvy storyteller with a knack for uncovering AI's hidden gems and dodging its potential pitfalls. 'Navigating the world of tech', one story at a time. You can reach me at: lokesh.choudhary@analyticsindiamag.com.

Subscribe to our newsletter

Join our editors every weekday evening as they steer you through the most significant news of the day.
Your newsletter subscriptions are subject to AIM Privacy Policy and Terms and Conditions.

Our Upcoming Events

15th June | Bangalore

Future Ready | Lead the AI Era Summit

15th June | Online

Building LLM powered applications using LangChain

17th June | Online

Mastering LangChain: A Hands-on Workshop for Building Generative AI Applications

20th June | Bangalore

Women in Data Science (WiDS) by Intuit India

Jun 23, 2023 | Bangalore

MachineCon 2023 India

26th June | Online

Accelerating inference for every workload with TensorRT

MachineCon 2023 USA

Jul 21, 2023 | New York

Cypher 2023

Oct 11-13, 2023 | Bangalore

3 Ways to Join our Community

Telegram group

Discover special offers, top stories, upcoming events, and more.

Discord Server

Stay Connected with a larger ecosystem of data science and ML Professionals

Subscribe to our Daily newsletter

Get our daily awesome stories & videos in your inbox
MOST POPULAR