With video-generation tools blurring the line between reality and AI, the continuous developments are only making it easier for people to create stunning visuals.
RunwayML, an applied AI research company for AI video editing and generation, which is capable of making videos from short text-based prompts, has released a series of new updates and features. The updates are said to enhance user experience by providing more control, fidelity and expressiveness.
Here are some of the latest features of RunwayML that transcend the boundaries of creativity.
Motion Brush
Motion Brush, a cutting-edge interface for generative models, is empowering artists with controlled movement options for enhanced creative expression. This tool addresses the need for increased utility and expressiveness in generative models, providing users with precise control over their creations.
Users can paint an area or subject, and choose appropriate directions and intensity to the motion, thereby allowing one to transform any kind of images or portion of images into a video. This has been called a much-needed feature with many sharing their experiments with the new tool.
A few users have also tried running this feature on images generated from Midjourney.
Gen 2 Style Presets
The company believes that control is not just about motion but also art direction and style. Style presets in Gen2 allows one to create content using curated styles without the need of complex prompting. Glossy animations, and grainy retro film stocks are some of the many styles that can be brought to stories.
Director Mode Updates
The advanced camera control on Director’s mode has been updated with more nuances. With this, a more granular level of control can be obtained. Furthermore, a user can fine-tune camera moves using fractional numbers for improved precision.
New Image Model Update
With the latest update, RunwayML has brought in features to improve fidelity and consistency. The higher resolution generations are now available in options such as text-to-image, image-to-image and image variation. By implementing these features, it also improves storytelling control.
Combined Motion and Camera Control
To achieve higher precision and control over an image, combining the tools can lead to desired results. Users can fine-tune it as per their desired style with the ‘style preset’ option. This will enable better expressibility too.
Runway has been working aggressively to release updates in the AI image space to compete with other players such as Midjourney and Stable Diffusion that released a new feature where meme images can be converted to videos.
Runway has also received significant funding. The company raised funds of over $141 million from major tech giants such as Google, Nvidia, Salesforce and others. Furthermore, Runway AI announced its partnership with Canva, a graphic-design tool company to create generative AI videos and provide Gen-2 AI technology to Canva’s ecosystem.
Your reaction
Discussion
What's your take on this story?
No comments yet — be the first to share your view.