Models & resources
Gen-2
Gen-2 is a multimodal AI video generation model developed by Runway Research.
What is Gen-2?
Gen-2 is a multimodal AI video generation model developed by Runway Research.It creates novel videos from text prompts, images, or existing video clips, enabling creators to produce cinematic content without the need for traditional filming setups—no lights, no camera, just action.
The model supports eight generation modes, including Text to Video, Stylization, and Customization.Users can apply the composition and style of an image or text prompt to the structure of a source video (Video to Video), or synthesize videos using nothing but words.User studies indicate that Gen-2 results are preferred over existing methods like Stable Diffusion 1.5 and Text2Live for image-to-image and video-to-video translation.
As a pivotal step in Runway’s mission to build multimodal AI systems for new forms of creativity, Gen-2 serves professionals across film, social media, and marketing.It transforms static assets and plain-language descriptions into compelling motion pictures, offering a new standard for video generation fidelity and consistency.
Key features
- Text to VideoSynthesize videos in any style you can imagine using nothing but a text prompt, turning descriptions into visual reality.
- Text + Image toGenerate video using a driving image and a text prompt, combining structural guidance with stylistic direction.
- Image to VideoGenerate video variations using just a driving image, bringing static photos to life with dynamic motion.
- StylizationTransfer the style of any image or prompt to every frame of your video for consistent aesthetic transformation.
- StoryboardTurn mockups and storyboards into fully stylized and animated renders, accelerating pre-visualization.
- MaskApply stylization selectively to specific regions of your video while leaving the rest unchanged for precise control.
- RenderTurn untextured 3D renders into realistic outputs by applying an input image or prompt.
- CustomizationUnleash the full power of Gen-2 by customizing the model for even higher fidelity and tailored results.
How to use it
- Visit the Runway website or download the iOS/Android app, then sign up and log in to your account.
- Select the Gen-2 model in the creation interface and choose one of the 8 generation modes (e.g., Text to Video or Image to Video).
- Enter your text prompt, upload a driving image or source video clip, and adjust parameters to match your creative vision.
- Click generate and wait for the AI to synthesize the video; use parallel generations to test multiple versions simultaneously.
- Preview the generated video and use tools like Masking or Stylization for fine-tuning if needed.
- Export the final video project, ready for use in social media posts, advertisements, or presentations.
Where it fits
- Social Media ConTurn product photos into scroll-stopping video posts for Instagram and TikTok, generating on-brand content in seconds.
- Product VisualizCreate endless product shots, packaging visuals, or retail shelf sets from a single image without physical shoots.
- Film Pre-visualiTransform static storyboards or concept art into dynamic preview videos to visualize scenes before filming.
- Real Estate & HoConvert listing photos into cinematic walkthroughs or aerial-style exterior videos to enhance property appeal.
Pricing and free quota
Runway offers a Free plan (with 125 one-time credits) as well as paid subscriptions like Standard and Pro.Pricing details follow the official site.
Who it is for
- Video Creators & Filmmakers
- Social Media Marketers
- Product Designers & E-commerce Sellers
- Advertising Agencies
FAQ
What input methods does Gen-2 support?
Gen-2 supports text prompts, static images, and video clips as inputs, offering 8 different generation modes to process them.
How does Gen-2 compare to other video generation models?
According to user studies, Gen-2 results are preferred over existing methods like Stable Diffusion 1.5 and Text2Live for image-to-image and video-to-video translation.
Can I use Gen-2 on my mobile phone?
Yes, Runway offers apps for iPhone and Android, allowing users to create with Gen-2 anytime and anywhere.
Can Gen-2 be used for commercial projects?
Yes, Runway's paid plans allow users to generate watermark-free videos suitable for commercial ads, social media content, and other business uses.