Log in
Enquire now
Stable Video Diffusion

Stable Video Diffusion

Stable Video Diffusion is a foundational model for generative video from Stability AI, based on its image model Stable Diffusion.

OverviewStructured DataIssuesContributors

Contents

stability.ai/stable-video
Is a
Product
Product

Product attributes

Industry
‌
AI video generation
Generative AI
Generative AI
Artificial Intelligence (AI)
Artificial Intelligence (AI)
Synthetic Media
Synthetic Media
Launch Date
November 21, 2023
0
Product Parent Company
Stability AI
Stability AI
Competitors
Synthesia
Synthesia
Runway
Runway
‌
Peech

Other attributes

Announcement URL
stability.ai/news/sta...deo-model
Overview

Stable Video Diffusion (SVD) is a foundational model for generative video from Stability AI, based on its image model Stable Diffusion. SVD is a latent diffusion model trained to generate short video clips from an image taken as a conditioning frame. SVD is capable of text-to-video and image-to-video generation, as well as multiview synthesis via image-to-video fine-tuning. Users provide SVD with a natural language description and receive a short video clip.

Stable Video Diffusion launch video.

The model was released in research preview on November 21, 2023, with the code available on the company's GitHub repository and the weights to run locally on its Hugging Face page. Stable Diffusion also released a research paper going into detail on the technical capabilities of the model. Upon initial release, SVD is intended for research purposes only. It is not intended for real-world or commercial applications as the model was not trained to be factual or provide true representations of people or events.

SVD was initially trained on a dataset of millions of videos before being fine-tuned on a much smaller dataset (hundreds of thousands to around a million clips). SVD can adapt to multiple tasks including multi-view synthesis from a single image with fine-tuning on multi-view datasets. Upon release, SVD offers two forms of image-to-video generation 14 frames and 25 frames at customizable frame rates between 3 and 30 frames per second.

Timeline

No Timeline data yet.

Further Resources

Title
Author
Link
Type
Date

Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets -- Stability AI

Andreas Blattmann, Tim Dockhorn, Sumith Kulal, Daniel Mendelevitch,

Maciej Kilian, Dominik Lorenz, Yam Levi, Zion English, Vikram Voleti,

Adam Letts, Varun Jampani, Robin Rombach

https://stability.ai/research/stable-video-diffusion-scaling-latent-video-diffusion-models-to-large-datasets

Web

November 21, 2023

References

Find more entities like Stable Video Diffusion

Use the Golden Query Tool to find similar entities by any field in the Knowledge Graph, including industry, location, and more.
Open Query Tool
Access by API
Golden Query Tool
Golden logo

Company

  • Home
  • Press & Media
  • Blog
  • Careers
  • WE'RE HIRING

Products

  • Knowledge Graph
  • Query Tool
  • Data Requests
  • Knowledge Storage
  • API
  • Pricing
  • Enterprise
  • ChatGPT Plugin

Legal

  • Terms of Service
  • Enterprise Terms of Service
  • Privacy Policy

Help

  • Help center
  • API Documentation
  • Contact Us
By using this site, you agree to our Terms of Service.