Alibaba’s new open-source AI video-generation model turns photos into film-quality clips


Alibaba Group Holding’s AI and cloud computing unit on Wednesday released the Wan2.2-S2V tool, its latest open-source artificial intelligence model that generates expressive, film-quality character videos from a static image and an audio clip.
The new model forms part of Alibaba Cloud’s Wan2.2 family, which the company last month touted as the AI industry’s first open-source large video-generation models incorporating the so-called Mixture-of-Experts (MoE) architecture. Hangzhou-based Alibaba owns the Post.

Powered by advanced audio-driven animation technology, the Wan2.2-S2V model “delivers lifelike character performances, ranging from natural dialogue to musical performances, and seamlessly handles multiple characters within a scene”, Alibaba Cloud said on Wednesday.

Wan2.2-S2V could be used by professional content creators to “capture precise visual representations tailored to specific storytelling and design requirements”, the company said. That enhancement was attributed to the model’s large-scale audiovisual data set tailored to film and television production scenarios, it added.

The latest Wan2.2 variant reflects how Chinese AI companies are continuing to narrow the gap with their US peers through the open-source approach, which makes the source code of AI models available for third-party developers to use, modify and distribute.

Alibaba Cloud’s Wan2.2 family was designed to meet the diverse needs of professional AI-generated content creators. Photo: Handout
Alibaba Cloud’s Wan2.2 family was designed to meet the diverse needs of professional AI-generated content creators. Photo: Handout
Wan2.2-S2V can now be downloaded from online developer platforms Hugging Face and GitHub, as well as from Alibaba Cloud’s ModelScope open-source community.
  • Related Posts

    Chinese EV maker Nio forecasts surge in deliveries after first quarterly profit

    Chinese electric vehicle (EV) maker Nio has forecast a surge of up to 97 per cent in first-quarter deliveries, underscoring the turnaround after posting its first-ever quarterly profit and defying…

    Continue reading
    From Valuation to Vision: Reinventing Hong Kong’s Real Estate Landscape

    K.K. Chiu is reimagining Hong Kong’s real estate future by helping to shape the next chapter for the city through technology, housing and long-term commitment. Few executives have witnessed Hong…

    Continue reading

    Leave a Reply

    Your email address will not be published. Required fields are marked *