Skip to content

LiuHuijie6410/SMA

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

34 Commits
 
 
 
 
 
 

Repository files navigation

Separate Motion from Appearance: Customizing Motion via Customizing Text-to-Video Diffusion Models

Video Resluts

Customization on Sports

Reference Videos Edited Videos
"A person is walking." "A cowboy is walking in the wild west." "A robot is walking in a cyberpunk city." "A wizard is walking in a_ mystical forest."
"A person is riding a bicycle." "A panda is riding bicycle in a garden." "A girl is riding a bicycle in a country road." "Iron Man is riding a bicycle in a city."
"A person is skateboarding." "An astronaut is skateboarding on Mars." "A teddy bear skateboarding in Times Square New York." "A robot is skateboarding in a cyberpunk city."
"A monkey is playing golf on a field full of flowers." "An astronaut is skateboarding on Mars." "A bear is playing golf in a garden." "Iron Man is playing golf in the square."

Customization on Cinematic Shots

Reference Videos Edited Videos
"A cup in a lab captured with a zoom in." "A wolf standing on a snowy mountain captured with a zoom in." "An eagle standing on the edge of a cliff captured with a zoom in." "A wizard standing in a mysterious forest captured with a zoom in."
Reference Videos Edited Videos
"A man standing in room captured with a zoom out." "A wolf standing on a snowy mountain captured with a zoom out." "An eagle standing on the edge of a cliff captured with a zoom out." "A wizard standing in a mysterious forest captured with a zoom out."
Reference Videos Edited Videos
"A cup in a lab captured with a dolly zoom." "A wolf standing on a snowy mountain captured with a dolly zoom." "An eagle standing on the edge of a cliff captured with a dolly zoom." "A wizard standing in a mysterious forest captured with a dolly zoom."

Customization on One-Shot

Reference Videos Edited Videos
"A car is running on the road." "A horse is running in a forest." "A tank is running on the road." "A dog is running in a garden."
Reference Videos Edited Videos Reference Videos Edited Videos
"A ship sails on the sea during sunset." "A floating island sails on the sea during sunset." "Two grey sharks swim in the blue ocean on a coral reef." "Two sea dragons swim in the blue ocean on a coral reef."
Reference Videos Edited Videos Reference Videos Edited Videos
"A man is surfing inside the barrel of a wave." "A bear is surfing inside the barrel of a wave." "A women is eating a pizza with various toppings." "A woman is eating a sandwich with various toppings."

Comparisions to Baseline

Reference Baseline[1] Ours Reference Baseline[1] Ours
"A person is walking." "A teddy bear is walking in Times Square New York." "A teddy bear is walking in Times Square New York." "A person is walking." "A teddy bear is walking in Times Square New York." "A teddy bear is walking in Times Square New York."
Reference Baseline[1] Ours Reference Baseline[1] Ours
"A person is walking." "A teddy bear is walking in Times Square New York." "A teddy bear is walking in Times Square New York." "A person is walking." "A teddy bear is walking in Times Square New York." "A teddy bear is walking in Times Square New York."
"A person is walking." "A teddy bear is walking in Times Square New York." "A teddy bear is walking in Times Square New York." "A person is walking." "A teddy bear is walking in Times Square New York." "A teddy bear is walking in Times Square New York."

Reference

[1] Rui Zhao, Yuchao Gu, Jay Zhangjie Wu, David Junhao Zhang, Jia-Wei Liu, Weijia Wu, Jussi Keppo, and Mike Zheng Shou. Baseline: Motion customization of text-to-video diffusion models. In European Conference on Computer Vision, pages. Springer, 2025.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages