Champ fudan-generative-vision.github.io이 논문의 경우 엄밀히 따지면 Human Image Animation으로 분류되는 논문이다. Reference Image가 주어지게 되면 YouTube, TikTok 등 다양한 비디오 매체에서 가져온 motion들을 학습한 모델이 reference image 속 사람을 움직이게 하는 task이다. 본 논문을 Music-to-Dance로 분류한 이유는 이 다음 posting에서 다룰 X-Dancer라는 논문이 Human Image Animation에 추가적으로 music을 condition으로 줘서 음악에 맞는 동작을 취하도록 한 논문이기 때문에 서론의 느낌으로 music-to-dance라고 분류하였다.AbstractWe introduc..

GCDance: Genre-Controlled 3D Full Body Dance Generation Driven By MusicGenerating high-quality full-body dance sequences from music is a challenging task as it requires strict adherence to genre-specific choreography. Moreover, the generated sequences must be both physically realistic and precisely synchronized with the beatsarxiv.orgAbstract고퀄리티의 full-body dance sequence를 음악으로부터 생성하는 것은 어려운 tas..

DiffDance: Cascaded Human Motion Diffusion Model for Dance GenerationWhen hearing music, it is natural for people to dance to its rhythm. Automatic dance generation, however, is a challenging task due to the physical constraints of human motion and rhythmic alignment with target music. Conventional autoregressive methods inarxiv.orgAbstract자동으로 dance를 생성하는 것은 human motion과 rhythm의 alignment로 인해 ..

Champ: Controllable and Consistent Human Image Animation with 3D Parametric GuidanceIn this study, we introduce a methodology for human image animation by leveraging a 3D human parametric model within a latent diffusion framework to enhance shape alignment and motion guidance in curernt human generative techniques. The methodology utilizearxiv.org  Champ fudan-generative-vision.github.ioAbstract..

DreamWaltz: Make a Scene with Complex 3D Animatable AvatarsWe present DreamWaltz, a novel framework for generating and animating complex 3D avatars given text guidance and parametric human body prior. While recent methods have shown encouraging results for text-to-3D generation of common objects, creating high-quaidea-research.github.io DreamWaltz: Make a Scene with Complex 3D Animatable Avatars..

POPDG: Popular 3D Dance Generation with PopDanceSetGenerating dances that are both lifelike and well-aligned with music continues to be a challenging task in the cross-modal domain. This paper introduces PopDanceSet, the first dataset tailored to the preferences of young audiences, enabling the generationarxiv.org POPDG: Popular 3D Dance Generation with PopDanceSetZhenye Luo, Min Ren, Xuecai Hu,..