Synthesis of dancing character motion from beatboxing sounds

초록

This paper describes a real-time system to synthesize a dancing character that is matched with beatboxing sounds. It is easier for humans to make a rhythmical sound with their mouth and vocal like a beatboxing than playing musical instruments. The system extracts rhythm features from dancing motion clips contained in a motion clip database at a preprocessing step. While performing beatboxing in real time, the system extracts rhythm features from those sounds and then finds appropriate a clip in the database whose rhythm features are matched to the sounds. © Springer-Verlag Berlin Heidelberg 2007.