Multi-Domain Motion Embedding
Expressive Real-Time Mimicry for Legged Robots
Prior motion imitation methods rely on explicit, morphology-specific retargeting and fail to generalise to unseen motions because they do not capture the inherent periodic and aperiodic structure of natural movement. MDME addresses this with a dual-encoding architecture that combines a Variational Autoencoder for unstructured features with a discrete wavelet transform (DWT) encoder for periodic structure, producing a rich latent representation that conditions a robot policy directly on raw reference motions — no retargeting needed. Trained jointly on human (AMASS) and dog (SIGGRAPH) motion-capture datasets, the framework demonstrates zero-shot sim-to-real deployment on the Fourier N1 humanoid and ANYmal D quadruped, outperforming prior approaches in reconstruction fidelity and generalising to novel unseen motion styles in real time.