Multi-instrumentalist Net

Kun Su*, Xiulong Liu*, Eli Shlizerman arxiv

a novel system that takes as an input body movements of a musician playing a musical instrument and generates music in an unsupervised setting