PDF] Skeleton Plays Piano: Online Generation of Pianist Body

A deep neural network system is directly trained to map a MIDI note stream and additional metric structures to a skeleton sequence of a pianist playing a keyboard instrument in an online fashion and shows that it is capable of learning the motion behavior of a specific player. Generating expressive body movements of a pianist for a given symbolic sequence of key depressions is important for music interaction, but most existing methods cannot incorporate musical context information and generate movements of body joints that are further away from the fingers such as head and shoulders. This paper addresses such limitations by directly training a deep neural network system to map a MIDI note stream and additional metric structures to a skeleton sequence of a pianist playing a keyboard instrument in an online fashion. Experiments show that (a) incorporation of metric information yields in 4% smaller error, (b) the model is capable of learning the motion behavior of a specific player, and (c) no significant difference between the generated and real human movements is observed by human subjects in 75% of the pieces.

Applied Sciences October-1 2021 - Browse Articles

PDF) Detecting Hand Posture in Piano Playing Using Depth Data

Exhausting repetitive piano tasks lead to local forearm

Piano Playing Skeleton by Kevin & Julia Olson

John J. Mortensen - The Pianist's Guide To Historic Improvisation

Skeletons sheet music Play, print, and download in PDF or MIDI

Frontiers A Methodological Framework for Assessing Social

Headliner Magazine Issue 44 by Headliner Magazine - Issuu

Skeleton Plays Piano

PDF) Audio-Visual Tensor Fusion Network for Piano Player Posture

An anthropomorphic soft skeleton hand exploiting conditional

Crowne, Scott.pdf - DRUM - University of Maryland

Piano Playing Skeleton by Kevin & Julia Olson

PDF) Audio to Body Dynamics

Skeleton Plays Piano