Enhanced Learning of Jazz Chords with a Projector Based Piano Keyboard Augmentation

Abstract

Learning jazz piano is considered technically difficult. Most people cannot afford private piano tuition and there are many freely available video tutorials on the Internet. This study identified a set of challenging topics associated with learning jazz piano based on popular YouTube jazz piano tutorials. The results suggest that learners are struggling to understand the construction of complex chords in the 12 keys. Most tutorial videos show two parallel keyboards, one physical with the real hands and one virtual keyboard, which the viewers must map onto their own keyboard. Based on these results a series of visualization approaches were explored through a low-fi prototype by augmenting the physical piano keyboard with voicing instructions using a projector.

Music in Extended Realities

“…A similar system was then adapted for children [162]. The piano has been the instrument mostly investigated using such a paradigm [21], [41], [120], [122], [124], [158], [162], [163], [165], while similar systems exist for guitar [88] and drums [164].…”

“…Systems for individual use have been created for AR, AV and VR as well as for all types of target users and primary functions identified in Section VII-B. A number of interfaces have been developed for individual composition (for VR see e.g., [102], for AR see e.g., [111]), education (for VR see e.g., [49], [103], for AR see e.g., [101], [124], for AV see e.g., [82]), performance (for VR see e.g., [26], [57], [169], for AV see e.g., [52]), and entertainment (for VR see e.g., [55], [157], for AR see e.g., [53]).…”

Experiences Using Three App Prototyping Tools with Different Levels of Fidelity from a Product Design Student’s Perspective

“…Prototypes are often used to test technologies that are not easily available such as augmented reality displays [10,11,12], public kiosks [13,14], or technologies that do not yet exist such as novel application-specific smart devices [15]. Such prototypes can be simple mockups that leave much to the imagination, or it can be more complete implementations such as using Arduino to prototype mobile technology [16].…”