Audio and acoustics
Project
SoundWave: Using the Doppler Effect to Sense Gestures
We present SoundWave, a technique that leverages the speaker and microphone already embedded in most commodity devices to sense in-air gestures around the device.
Project
Computational Tools for Music
Work in this area seeks to use computational tools to enable musical creativity, in particular to give novices a variety of new approaches to experience musical creativity.
Project
MySong: Automatic Accompaniment for Vocal Melodies
Want to Give MySong a Try? MySong is now Songsmith; you can download a free trial (or the full version, if you’re a teacher who wants to use it in your classroom) at: http://research.microsoft.com/songsmith Happy…
Project
Data-Driven Exploration of Musical Chord Sequences
We present data-driven methods for supporting musical creativity by capturing the statistics of a musical database. Specifically, we introduce a system that supports users in exploring the high-dimensional space of musical chord sequences by parameterizing…
Project
User-Specific Training for Vocal Melody Transcription
Overview This page contains supplementary material for our AAAI 2010 paper: “User-Specific Learning for Recognizing a Singer’s Intended Pitch”. The full citation for our paper follows, along with a link to the paper itself: Guillory…
Video
Ultrasound-Based Gesture Recognition
Sensing technologies have been steadily gaining popularity since they can provide useful and complementary data in Human Computer Interaction (HCI) algorithms. In this study, we explore the feasibility of using ultrasonic imaging to recognize hand…
Publication