Using the microphone on a cell phone,SoundSense software picks up sounds and automatically classifies sounds as “voice,” “music,” or “ambient noise.”
The architecture and algorithms are designed for scalability. SoundSense uses a combination of supervised and unsupervised learning techniques to classify both general sound types (e.g., music, voice) and discover novel sound events specific to individual users.
If a sound is repeated often enough or for long enough, SoundSense gives it a high “sound rank” and asks the user to confirm that it is significant and offers the option to label the sound.
Hong Lu, et al. SoundSense: Scalable Sound Sensing for People-Centric Applications on Mobile Phones, captured June 278, 2009.