If you think having your phone identify the nearest bus stop is cool, wait until it identifies your mood.<\/p>\n
New research by a team of engineers at the University of Rochester may soon make that possible. At the IEEE Workshop on Spoken Language Technology on Dec. 5, the researchers will describe a new computer program that gauges human feelings through speech, with substantially greater accuracy than existing approaches.<\/p>\n
Surprisingly, the program doesn’t look at the meaning of the words. “We actually used recordings of actors reading out the date of the month \u2013 it really doesn’t matter what they say, it’s\u00a0how<\/em>\u00a0they’re saying it that we’re interested in,” said Wendi Heinzelman, professor of electrical and computer engineering.<\/p>\n Heinzelman explained that the program analyzes 12 features of speech, such as pitch and volume, to identify one of six emotions from a sound recording. And it achieves 81 percent accuracy \u2013 a significant improvement on earlier studies that achieved only about 55 percent accuracy.<\/p>\n The research has already been used to develop a prototype of an app. The app displays either a happy or sad face after it records and analyzes the user’s voice. It was built by one of Heinzelman’s graduate students, Na Yang, during a summer internship at Microsoft Research. “The research is still in its early days,” Heinzelman added, “but it is easy to envision a more complex app that could use this technology for everything from adjusting the colors displayed on your mobile to playing music fitting to how you’re feeling after recording your voice.”<\/p>\n Heinzelman and her team are collaborating with Rochester psychologists Melissa Sturge-Apple and Patrick Davies, who are currently studying the interactions between teenagers and their parents. “A reliable way of categorizing emotions could be very useful in our research,”. Sturge-Apple said. “It would mean that a researcher doesn’t have to listen to the conversations and manually input the emotion of different people at different stages.”<\/p>\n Sound examples:<\/strong> female speaker performing the “pride” emotion.