ÌÇÐÄ´«Ã½

Skip to content
The Arts

What we learn when a machine ÌÇÐÄ´«Ã½˜listensÌÇÐÄ´«Ã½™ to Miles Davis

(Flick photo / mrbluegenes)
Our latest Newscenter series showcases a cross-section of summer research conducted by undergraduates at Rochester and beyond.

Jake Altabef and Graham Palmer have been spending a lot of time at the University of Rochester this summer studying a recording that was first released nearly four decades before they were born.

TheyÌÇÐÄ´«Ã½™ve been studying ÌÇÐÄ´«Ã½œSo What,ÌÇÐÄ´«Ã½� the first track on Miles DavisÌÇÐÄ´«Ã½™s Kind of Blue, which many critics consider the greatest jazz album of all time. First released on vinyl in 1959, it has subsequently been re-mastered in multiple formats, including on cassette in 1987 and on compact disc that same year and in 1997, 2009, and 2013.

And thatÌÇÐÄ´«Ã½™s what Altabef, a rising junior in computer systems engineering at Rensselaer Polytechnic Institute, and Graham, a rising senior in computer science at the University of Michigan, have been focusing on.

How has the sound quality of ÌÇÐÄ´«Ã½œSo WhatÌÇÐÄ´«Ã½� changed over the course of all those re-masters? Is the song ÌÇÐÄ´«Ã½œbrighterÌÇÐÄ´«Ã½� in some formats than others? Is there less background ÌÇÐÄ´«Ã½œnoiseÌÇÐÄ´«Ã½� on disc than on vinyl?

To compare the re-mastered versions of the track, theyÌÇÐÄ´«Ã½™ve been using various tools, such as MATLAB software to analyze the noise-to-signal ratios and the Bark psychoacoustic scale to compare the relative loudness.

By the midpoint of their project, patterns were emerging. ÌÇÐÄ´«Ã½œWhenever the recording companies re-master a track, they try to get rid of white noise, and you find a pretty clear trend as you go through time. The signalÌÇÐÄ´«Ã½”the noise that you want to hearÌÇÐÄ´«Ã½”is going up,ÌÇÐÄ´«Ã½� Palmer says.

Altabef and Graham are at Rochester as participants in a new Research Experience for Undergraduates, or REU, program called Computational Methods for Understanding Music, Media, and Minds. REUs are designed at universities and funded by the National Science Foundation as part of a federal effort to make research accessible to undergraduate students from as many backgrounds as possible. Ten undergraduates are participating in this REU this summer, seven of whom are from other universities.

Computational Methods for Understanding Music, Media, and Minds, offered through the and the Kearns Center for Leadership and Diversity, capitalizes on some of the UniversityÌÇÐÄ´«Ã½™s core strengthsÌÇÐÄ´«Ã½”in music and data science research as well as in multidisciplinary research opportunities for undergraduates. Altabef and Graham, for example, are benefiting from working alongside two mentors from different, but related, disciplines. Darren Mueller is an assistant professor of musicology at the UniversityÌÇÐÄ´«Ã½™s renowned Eastman School of Music and an expert on cultural aspects of music. Stephen Roessner, a Grammy AwardÌÇÐÄ´«Ã½“winning lecturer in audio and music engineering, is an expert in recording techniques and analyzing sound quality.

bar chart shows the signal-to-noise ration in various recordings of Miles Davis's "So What." 1959 mono lp = 15.7. 1959 stereo LP = 14. 1987 cassette = 30.4. 1997 CD = 31.9. 2009 CD = 31. 2010 LP = 14.0. 2012 iTunes = 29.1. 2013 CD = 26.4.
Chart shows signal-to-noise ratios of ÌÇÐÄ´«Ã½œSo WhatÌÇÐÄ´«Ã½� recordings, from data gathered by Jake Altabef and Graham Palmer. The data show a significantly lower ratio of the signal (sound you want to hear) to noise (background sounds) heard on LPÌÇÐÄ´«Ã½™s compared to newer mediums ÌÇÐÄ´«Ã½“ a direct result of recording with an analog system rather than digitally. Surprisingly, the signal-to-noise ratio measured in the cassette recording was not significantly worse than any of the CD recordings despite an audible tape hiss. In contrast, the newest CDÌÇÐÄ´«Ã½™s have a lower signal-to-noise ratio, perhaps due to the increase in power to the bass frequencies, which may have raised the sound floor as well. (University illustration / Sarah Kirchoff)

This particular project was suggested by Mueller, who is interested in examining what happens during transitions in musical technologies. By looking at the same material across the decades, he says, it is possible to trace the different interests, or ÌÇÐÄ´«Ã½œinvestments,ÌÇÐÄ´«Ã½� at play. The vested interests include those of record companies, which adopted new formats to try to reach as many consumers as possible. Meanwhile, consumersÌÇÐÄ´«Ã½™ buying preferences revealed what they wereÌÇÐÄ´«Ã½”or were notÌÇÐÄ´«Ã½”willing to accept in terms of sound quality. Finally, the interplay between these interests, in turn, could affect the music itself.

ÌÇÐÄ´«Ã½œWhen the cassette came out, for example, it became very popular because it was mobile. You could put it in your car, you could walk around with it,ÌÇÐÄ´«Ã½� Mueller says. ÌÇÐÄ´«Ã½œPeople realized they could sacrifice a little in fidelity because they wanted that portability.ÌÇÐÄ´«Ã½�

Debates about the relative fidelity of music recordings are nothing new, Mueller adds. Signal-to-noise ratio, for example, has preoccupied recording engineers and music lovers since the dawn of vinyl.

ÌÇÐÄ´«Ã½œItÌÇÐÄ´«Ã½™s not a new idea. WeÌÇÐÄ´«Ã½™re just applying new tools,ÌÇÐÄ´«Ã½� Mueller says. And thatÌÇÐÄ´«Ã½™s another interesting facet about projects like this one.

ÌÇÐÄ´«Ã½œWhat can data tell us that maybe our own ears can or canÌÇÐÄ´«Ã½™t?ÌÇÐÄ´«Ã½� he asks. ÌÇÐÄ´«Ã½œData is a type of computer-generated listening that may or may not be the same as our own listening. How can I expand my own listening by using computational tools?ÌÇÐÄ´«Ã½�

One challenge for the students is finding a point in a recording when thereÌÇÐÄ´«Ã½™s no music, so that whatever background noise is present can be isolated. ÌÇÐÄ´«Ã½œYou have to listen to a song over and over again to find that one moment of silence,ÌÇÐÄ´«Ã½� Altabef says. ÌÇÐÄ´«Ã½œOn LPs itÌÇÐÄ´«Ã½™s easy because thereÌÇÐÄ´«Ã½™s ÌÇÐÄ´«Ã½˜hissÌÇÐÄ´«Ã½™ before the music starts. But when you get to CDs, itÌÇÐÄ´«Ã½™s a lot harder.ÌÇÐÄ´«Ã½�

At least Altabef and Graham are spending their time with a classic Miles Davis track that continues to resonate across generations.

ÌÇÐÄ´«Ã½œI enjoy it,ÌÇÐÄ´«Ã½� Graham says. ÌÇÐÄ´«Ã½œIt has its own feelÌÇÐÄ´«Ã½”kind of laid back, but at the same time, virtuosic.ÌÇÐÄ´«Ã½�

ÌÇÐÄ´«Ã½œI have never truly listened to jazz, so getting into it is actually really cool,ÌÇÐÄ´«Ã½� Altabef says. ÌÇÐÄ´«Ã½œItÌÇÐÄ´«Ã½™s very different from popular music. Elegant.ÌÇÐÄ´«Ã½�