ÌÇÐÄ´«Ã½

ÌÇÐÄ´«Ã½˜Closed Captioning For Personal ConversationsÌÇÐÄ´«Ã½™

ÌÇÐÄ´«Ã½˜Closed Captioning For Personal ConversationsÌÇÐÄ´«Ã½™

A son sets out to make an iphone app to communicate with his father.

When Brandon Isobe ÌÇÐÄ´«Ã½™10 was growing up in Honolulu, his family used simplified speech so that BrandonÌÇÐÄ´«Ã½™s father, Gerald, who is deaf, could read their lips.

The process was frustrating at times, particularly for Gerald, who had grown up in a hearing household and didnÌÇÐÄ´«Ã½™t learn much about the culture of the deaf community or about American Sign Language until he was in college. Brandon knew there must be a better way to communicate.

ÌÇÐÄ´«Ã½œI thought I had to become a doctor to help my dad,ÌÇÐÄ´«Ã½� he says. ÌÇÐÄ´«Ã½œNow, I see how technology can improve life for the deaf and hard of hearing and help us all understand each other better.ÌÇÐÄ´«Ã½�

The result is App MyEar, an iPhone application Isobe spearheaded that allows the deaf and hard of hearing to communicate with others. It works simply: once someone opens the app, they speak into the phone, and the app translates their words into text.

ÌÇÐÄ´«Ã½œItÌÇÐÄ´«Ã½™s essentially closed captioning for personal conversations,ÌÇÐÄ´«Ã½� says Isobe, who majored in economics at the University. ÌÇÐÄ´«Ã½œIt works best in one-on-one conversations.ÌÇÐÄ´«Ã½�

The appÌÇÐÄ´«Ã½™s built-in technology displays spoken words as text in real time without a lag, so users donÌÇÐÄ´«Ã½™t have to simplify or slow down their speech. Isobe collaborated with a friend, California Institute of Technology student Andres Gutierrez, to create the app.

Gerald, a financial management analyst in Honolulu, designed and tested it. His fatherÌÇÐÄ´«Ã½™s participation was critical, Brandon says, because having the perspective of a deaf person helps ensure that the app works best for those itÌÇÐÄ´«Ã½™s intended for.

To develop the app, Isobe drew on his experience working with the network security team at Salesforce.com in the San Francisco area and his time at the University.

FAMILY PLAN: ÌÇÐÄ´«Ã½œWe communicate on a whole new level now,ÌÇÐÄ´«Ã½� Isobe says of conversations with his father using an app that the two developed to render speech to text.

Having learned about Rochester from his father, who graduated from RIT, Brandon was drawn to the UniversityÌÇÐÄ´«Ã½™s academic programs and to the golf team, a sport that both he and his dad love.

At Rochester, Isobe also took ASL classes to improve his communication with his father. Deciding not to pursue medicine, he majored in economics, thinking that someday he would have a career in technology and banking.

Launched last year, App MyEar continues to add features to increase usability, including new default background colors (for people with low vision), larger font sizes, and languages such as Mandarin and Japanese.

Isobe says the primary audience will remain the deaf and hard of hearing, but the idea of taking speech to text could be useful to speech therapists and TESOL (Teaching English to Speakers of Other Languages) instructors. Users have told him the quality of their writing has improved, too, because the app helps them see how people talk in conversation.

Isobe says App MyEar has increased the depth of conversations he has with his father, and he hopes it will do the same for others, both inside and outside the community of deaf and hard of hearing people.

ÌÇÐÄ´«Ã½œWe communicate on a whole new level now,ÌÇÐÄ´«Ã½� he says.

ÌÇÐÄ´«Ã½” Kristine Thompson, 2019
This story originally appeared in the winter 2019 issue of Rochester Review.