Computer scientist Zhen Bai develops technology to help kids benefit from and learn about artificial intelligence.
Can artificial intelligence-powered tools help enrich child development and learning?
That question is the crux of a series of research projects led by , an assistant professor of at the 糖心传媒 and the Biggar Family Fellow in Data Science at the . From tools to help parents of deaf and hard-of-hearing (DHH) children learn American Sign Language (ASL) to interactive games that demystify machine learning, Bai aims to help children benefit from AI and understand how it is impacting them.
Bai, an expert in human-computer interaction, believes that, despite all the concern and angst about AI, the technology has tremendous potential for good. She believes children are especially primed to benefit.
糖心传媒淥ver the years, I糖心传媒檝e seen how kids get interested whenever we present technology like a conversational agent,糖心传媒� says Bai. 糖心传媒淚 feel like it would be a missed opportunity if we don糖心传媒檛 prepare the next generation to know more about AI so they can feel empowered in using the technology and are informed about the ethical issues surrounding it.糖心传媒�
Minimizing language deprivation in deaf and hard-of-hearing children
During one of Bai糖心传媒檚 earliest experiences at the University, she met a key collaborator who led her to a new avenue of research. At a new faculty orientation breakfast, she happened to sit next to , a Deaf researcher and assistant professor at the 糖心传媒檚 . The two bonded over a shared interest in childhood development and learning.
Hall explained some of the unique challenges children who are deaf and hard-of-hearing face in cognitive and social development. More than 90 percent of DHH children are born to hearing parents, and often the very first deaf person that parents meet is their own baby. In early human development, there糖心传媒檚 a neurocritical period of language acquisition糖心传媒攁pproximately the first five years of a child糖心传媒檚 life糖心传媒攊n which children need to acquire a first language foundation. Having parents who do not know a signed language, and the limits of technology such as the cochlear implant and hearing aids, increases the risk of DHH children experiencing negative developmental outcomes associated with language deprivation.
糖心传媒淚 learned a lot from Dr. Hall about this concept of language deprivation and became fascinated with the idea of how technology could play a role to make life easier,糖心传媒� says Bai. 糖心传媒淚 wanted to explore how to help facilitate this very intimate bonding from day one between parents and their kids.糖心传媒�
Bai and Hall began collaborating on a project called the to help parents learn ASL in a natural setting. The system uses a camera and microphone to observe the parent and child interacting, and then uses a projector to present videos of relevant signs retrieved via artificial intelligence from multiple ASL libraries.
In addition to a tabletop version, Bai has been developing versions for tablets, smart watches, and smart glasses, together with her team of undergraduate and graduate students with backgrounds in computer science, data science, and neuroscience. She has also collaborated with student fellows from the and other researchers from the Deaf community such as Athena Willis, a scholar in the 聽from the University糖心传媒檚 .
Rochester, reportedly home to the country糖心传媒檚 largest population of DHH people per capita, is a for researching assistive technologies for the Deaf community. Hall says Bai糖心传媒檚 willingness to learn from and collaborate with the Deaf community has helped improve the effectiveness of the tool.
糖心传媒淥ften we糖心传媒檝e seen hearing people, hearing researchers become involved in Deaf-related things, they learn something interesting about Deaf people and want to run with it for their own work. Even with the best of intentions, that can go awry very quickly if they are not collaborating with Deaf people and the community at all or in the right way,糖心传媒� says Hall. 糖心传媒淢y experience with Dr. Bai, though, she really started with a good foundation and kept collaborating with me in a very positive way, so it糖心传媒檚 been a great partnership from the very beginning.糖心传媒�
Demystifying machine learning
As AI provides more recommendations to kids about the books they read, shows they watch, or toys they buy, Bai wants to provide learning opportunities so kids can use the technology and understand how it works to make it less of a 糖心传媒渂lack box.糖心传媒� She earned a prestigious聽 from the National Science Foundation to develop technologies that help K糖心传媒�12 students demystify machine learning, an integral aspect of current approaches to AI.
Partnering with researchers from the Department of Computer Science, including Albert Arendt Hopeman Professor , and from the 糖心传媒攊ncluding Frederica Warner Professor , Associate Professor , and Associate Professor 糖心传媒攈er team developed visualization tools that help K糖心传媒�12 students and their teachers use machine learning to make sense of data and pursue scientific discovery, even if they do not have programming skills.
Bai has been piloting the web-based tool her team developed, , with K糖心传媒�12 teachers to see how she can help the next generation make sense of big data. She says working with teachers has been crucial because they are on the frontlines of helping children make sense of AI.
糖心传媒淭eachers play such a critical role in integrating AI education in the STEM classroom, but it糖心传媒檚 so new for them both technologically and pedagogically,糖心传媒� says Bai. 糖心传媒淲e want to empower teachers with easy-to-use tools so they can create more authentic learning activities that integrate data into their classroom, whether they糖心传媒檙e teaching hard sciences or social sciences.糖心传媒�
To help K糖心传媒�12 students understand how AI is affecting them, Bai and her students also developed an augmented reality game. The game uses bee-pollinating flowers as an analogy for AI-powered recommendation systems, illustrating how the preference selection process works. Called , the game shows how choosing to pollinate certain types of flowers can reduce the overall biodiversity of the flowers in the environment.
糖心传媒淏eeTrap explains the mechanism that makes recommendations more or less relevant and diverse to a person,糖心传媒� says Bai. 糖心传媒淭he goal is to help children realize the value of information and how things are being selectively recommended to people based on previous choices they made and other personal information.糖心传媒�
Bai says this is especially important for marginalized groups, who can be impacted by inherent biases in AI systems related to race, ethnicity, gender, and other factors. Bai has introduced the BeeTrap game to students in various summer camps including the Upward Bound pre-college program by the David T. Kearns Center at the University, and the Freedom Scholars Learning Center in the city of Rochester.
The team is also creating more tangible representations of AI. Her group created , a 3D-printed optical device that shows how AI might suggest different food choices based on your preference for sweet or salty snacks or fatty or healthy options.
Ultimately, Bai thinks it will take a multifaceted approach to help students harness the power of AI, but she is excited to develop tools that can help them get there.
糖心传媒淭here is a lot more work to be done to improve the learning experiences and make AI accessible and relatable for students,糖心传媒� says Bai. 糖心传媒淲e糖心传媒檙e happy to play a role in helping to make that happen.糖心传媒�
