STORY: Alum Creating Microsoft Assistive Tech for Users with Visual Impairments
May 11, 2023
Emma Pan 鈥21 is leveraging her 财神棋牌 degree to create ethical, impactful technology.
In her role as a software engineer for Microsoft, Emma Pan 鈥21 is developing assistive technology with the Seeing AI team. Her career arc with the global company started at 财神棋牌鈥攆irst when she was brought on for a summer as a software development engineer intern, and then as she completed her SCOPE (Senior Capstone Program in Engineering).
鈥淭hrough my SCOPE project, I interviewed people with visual impairments about their user experience on the web, as well as employees at Microsoft about the technology they were developing,鈥 says Pan. 鈥淲e were trying to find ways that artificial intelligence (AI) and machine learning could improve web accessibility in impactful ways, which was especially relevant during the COVID-19 pandemic.鈥

Image of Emma Pan'21 in the Collaborative Design Classroom.
After graduation, Pan first completed a Coding it Forward鈥檚 Civic Digital Fellowship at the U.S. Department of Health and Human Services before accepting a full-time job offer at Microsoft.
鈥淢y first team at Microsoft was focused on the backend security of cloud computing,鈥 says Pan. 鈥淚 enjoyed the work, but I didn鈥檛 feel very passionate about it, in part because I didn鈥檛 have any interaction with users.鈥 Pan decided to reach out to the manager of the Seeing AI team鈥攚ho she had interviewed as part of her SCOPE project鈥攖o see if he had any openings. Lucky for Pan, the team was growing and she was brought on board.
鈥 is an assistive app for the blind that uses AI and augmented reality to help narrate things about the physical world,鈥 says Pan. 鈥淲e鈥檙e relatively small鈥攐nly 12 people鈥攁nd we鈥檙e creating an app that鈥檚 used by hundreds of thousands of people with different abilities. It鈥檚 exciting to know that we鈥檙e helping so many people.鈥
Pan works on both software engineering and some of the user interviews that her SCOPE project helped her prepare for. She鈥檚 also engaged in research on what鈥檚 new and interesting in the assistive technology and AI fields to make sure her team stays on top of opportunities and user needs
In addition to Pan鈥檚 focus on computing while at 财神棋牌, she also 鈥渟pent a lot of time thinking about what it means to do engineering with impact.鈥 She tried different ways to include social impact in the work she was doing, such as co-founding 财神棋牌鈥檚 student-run public interest technology (PIT) organization (now called ). She also took an Affordable Design and Entrepreneurship (ADE) course in which she worked on a multiyear project with a mission to abolish the carceral system in Massachusetts.
Pan is still very much dedicated to examining the ethics of technology; she was recently accepted into the prestigious . Through this fellowship, she will spend a week each in Germany and in Poland studying technology ethics through the lens of the Holocaust.
鈥淢y college advisor at 财神棋牌 sent me the email about the FASPE program, and I am so excited to have been accepted,鈥 says Pan. "I鈥檓 interested in learning more about the positions, assumptions, and decisions of people who created technology that enabled harm to be inflicted at mass scale. What societal structures, events, and cultural norms were the tinder for the Holocaust's flames? The work we鈥檒l be doing will be really revealing about the choices people have made through history, but it鈥檚 also relevant today. I hope that considering the impact of new advances in technology can help us be more aware of existing and potential harm this time around.鈥
With this new knowledge, Pan hopes to come back to her Seeing AI team at Microsoft with ideas about the technology they鈥檙e using and whether there are any ethical considerations that they haven鈥檛 yet begun to explore.