Project Overview
This MR experience focuses on the interaction between music and physical space. By wearing the Meta Quest 3 headset, users can travel through various virtual environments that respond dynamically to their musical input. As users play their instruments, the surrounding virtual world transforms in real-time, creating a unique blend of auditory and visual stimuli. This immersive experience aims to enhance musical expression and creativity by allowing users to see their music come to life in a captivating way.
- Platform: Meta Quest 3 (standalone)
- Genre: MR experience
- Status: In development
Team
Johannes(Xiaokai) Liu
Johannes Liu is a Ph.D. student in Computer Science at the University of Georgia (UGA). He received his Bachelor’s degree in Mathematics and Applied Mathematics from Zhengzhou University and his Master’s degree in Cybersecurity from Huazhong University of Science and Technology (HUST). During his time at HUST, he performed as a violist in the HUST Symphony Orchestra and now plays both violin and viola with the UGA Philharmonia. His research interests span embedded systems, system security, AI security, and computer music. Outside of academia, he enjoys watching Rick and Morty, The Simpsons, and Futurama.
Armaity Katki
Armaity is a Computer Science student at UGA graduating in December 2025. She is a Web Developer for the Office of Research and a student researcher working on steering techniques of Protein Language Models. This past summer, she completed a study abroad program at Oxford and got to explore Europe! Outside of work, she enjoys hiking, baking, playing piano, watching TV-shows, and spending time with friends.
Benjamin Brown
Benjamin is a senior pursuing a B.S. in Computer Science and a B.A. in Music. As a CURO Honors Scholar, he is involved in undergraduate research, currently working on a project to use artificial intelligence to produce piano accompaniment that can automatically follow a soloist. He also works as an undergraduate teaching assistant for computer science classes. Benjamin frequently sings and plays piano for events, concerts, and competitions on and off campus, and he is currently applying to graduate programs in collaborative piano performance across the country for next year.