UTSA research shaping future of accessible virtual reality

APRIL 10, 2025 — UTSA researchers are leading a $1.2 million project funded over three years by the National Science Foundation to make virtual reality (VR) universally accessible. Their research aims to revolutionize VR experiences for people with balance impairments, a condition that affects an estimated 69 million people in the U.S. alone.

The project, titled Adaptive Auditory Feedback to Improve Balance in Virtual Reality at Home, is led by Professor John Quarles and Assistant Professor Kevin Desai from the UTSA Department of Computer Science and Professor Alberto Cordova from the university’s Department of Kinesiology.

The trio is teaming up to find a solution that would enable individuals with balance challenges to more regularly enjoy the benefits of VR, including rehabilitation, education and fitness. Their work will be especially helpful for people with neurological disorders, vestibular disfunction and the elderly.

“This project is all about improving VR to enable people to have a better quality of life.”

The UTSA researchers are developing specialized audio feedback — sounds or noises controlled with artificial intelligence (AI) — to improve a VR user’s balance. Quarles, Desai and Cordova examined several auditory techniques, including sending white noise signals through headphones, to see if these sounds could help reduce a person’s imbalance.

Desai says the team’s preliminary research demonstrated that some auditory signals, such as white noise, did help people improve their balance.

“This specific project is going to be very exciting, because the end goal of this is to provide a means for people to use the VR devices at home, not just in lab environments,” he said. “This project is all about improving VR to enable people to have a better quality of life."

In phase one of the research study, conducted in UTSA’s San Pedro I Building, participants are secured in a harness as they stand on a balancing board wearing a VR headset and a special suit. A camera system surrounds them, capturing their every move from multiple angles to study their balance. The data that the researchers collect is used to create and fine-tune AI models.

These models are then used in a VR environment to provide auditory signals that ensure the individual is steady.

Nipa Anjum, a doctoral student in computer science, is one of four UTSA students contributing to the development of a data collection system that is precisely capturing each participant’s pose data. Once the data is gathered, the students will analyze it to estimate each individual’s balance.

“I really feel great to work on this project,” Anjum said. “It was really a new experience for me to work with different types of people, like those with and without disabilities. I feel good about doing something for them.”

— Michelle Gaitan and Tiffany Huertas