FEBRUARY 21, 2020 — Researchers at UTSA are working to identify the best approach to help children operate augmented reality technology. According to UTSA computer science experts, a major barrier to wider adoption of AR for experiential learning is that designs tend to be geared toward adults’ voice or gesture commands.
By conducting in-classroom testing among elementary school students, UTSA researchers have uncovered that AR programs are best delivered using controller commands, followed by programs that communicate with age-specific language.
“The majority of AR programs urge users to speak commands such as ‘select,’ but a child doesn’t necessarily communicate in this manner,” said John Quarles, study co-author and an associate professor in UTSA’s Department of Computer Science. “We have to create AR experiences that are designed with a child in mind. It’s about making experiential learning grow and adapt with the intended user. Currently, many voice commands are built to recognize adult voices but not children’s.”
—BRITA MUNSINGER, Ph.D. Student in Computer Science
Quarles, along with project co-lead Brita Munsinger, designed the research study to replace more complex word instructions with easier commands that would be best understood by the younger subjects. This allowed the children to reduce time and error in completing a series of tasks.
“One of my favorite parts of working in human-computer interaction is the impact your work can have,” Munsinger said. “Any time someone uses technology there’s an opportunity to improve how they interact with it. With this project we hope to eventually make augmented reality a useful tool for teaching STEM subjects to kids.”
The UTSA study was conducted in classrooms with children ages 9–11 who wore Microsoft HoloLens smart glasses and were then asked to complete a series of tasks.
In the analysis students by far exhibited fewer errors, less fatigue and higher usability when interaction with AR was based on completing tasks that relied on hardware controllers. Voice and gesture selection both took longer than controller selection.
Children’s fatigue levels also were highest when participants had to make gesture commands. Moreover, this modality was the least usable interaction, while controller was rated highest on usability.
According to a 2019 Deloitte report on the state of AR, investments into this segment of digital reality will be led by the U.S. and estimated over $3.5 billion.
Quarles, who serves as director of the San Antonio Virtual Environments Lab at UTSA and whose areas of research focus include human-computer interaction and virtual, augmented and mixed realities, has developed virtual reality programs for children with learning disabilities.
“We hope that with this study,” Quarles said, “will serve as a launching point to improve the future immersive learning tools in our classrooms.”
UTSA Today is produced by University Communications and Marketing, the official news source of The University of Texas at San Antonio. Send your feedback to news@utsa.edu. Keep up-to-date on UTSA news by visiting UTSA Today. Connect with UTSA online at Facebook, Twitter, Youtube and Instagram.
All UTSA students, faculty, staff, alumni, and families are invited to march with the UTSA delegation in San Antonio's 38th annual Martin Luther King, Jr. March. Free transportation will be provided from the Main and Downtown Campuses.
Dr. Martin Luther King, Jr. Academy, 3501 Martin Luther King, Jr., San Antonio, TXJoin the UTSA Alumni Association for free coffee and breakfast to celebrate the start of the fall semester.
Sombrilla PlazaWarm up with a hot cup of coffee or a hot chocolate with Wellbeing Services to kick off the start of the Spring Semester! The Wellbeing team will be in the Window Lounge to welcome you to the first day of classes and highlight our events and programs for the semester.
Dreamers Resource Lounge, Main CampusJoin us in the HCAP Student Success Center for refreshments and get to know your HCAP Ambassadors, Peer Mentors, and staff!
HCAP Student Success Center (MS 2.02.36), Main CampusKlesse College is excited to welcome back our Klesse College of Engineering and Integrated Design students! Join us for a fun day full of community, food, and fun events. Food is free for all KCEID Students. Come get your T-shirts and connect with student organizations.
Atrium, Biotechnology, Sciences and Engineering Building, Main CampusStop by the Alvarez Student Success Center to learn about our services, meet our staff, and grab some goodies! Students can earn Career Compass spirit points by taking a photo with our frame and uploading it to the app.
Alvarez Student Success Center (BB 2.01.08,) Business Building, Main CampusCome meet student organizations and learn about different volunteering opportunities at the Spring 2025 Get Involved Fair.
HSU Ballroom (HSU 1.104-1.106,) Main CampusThe University of Texas at San Antonio is dedicated to the advancement of knowledge through research and discovery, teaching and learning, community engagement and public service. As an institution of access and excellence, UTSA embraces multicultural traditions and serves as a center for intellectual and creative resources as well as a catalyst for socioeconomic development and the commercialization of intellectual property - for Texas, the nation and the world.
To be a premier public research university, providing access to educational excellence and preparing citizen leaders for the global environment.
We encourage an environment of dialogue and discovery, where integrity, excellence, inclusiveness, respect, collaboration and innovation are fostered.
UTSA is a proud Hispanic Serving Institution (HSI) as designated by the U.S. Department of Education .
The University of Texas at San Antonio, a Hispanic Serving Institution situated in a global city that has been a crossroads of peoples and cultures for centuries, values diversity and inclusion in all aspects of university life. As an institution expressly founded to advance the education of Mexican Americans and other underserved communities, our university is committed to promoting access for all. UTSA, a premier public research university, fosters academic excellence through a community of dialogue, discovery and innovation that embraces the uniqueness of each voice.
