NASA NSF REU Project
During the summer of 2023, I participated in a research project funded by the National Science Foundation with Noah Hightower under the guidance of A. Sadeghi and Dr. J. Cecil. At the end of the internship, we presented our findings at the OSU summer research symposium.
Images
Background
The virtual environment was created using the Unity 3D engine, and models were created using Blender 3D software or obtained directly from the NASA website. The MR environment was implemented using the Microsoft HoloLens2 platform).
​
For this project, we created two separate simulation environments: the first (descriptive VLE) introduces users to the steps in the rock sample collection process using either voice or text-based cues and instructions. The second focuses on facilitating assessment activities related to studying the impact of HCI elements on participant’s cognition (comprehension and understanding).
​
Human-computer interaction (HCI) investigates how humans interact with computers to determine how computers can be improved to enhance learning. Thus, for VLEs to provide the greatest benefit to users, HCI elements must be examined and optimized to make the simulation environment as conducive as possible to acquiring information.
Research Objectives
1. Create a mixed-reality simulation-based training environment introducing users to the sample-gathering process of the Mars Perseverance rover.
​
2. Determine how altering HCI attributes such as audio versus text-based instructions, light, and color within the simulation impacts cognitive response as well as perception of the 3D elements within the simulation. One specific thrust is to explore ways to improve the readability of the data/information displayed on the 3D screen when using a Mixed Reality headset such as the HL2.
In the first phase of the assessment, the focus was studying the effectiveness of text-based instructions versus audio instructions on comprehension of a target process in a VR simulation environment.
​
•Participants were randomly assigned to interact with either the simulation with text instructions or the simulation with audio instructions
•Participants then completed a short post-test evaluating their comprehension of the target process they were introduced to in the simulation
•The NASA Task Load Index (TLX) will be used to assess other HCI elements such as cognitive load, user-friendliness of interfaces, etc.
Subsequently, we will conduct statistical analysis to determine whether there is a significant difference in results between
Results
Of the 10 students and residents who have participated in the study so far, most have demonstrated increased understanding of the rover’s sample-gathering process after experiencing the simulation environment with visual instruction panels.