We investigate the real-time estimation of human situation awareness using observations from a robot team- mate with limited visibility. In human factors and human- autonomy teaming, it is recognized that individuals navigate their environments using an internal mental simulation, or mental model. The mental model informs cognitive processes including situation awareness, contextual reasoning, and task […]
Richard Agbeyibor, Vedant Ruia, and Jack Kolb get their paper accepted at the 2024 IEEE/AIAA Digital Avionics Systems Conference (DASC)
Many aviation missions today are accomplished by a heterogeneous crew of pilots and mission specialists. As fully Automated Pilots (AP) are integrated into aviation crews, effective teaming will be necessary for safety assurance and mission effectiveness. This flight simulator study explored teaming between a non-pilot human operator and an AP collaborating on a maritime Intelligence, […]
Richard Agbeyibor, Vedant Ruia, and Jack Kolb get their paper accepted at the 2024 Human Factors and Ergonomics Society (HFES) Conference
This study explores human-autonomy collaboration between a future autonomous pilot and a human crew member pursuing a joint Intelligence, Surveillance, and Reconnaissance (ISR) mission. We introduce a novel open-sourced autonomous ISR interaction domain simulating real-world scenarios. As aviation increasingly integrates autonomy, our focus lies in understanding how various autonomous capabilities and interface features affect trust, […]
Richard Agbeyibor, Vedant Ruia, and Jack Kolb get their publication accepted at the AIAA Aviation Forum and ASCEND
The maturation of autonomy for electric vertical take-off and landing aircraft will soon make it possible to execute military intelligence, surveillance, reconnaissance (ISR) missions aboard crewed autonomous aerial vehicles. This research experimentally investigates factors that may influence the quality of interaction (i.e., team fluency) between a non-pilot human operator and the AI pilot responsible for […]
Exploring Shared Mental Models in Household Human-Robot Teams
In human-human teams, we often infer the situation awareness of our teammates to inform our planning and decision-making. What if we applied this to human-AI teams? This project explores how autonomous systems can estimate the belief states of human teammates. We deploy a robot agent to a collaborative household cooking domain, where the agent constructs […]
Jack Kolb completes his Thesis Proposal
February 1, 2024: Jack Kolb completes his thesis proposal on “Applying User Cognitive State to Human-Robot Interaction and Role Assignment” Abstract: Robots are increasingly deployed to support individuals in high-workload or closely collaborative environments across various operational domains. However, limited research has explored how robots can actively leverage a user’s cognitive state to personalize their […]
Jack Kolb presents at IEEE Conference on Robot & Human Interactive Communication
Jack presented his work on comparing the impacts of False Positive and False Negative recommendation errors in a structured shared decision making domain (mars rover landing) at the 2023 IEEE Conference on Robot & Human Interactive Communication (RO-MAN).