You are here

UCF Digital Collections ยป ETD Collection

The Impact of Automation Reliability and Fatigue on Reliance

Download pdf | Full Screen View

Date Issued:
2016
Abstract/Description:
The objective of this research is to inform th(&)#172;(&)#172;e design of dynamic interfaces to optimize unmanned aerial vehicle (UAV) operator reliance on automation. A broad goal of the U.S. military is to improve the ratio of UAV operators to UAVs controlled. Accomplishing this goal requires the use of automation; however, the benefits of automation are jeopardized without appropriate operator reliance. To improve reliance on automation, this effort sought to accomplish several objectives organized into phases. The first phase aimed to validate metrics that could be used to gauge operator fatigue online, to understand how the reliability of automated systems influences subjective and objective responses, and to understand how the impact of automation reliability changes with different levels of fatigue. To that end, this study employed a multiple UAV simulation containing several tasks. Findings for a challenging Image Analysis task indicated a decrease in accuracy and reliance with time. Both accuracy and reliance were lower with an unreliable automated decision making aid (60% reliability) than with a reliable automated decision making aid (86.7% reliability). Further, a significant interaction indicated that reliance diminished more quickly when the automated aid was less reliable. Concerning the identification of possible eye tracking measures for fatigue, metrics for percentage of eye closure (PERCLOS), blinks, fixations, and dwell time registered changes with time on task. Fixation metrics registered reliability differences. The second phase sought to use outcomes from the first phase to build two algorithms, based on eye tracking, to drive continuous diagnostic monitoring, one simple and another complex. These algorithms were intended to diagnose the passive fatigue state of UAV operators and used subjective task engagement as the dependent variable. The simple algorithm used PERCLOS and total dwell time within the automated tasking area. The complex algorithm added percent of cognitive fixations and frequency of express fixations. The complex algorithm successfully predicted task engagement, primarily on the strength of percentage of cognitive fixations and express fixation frequency metrics.
Title: The Impact of Automation Reliability and Fatigue on Reliance.
50 views
18 downloads
Name(s): Wohleber, Ryan, Author
Matthews, Gerald, Committee Chair
Reinerman, Lauren, Committee CoChair
Szalma, James, Committee Member
Funke, Gregory, Committee Member
Jentsch, Florian, Committee Member
University of Central Florida, Degree Grantor
Type of Resource: text
Date Issued: 2016
Publisher: University of Central Florida
Language(s): English
Abstract/Description: The objective of this research is to inform th(&)#172;(&)#172;e design of dynamic interfaces to optimize unmanned aerial vehicle (UAV) operator reliance on automation. A broad goal of the U.S. military is to improve the ratio of UAV operators to UAVs controlled. Accomplishing this goal requires the use of automation; however, the benefits of automation are jeopardized without appropriate operator reliance. To improve reliance on automation, this effort sought to accomplish several objectives organized into phases. The first phase aimed to validate metrics that could be used to gauge operator fatigue online, to understand how the reliability of automated systems influences subjective and objective responses, and to understand how the impact of automation reliability changes with different levels of fatigue. To that end, this study employed a multiple UAV simulation containing several tasks. Findings for a challenging Image Analysis task indicated a decrease in accuracy and reliance with time. Both accuracy and reliance were lower with an unreliable automated decision making aid (60% reliability) than with a reliable automated decision making aid (86.7% reliability). Further, a significant interaction indicated that reliance diminished more quickly when the automated aid was less reliable. Concerning the identification of possible eye tracking measures for fatigue, metrics for percentage of eye closure (PERCLOS), blinks, fixations, and dwell time registered changes with time on task. Fixation metrics registered reliability differences. The second phase sought to use outcomes from the first phase to build two algorithms, based on eye tracking, to drive continuous diagnostic monitoring, one simple and another complex. These algorithms were intended to diagnose the passive fatigue state of UAV operators and used subjective task engagement as the dependent variable. The simple algorithm used PERCLOS and total dwell time within the automated tasking area. The complex algorithm added percent of cognitive fixations and frequency of express fixations. The complex algorithm successfully predicted task engagement, primarily on the strength of percentage of cognitive fixations and express fixation frequency metrics.
Identifier: CFE0006548 (IID), ucf:51323 (fedora)
Note(s): 2016-05-01
Ph.D.
Sciences, Dean's Office GRDST
Doctoral
This record was generated from author submitted information.
Subject(s): fatigue -- automation reliability -- automation -- eye tracking
Persistent Link to This Record: http://purl.flvc.org/ucf/fd/CFE0006548
Restrictions on Access: campus 2021-11-15
Host Institution: UCF

In Collections