View All Items

Title: Transparency and Communication Patterns in Human-Robot Teaming.
Creator: Lakhmani, Shan, Barber, Daniel, Jentsch, Florian, Reinerman, Lauren, Guznov, Svyatoslav, University of Central Florida
Abstract / Description: In anticipation of the complex, dynamic battlefields of the future, military operations are increasingly demanding robots with increased autonomous capabilities to support soldiers. Effective communication is necessary to establish a common ground on which human-robot teamwork can be established across the continuum of military operations. However, the types and format of communication for mixed-initiative collaboration is still not fully understood. This study explores two approaches to...
Show moreIn anticipation of the complex, dynamic battlefields of the future, military operations are increasingly demanding robots with increased autonomous capabilities to support soldiers. Effective communication is necessary to establish a common ground on which human-robot teamwork can be established across the continuum of military operations. However, the types and format of communication for mixed-initiative collaboration is still not fully understood. This study explores two approaches to communication in human-robot interaction, transparency and communication pattern, and examines how manipulating these elements with a robot teammate affects its human counterpart in a collaborative exercise. Participants were coupled with a computer-simulated robot to perform a cordon-and-search-like task. A human-robot interface provided different transparency types(-)about the robot's decision making process alone, or about the robot's decision making process and its prediction of the human teammate's decision making process(-)and different communication patterns(-)either conveying information to the participant or both conveying information to and soliciting information from the participant. This experiment revealed that participants found robots that both conveyed and solicited information to be more animate, likeable, and intelligent than their less interactive counterparts, but working with those robots led to more misses in a target classification task. Furthermore, the act of responding to the robot led to a reduction in the number of correct identifications made, but only when the robot was solely providing information about its own decision making process. Findings from this effort inform the design of next-generation visual displays supporting human-robot teaming.
Show less
Date Issued: 2019
Identifier: CFE0007481, ucf:52674
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0007481

Title: Simultaneous Use of Physiological Sensors for a Neuromarketing Task.
Creator: Descheneaux, Charles, Reinerman, Lauren, Barber, Daniel, Karwowski, Waldemar, Goldiez, Brian, University of Central Florida
Abstract / Description: ABSTRACTPhysiological measurements have become more popular in Psychological research over the past ten years. These advancements allowed different objective sensors to become another measurement tool in a scientific arsenal of collecting data. Traditionally, performance and after task subjective measures have been used for most studies in Psychological research. With the opportunity to use these subjective measures along with objective measures, more data can be collected during research and...
Show moreABSTRACTPhysiological measurements have become more popular in Psychological research over the past ten years. These advancements allowed different objective sensors to become another measurement tool in a scientific arsenal of collecting data. Traditionally, performance and after task subjective measures have been used for most studies in Psychological research. With the opportunity to use these subjective measures along with objective measures, more data can be collected during research and therefore potentially produce better quality conclusions.Eye Tracking (ET), functional near infrared (fNIR), transcranial Doppler ultrasound (TCD), electrocardiogram (EKG) and the electroencephalogram (EEG) have shown great promise in their ability to produce reliable and powerful objective data for research. Consequently, these devices are being used at the same time. The simultaneous use has the potential for interference between devices. Further, these devices are used on human subjects who can find these devices uncomfortable. These issues have the ability to skew data simply due to the measurement devices used.The effort of this study was to determine if the above devices could be used simultaneously without affecting their data quality, determine if difference combinations are more or less beneficial and determine if the combination of sensors have an effect on participant experience. A negative effect from discomfort has the potential to effect data. A study was conducted utilizing the ET, EEG, EKG, fNIR and TCD together in various combinations and also alone to determine if data is compromised and to determine if the combinations have an effect on participant experience.
Show less
Date Issued: 2018
Identifier: CFE0007323, ucf:52130
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0007323

Title: A study of nonlinear dynamics of EEG responses to simulated unmanned vehicle tasks.
Creator: Xu, Ziqing, Karwowski, Waldemar, Hancock, Peter, Reinerman, Lauren, Mikusinski, Piotr, University of Central Florida
Abstract / Description: In the contemporary world, mental workload becomes higher as technology evolves and task demand becomes overwhelming. The operators of a system are usually required to complete tasks with higher complicity within a shorter period of time. Continuous operation under a high level of mental workload can be a major source of risk and human error, thus put the operator in a hazardous working environment. Therefore, it is necessary to monitor and assess mental workload. In this study, an unmanned...
Show moreIn the contemporary world, mental workload becomes higher as technology evolves and task demand becomes overwhelming. The operators of a system are usually required to complete tasks with higher complicity within a shorter period of time. Continuous operation under a high level of mental workload can be a major source of risk and human error, thus put the operator in a hazardous working environment. Therefore, it is necessary to monitor and assess mental workload. In this study, an unmanned vehicle operation with visual detection tasks was investigated by means of nonlinear analysis of EEG time series. Nonlinear analysis is considered more advantageous compared with traditional power spectrum analysis of EEG. Besides, nonlinear analysis is more capable to capture the nature of EEG data and human performance, which is a process that subjects to constant changes. By examining the nonlinear dynamics of EEG, it is more likely to obtain a deeper understanding of brain activity.The objective of this study is to investigate the mental workload under different task levels through the examination of brain activity via nonlinear dynamics of EEG time series in simulated unmanned ground vehicle visual detection tasks.The experiment was conducted by the team lead by Dr. Lauren Reinerman Jones at Institute for Simulation (&) Training, University of Central Florida. One hundred and fifty subjects participated the experiment to complete four visual detection task scenarios (1) change detection, (2) threat detection task, (3) dual task with different change detection task rates, and (4) dual task with different threat detection task rates. Their EEG was recorded during performing the tasks at nine EEG channels. This study develops a massive data processing program to calculate the largest Lyapunov exponent, correlation dimension of the EEG data. This study also develops the program for performing 0-1 test on the EEG data in Python language environment. The result of this study verifies the existence of chaotic dynamics in EEG time series, reveals the change in brain activity as the effect of changing task demand in more detailed level, and obtains new insights from the psychophysiological mental workload measurement used in the preliminary study. The results of this study verified the existence of the chaotic dynamics in the EEG time series. This study also supported the hypothesis that EEG data exhibits change in the level of nonlinearity corresponding to differed task levels. The nonlinear analysis of EEG time series data is able to discriminate the change in brain activity derived from the changes in task load. All nonlinear dynamics analysis techniques used in this study is able to find the difference of nonlinearity in EEG among task levels, as well as between single task scenario and dual task scenario.
Show less
Date Issued: 2019
Identifier: CFE0007558, ucf:52615
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0007558

Title: Developing an Insider Threat Experimental Environment.
Creator: Ortiz, Eric, Reinerman, Lauren, Matthews, Gerald, Fanfarelli, Joseph, Nicholson, Denise, University of Central Florida
Abstract / Description: Simulated, 3D gaming environments have been used for a wide-range of applications including training, entertainment, and experimentation in an assortment of domains for some time. This can be attributed to their unique ability to emulate multifaceted situations that may be difficult to control, while affording participants the opportunity to operate in a relatively safe environment. In cybersecurity research, investigation of insider threat behavior is an endeavor that has received little...
Show moreSimulated, 3D gaming environments have been used for a wide-range of applications including training, entertainment, and experimentation in an assortment of domains for some time. This can be attributed to their unique ability to emulate multifaceted situations that may be difficult to control, while affording participants the opportunity to operate in a relatively safe environment. In cybersecurity research, investigation of insider threat behavior is an endeavor that has received little attention in terms of available environments and resources for experimental manipulation. This research effort aimed to close this gap. A simulated, 3D gaming environment and accompanying scenarios were developed for utilization as a research application for a verification study. These constitute crucial components for proper development of insider threat detection tools and training applications. The aim was to use knowledge of performance, user stress state, and user perceptions of the simulation's graphic and usability qualities to verify the simulation for use in insider threat detection work. The objective of this simulated, 3D gaming environment and scenarios was to serve as a realistic and valid context for the development of insider threat identification methods. The scenario narrative involved a reenactment of computer system exploitation by an employee who is trying to acquire private financial information without authorization. In each scenario, the participant assumed the role of a financial investigator employed at a large financial institution. There were two conditions associated with this verification study (control and insider threat). Participants in the control condition performed all of their tasking as regular bank employees while participants assigned to the insider threat condition had to carry out a portion of their tasking as an insider threat.Findings indicated that participants found the simulated, 3D gaming environment engaging, and the simulations graphics usable and immersive. Additionally, the role manipulation resulted in a significant difference in the time it took to perform critical tasking (tasking that was illicit in the insider threat condition). Role manipulation did not produce significant differences in stress between conditions, but it was influential regarding the perceptions of the stress sources. The results suggest that this simulated, 3D gaming environment meets the needs of insider threat investigation and can be used to advance understanding of the nature of insider threat behavior.
Show less
Date Issued: 2017
Identifier: CFE0007131, ucf:52309
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0007131

Title: Evaluating Human-Robot Implicit Communication through Human-Human Implicit Communication.
Creator: Richardson, Andrew, Karwowski, Waldemar, Hancock, Peter, Shumaker, Randall, Reinerman, Lauren, University of Central Florida
Abstract / Description: Human-Robot Interaction (HRI) research is examining ways to make human-robot (HR) communication more natural. Incorporating natural communication techniques is expected to make HR communication seamless and more natural for humans. Humans naturally incorporate implicit levels of communication, and including implicit communication in HR communication should provide tremendous benefit. The aim for this work was to evaluate a model for human-robot implicit communication. Specifically, the...
Show moreHuman-Robot Interaction (HRI) research is examining ways to make human-robot (HR) communication more natural. Incorporating natural communication techniques is expected to make HR communication seamless and more natural for humans. Humans naturally incorporate implicit levels of communication, and including implicit communication in HR communication should provide tremendous benefit. The aim for this work was to evaluate a model for human-robot implicit communication. Specifically, the primary goal for this research was to determine whether humans can assign meanings to implicit cues received from autonomous robots as they do for identical implicit cues received from humans.An experiment was designed to allow participants to assign meanings to identical, implicit cues (pursuing, retreating, investigating, hiding, patrolling) received from humans and robots. Participants were tasked to view random video clips of both entity types, label the implicit cue, and assign a level of confidence in their chosen answer. Physiological data was tracked during the experiment using an electroencephalogram and eye-tracker. Participants answered workload and stress measure questionnaires following each scenario.Results revealed that participants were significantly more accurate with human cues (84%) than with robot cues (82%), however participants were highly accurate, above 80%, for both entity types. Despite the high accuracy for both types, participants remained significantly more confident in answers for humans (6.1) than for robots (5.9) on a confidence scale of 1 - 7.Subjective measures showed no significant differences for stress or mental workload across entities. Physiological measures were not significant for the engagement index acrossentity, but robots resulted in significantly higher levels of cognitive workload for participants via the index of cognitive activity.The results of this study revealed that participants are more confident interpreting human implicit cues than identical cues received from a robot. However, the accuracy of interpreting both entities remained high. Participants showed no significant difference in interpreting different cues across entity as well. Therefore, much of the ability of interpreting an implicit cue resides in the actual cue rather than the entity. Proper training should boost confidence as humans begin to work alongside autonomous robots as teammates, and it is possible to train humans to recognize cues based on the movement, regardless of the entity demonstrating the movement.
Show less
Date Issued: 2012
Identifier: CFE0004429, ucf:49352
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0004429

Title: Simulation-Based Cognitive Workload Modeling and Evaluation of Adaptive Automation Invoking and Revoking Strategies.
Creator: Rusnock, Christina, Geiger, Christopher, Karwowski, Waldemar, Xanthopoulos, Petros, Reinerman, Lauren, University of Central Florida
Abstract / Description: In human-computer systems, such as supervisory control systems, large volumes of incoming and complex information can degrade overall system performance. Strategically integrating automation to offload tasks from the operator has been shown to increase not only human performance but also operator efficiency and safety. However, increased automation allows for increased task complexity, which can lead to high cognitive workload and degradation of situational awareness. Adaptive automation is...
Show moreIn human-computer systems, such as supervisory control systems, large volumes of incoming and complex information can degrade overall system performance. Strategically integrating automation to offload tasks from the operator has been shown to increase not only human performance but also operator efficiency and safety. However, increased automation allows for increased task complexity, which can lead to high cognitive workload and degradation of situational awareness. Adaptive automation is one potential solution to resolve these issues, while maintaining the benefits of traditional automation. Adaptive automation occurs dynamically, with the quantity of automated tasks changing in real-time to meet performance or workload goals. While numerous studies evaluate the relative performance of manual and adaptive systems, little attention has focused on the implications of selecting particular invoking or revoking strategies for adaptive automation. Thus, evaluations of adaptive systems tend to focus on the relative performance among multiple systems rather than the relative performance within a system.This study takes an intra-system approach specifically evaluating the relationship between cognitive workload and situational awareness that occurs when selecting a particular invoking-revoking strategy for an adaptive system. The case scenario is a human supervisory control situation that involves a system operator who receives and interprets intelligence outputs from multiple unmanned assets, and then identifies and reports potential threats and changes in the environment. In order to investigate this relationship between workload and situational awareness, discrete event simulation (DES) is used. DES is a standard technique in the analysis of systems, and the advantage of using DES to explore this relationship is that it can represent a human-computer system as the state of the system evolves over time. Furthermore, and most importantly, a well-designed DES model can represent the human operators, the tasks to be performed, and the cognitive demands placed on the operators. In addition to evaluating the cognitive workload to situational awareness tradeoff, this research demonstrates that DES can quite effectively model and predict human cognitive workload, specifically for system evaluation.This research finds that the predicted workload of the DES models highly correlates with well-established subjective measures and is more predictive of cognitive workload than numerous physiological measures. This research then uses the validated DES models to explore and predict the cognitive workload impacts of adaptive automation through various invoking and revoking strategies. The study provides insights into the workload-situational awareness tradeoffs that occur when selecting particular invoking and revoking strategies. First, in order to establish an appropriate target workload range, it is necessary to account for both performance goals and the portion of the workload-performance curve for the task in question. Second, establishing an invoking threshold may require a tradeoff between workload and situational awareness, which is influenced by the task's location on the workload-situational awareness continuum. Finally, this study finds that revoking strategies differ in their ability to achieve workload and situational awareness goals. For the case scenario examined, revoking strategies based on duration are best suited to improve workload, while revoking strategies based on revoking thresholds are better for maintaining situational awareness.
Show less
Date Issued: 2013
Identifier: CFE0004927, ucf:49607
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0004927

Title: Comparing Types of Adaptive Automation within a Multi-Tasking Environment.
Creator: Taylor, Grant, Szalma, James, Hancock, Peter, Mouloua, Mustapha, Reinerman, Lauren, University of Central Florida
Abstract / Description: Throughout the many years of research examining the various effects of automation on operator performance, stress, workload, etc., the focus has traditionally been on the level of automation, and the invocation methods used to alter it. The goal of the current study is to instead examine the utilization of various types of automation with the goal of better meeting the operator's cognitive needs, thus improving their performance, workload, and stress. The task, control of a simulated unmanned...
Show moreThroughout the many years of research examining the various effects of automation on operator performance, stress, workload, etc., the focus has traditionally been on the level of automation, and the invocation methods used to alter it. The goal of the current study is to instead examine the utilization of various types of automation with the goal of better meeting the operator's cognitive needs, thus improving their performance, workload, and stress. The task, control of a simulated unmanned robotic system, is designed to specifically stress the operator's visual perception capabilities to a greater degree. Two types of automation are implemented to support the operator's performance of the task: an auditory beep aid intended to support visual perception resources, and a driving aid automating control of the vehicle's navigation, offloading physical action execution resources. Therefore, a comparison can be made between types of automation intended to specifically support the mental dimension that is under the greatest demand (the auditory beep) against those that do not (the driving automation). An additional evaluation is made to determine the benefit of adaptively adjusting the level of each type of automation based on the current level of task demand, as well as the influence of individual differences in personality.Results indicate that the use of the auditory beep aid does improve performance, but also increases Temporal Demand and Effort. Use of driving automation appears to disengage the operator from the task, eliciting a vigilance response. Adaptively altering the level of automation to meet task demands has a mixed effect on performance and workload (reducing both) when the auditory beep automation is used. However, adaptive driving automation is clearly detrimental, causing an increase in workload while decreasing performance. Higher levels of Neuroticism are related to poorer threat detection performance, but personality differences show no indication of moderating the effects of either of the experimental manipulations. The results of this study show that the type of automation implemented within an environment has a considerable impact on the operator, in terms of performance as well as cognitive/emotional state.
Show less
Date Issued: 2012
Identifier: CFE0004340, ucf:49414
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0004340

Title: A System Dynamics Model for Manpower and Technology Implementation Trade-off and Cost Estimation.
Creator: Jiang, Hong, Karwowski, Waldemar, Kincaid, John, Reinerman, Lauren, Ahram, Tareq, University of Central Florida
Abstract / Description: The U.S. Navy has been confronted with budget cuts and constraints during recent years. This reduction in budget compels the U.S. Navy to limit the number of manpower and personnel to control costs. Reducing the total ownership cost (TOC) has become a major topic of interest for the Navy as plans are made for current and future fleets. According to the U.S. Government Accountability Office (GAO, 2003), manpower is the most influential component of determining the life cycle cost of a ship....
Show moreThe U.S. Navy has been confronted with budget cuts and constraints during recent years. This reduction in budget compels the U.S. Navy to limit the number of manpower and personnel to control costs. Reducing the total ownership cost (TOC) has become a major topic of interest for the Navy as plans are made for current and future fleets. According to the U.S. Government Accountability Office (GAO, 2003), manpower is the most influential component of determining the life cycle cost of a ship. The vast majority of the TOC is comprised of operating and support (O(&)S) costs which account for approximately 65 percent of the TOC. Manpower and personnel costs account for approximately 50 percent of O(&)S costs. This research focused on tradeoff analysis and cost estimation between manpower and new technology implementation. Utilizing concepts from System Dynamics Modeling (SDM), System Dynamics Causal Loop diagrams (CLD) were built to identify major factors when implementing new technology, and then stocks and flows diagrams were developed to estimate manpower cost associated with new technology implementation. The SDM base model reflected an 18 months period for technology implementation, and then compared different technology implementation for different scenarios. This model had been tested by the public data from Department of the Navy (DoN) Budget estimates.The objective of this research was to develop a SDM to estimate manpower cost and technology tradeoff analysis associated with different technology implementations. This research will assist Navy decision makers and program managers when objectively considering the impacts of technology selection on manpower and associated TOC, and will provide managers with a better understanding of hidden costs associated with new technology adoption. Recommendations were made for future study in manpower cost estimation of ship systems. In future studies, one particular type of data should be located to test the model for a specific manpower configuration.
Show less
Date Issued: 2013
Identifier: CFE0004869, ucf:49662
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0004869

Title: Investigating the universality and comprehensive ability of measures to assess the state of workload.
Creator: Abich, Julian, Reinerman, Lauren, Lackey, Stephanie, Szalma, James, Taylor, Grant, University of Central Florida
Abstract / Description: Measures of workload have been developed on the basis of the various definitions, some are designed to capture the multi-dimensional aspects of a unitary resource pool (Kahneman, 1973) while others are developed on the basis of multiple resource theory (Wickens, 2002). Although many theory based workload measures exist, others have often been constructed to serve the purpose of specific experimental tasks. As a result, it is likely that not every workload measure is reliable and valid for all...
Show moreMeasures of workload have been developed on the basis of the various definitions, some are designed to capture the multi-dimensional aspects of a unitary resource pool (Kahneman, 1973) while others are developed on the basis of multiple resource theory (Wickens, 2002). Although many theory based workload measures exist, others have often been constructed to serve the purpose of specific experimental tasks. As a result, it is likely that not every workload measure is reliable and valid for all tasks, much less each domain. To date, no single measure, systematically tested across experimental tasks, domains, and other measures is considered a universal measure of workload. Most researchers would argue that multiple measures from various categories should be applied to a given task to comprehensively assess workload. The goal for Study 1 to establish task load manipulations for two theoretically different tasks that induce distinct levels of workload assessed by both subjective and performance measures was successful. The results of the subjective responses support standardization and validation of the tasks and demands of that task for investigating workload. After investigating the use of subjective and objective measures of workload to identify a universal and comprehensive measure or set of measures, based on Study 2, it can only be concluded that not one or a set of measures exists. Arguably, it is not to say that one will never be conceived and developed, but at this time, one does not reside in the psychometric catalog. Instead, it appears that a more suitable approach is to customize a set of workload measures based on the task. The novel approach of assessing the sensitivity and comprehensive ability of conjointly utilizing subjective, performance, and physiological workload measures for theoretically different tasks within the same domain contributes to the theory by laying the foundation for improving methodology for researching workload. The applicable contribution of this project is a stepping-stone towards developing complex profiles of workload for use in closed-loop systems, such as human-robot team interaction. Identifying the best combination of workload measures enables human factors practitioners, trainers, and task designers to improve methodology and evaluation of system designs, training requirements, and personnel selection.
Show less
Date Issued: 2013
Identifier: CFE0005119, ucf:50675
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0005119

Title: An investigation of physiological measures in a marketing decision task.
Creator: Lerma, Nelson, Karwowski, Waldemar, Elshennawy, Ahmad, Xanthopoulos, Petros, Reinerman, Lauren, University of Central Florida
Abstract / Description: The objective of the present study was to understand the use of physiological measures as an alternative to traditional market research tools, such as self-reporting measures and focus groups. For centuries, corporations and researchers have relied almost exclusively on traditional measures to gain insights into consumer behavior. Oftentimes, traditional methods have failed to accurately predict consumer demand, and this has prompted corporations to explore alternative methods that will...
Show moreThe objective of the present study was to understand the use of physiological measures as an alternative to traditional market research tools, such as self-reporting measures and focus groups. For centuries, corporations and researchers have relied almost exclusively on traditional measures to gain insights into consumer behavior. Oftentimes, traditional methods have failed to accurately predict consumer demand, and this has prompted corporations to explore alternative methods that will accurately forecast future sales. One the most promising alternative methods currently being investigated is the use of physiological measures as an indication of consumer preference. This field, also referred to as neuromarketing, has blended the principles of psychology, neuroscience, and market research to explore consumer behavior from a physiological perspective. The goal of neuromarketing is to capture consumer behavior through the use of physiological sensors. This study investigated the extent to which physiological measures where correlated to consumer preferences by utilizing five physiological sensors which included two neurological sensors (EEG and ECG) two hemodynamic sensors (TCD and fNIR) and one optic sensor (eye-tracking). All five physiological sensors were used simultaneously to capture and record physiological changes during four distinct marketing tasks. The results showed that only one physiological sensor, EEG, was indicative of concept type and intent to purchase. The remaining four physiological sensors did not show any significant differences for concept type or intent to purchase.Furthermore, Machine Learning Algorithms (MLAs) were used to determine the extent to which MLAs (Na(&)#239;ve Bayes, Multilayer Perceptron, K-Nearest Neighbor, and Logistic Regression) could classify physiological responses to self-reporting measures obtained during a marketing task. The results demonstrated that Multilayer Perceptron, on average, performed better than the other MLAs for intent to purchase and concept type. It was also evident that the models faired best with the most popular concept when categorizing the data based on intent to purchase or final selection. Overall, the four models performed well at categorizing the most popular concept and gave some indication to the extent to which physiological measures are capable of capturing intent to purchase. The research study was intended to help better understand the possibilities and limitations of physiological measures in the field of market research. Based on the results obtained, this study demonstrated that certain physiological sensors are capable of capturing emotional changes, but only when the emotional response between two concepts is significantly different. Overall, physiological measures hold great promise in the study of consumer behavior, providing great insight on the relationship between emotions and intentions in market research.
Show less
Date Issued: 2015
Identifier: CFE0006345, ucf:51563
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0006345

Title: A Training Effectiveness Evaluation of UH-60A/L Simulated Environments: An Interdisciplinary Approach.
Creator: Goodwin, Martin, Reinerman, Lauren, Szalma, James, Goldiez, Brian, Goldberg, Benjamin, University of Central Florida
Abstract / Description: The U.S. military continues to develop and expand its use of simulation-based aviation training. While traditional simulation-based training continues to be a proven training method, game-based simulation has become more sophisticated and may provide viable training options in some applications. The use of game-based simulation with traditional simulation-based training can potentially reduce costs, enhance return on investment, advance training objectives, and inform future training...
Show moreThe U.S. military continues to develop and expand its use of simulation-based aviation training. While traditional simulation-based training continues to be a proven training method, game-based simulation has become more sophisticated and may provide viable training options in some applications. The use of game-based simulation with traditional simulation-based training can potentially reduce costs, enhance return on investment, advance training objectives, and inform future training environment designs. Current fiscal limitations are driving the need for more efficient training methods, while operational requirements are dictating training protocols that produce optimum levels of readiness. The gap between fiscal constraints and desired training outcomes can be addressed by investigating whether lower-cost, game-based simulations may potentially augment higher-cost, traditional simulation-based training approaches for specific training tasks. Performing a valid investigation of the value of these simulation environments depends on a thorough evaluation of their training effectiveness. However, current approaches to Training Effectiveness Evaluation (TEE) do not adequately address the complete range of factors required to effectively investigate this gap. The present effort leverages research from human performance assessment, neurophenomenology, and instructional science to identify and integrate a set of empirically validated measures that contribute to training effectiveness. From this foundation, an interdisciplinary approach to performing TEEs for simulation training is introduced that addresses the shortcomings of current practices. This approach is validated in a use case involving the evaluation of U.S. Army Aviation collective training.
Show less
Date Issued: 2017
Identifier: CFE0006942, ucf:51671
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0006942

Title: A study of EEG signature associated with Emotional and stress responses due to cyberbullying.
Creator: Alhujailli, Ashraf, Karwowski, Waldemar, Reinerman, Lauren, Hancock, Peter, Wan, Thomas, University of Central Florida
Abstract / Description: The human brain processes vital information regarding human feelings. Prior research has focused on the problems of underage bullying, workplace bullying, burnout, mobbing and, most recently, cyberbullying. Scholars have traditionally examined the adverse outcomes of cyberbullying using subjective measures of stress and emotion for decades. However, very few studies examined cyberbullying using objective measures like EEG. The main goal of this study was to explore the relationship between...
Show moreThe human brain processes vital information regarding human feelings. Prior research has focused on the problems of underage bullying, workplace bullying, burnout, mobbing and, most recently, cyberbullying. Scholars have traditionally examined the adverse outcomes of cyberbullying using subjective measures of stress and emotion for decades. However, very few studies examined cyberbullying using objective measures like EEG. The main goal of this study was to explore the relationship between the brain's EEG, expressed by the power spectral density, and emotions and stress due to two types of cyberbullying, specifically: 1) social exclusion, and 2) verbal harassment. This research also examined how cyberbullying factors of social interaction and publicity affect the emotional and stress responses. EEG data were collected from twenty-nine undergraduate students, aged 18-22, using 10/5 EEG system with 64 channels. Each cyberbullying experimental condition was treated as an independent study. The first study investigated the effects of social exclusion on EEG activity and the related emotional and stress factors while playing a virtual ball-tossing game known as cyberball. EEG results showed significant differences in alpha and beta power in the right posterior brain regions due to social exclusion. There were also significant differences in beta and gamma power in the left anterior brain regions due to social exclusion. The results suggest that EEG activity in the left anterior brain region may be important to identify social exclusion. The second study utilized a hypothetical scenario presented as impolite or complimentary online comments. EEG results showed marginally significant differences in gamma power at right- and left- anterior and midline brain regions due to verbal harassment. The results suggest that changes in gamma power at anterior brain regions might play an essential role in the processing of verbal harassment information. Self-reported measures confirmed that verbal harassment was more distressing than social exclusion.
Show less
Date Issued: 2018
Identifier: CFE0006968, ucf:51628
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0006968

Title: The Impact of Automation and Stress on Human Performance in UAV Operation.
Creator: Lin, Jinchao, Matthews, Gerald, Reinerman, Lauren, Szalma, James, Funke, Gregory, University of Central Florida
Abstract / Description: The United States Air Force (USAF) has increasing needs for unmanned aerial vehicle (UAV) operators. Automation may enable a single operator to manage multiple UAVs at the same time. Multi-UAV operation may require a unique set of skills and the need for new operators calls for targeting new populations for recruitment. The objective of this research is to develop a simulation environment for studying the role of individual differences in UAV operation under different task configurations and...
Show moreThe United States Air Force (USAF) has increasing needs for unmanned aerial vehicle (UAV) operators. Automation may enable a single operator to manage multiple UAVs at the same time. Multi-UAV operation may require a unique set of skills and the need for new operators calls for targeting new populations for recruitment. The objective of this research is to develop a simulation environment for studying the role of individual differences in UAV operation under different task configurations and investigate predictors of performance and stress. Primarily, the study examined the impact of levels of automation (LOAs), as well as task demands, on task performance, stress and operator reliance on automation. Two intermediate LOAs were employed for two surveillance tasks included in the simulation of UAV operation. Task demand was manipulated via the high and low frequency of events associated with additional tasks included in the simulation. The task demand and LOA manipulations influenced task performance generally as expected. The task demand manipulations elicited higher subjective distress and workload. LOAs did not affect operator workload but affected reliance behavior. Also, this study examined the role of individual differences in simulated UAV operation. A variety of individual difference factors were associated with task performance and with subjective stress response. Video gaming experience was linked to lower distress and better performance, suggesting possible transfer of skills. Some gender differences were revealed in stress response, task performance, but all the gender effects became insignificant with gaming experience controlled. Generally, the effects of personality were consistent with previous studies, except some novel findings with the performance metrics. Additionally, task demand was found to moderate the influence of personality factors on stress response and performance metrics. Specifically, conscientiousness was associated with higher subjective engagement and performance when demands were higher. This study supports future research which aims to improve the dynamic interfaces in UAV operation, optimize operator reliance on automation, and identify individuals with the highest aptitude for multi-UAV control.
Show less
Date Issued: 2017
Identifier: CFE0006951, ucf:51630
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0006951

Title: Investigating the Impact of Levels of Experience on Workload During Nuclear Power Plant Operations.
Creator: Harris, Jonathan, Reinerman, Lauren, Karwowski, Waldemar, Hancock, Peter, Barber, Daniel, University of Central Florida
Abstract / Description: The human-machine interface (HMI) of a Nuclear Power Plant (NPP) Main Control Room (MCR) is complex. Understanding HMI factors that influence Reactor Operator (RO) performance and workload when controlling an NPP is important. The Nuclear Regulatory Commission (NRC) began a program of research known as the Human Performance Test Facility (HPTF) with the goal of collecting human performance data to better understand cognitive and physical elements that support safe control room operation. The...
Show moreThe human-machine interface (HMI) of a Nuclear Power Plant (NPP) Main Control Room (MCR) is complex. Understanding HMI factors that influence Reactor Operator (RO) performance and workload when controlling an NPP is important. The Nuclear Regulatory Commission (NRC) began a program of research known as the Human Performance Test Facility (HPTF) with the goal of collecting human performance data to better understand cognitive and physical elements that support safe control room operation. The HPTF team developed an experimental methodology to evaluate workload using perceived ratings, performance measures, and physiological correlates. This methodology focuses on tasks commonly performed during operations in an NPP. These tasks include monitoring plant parameters, following defined procedures, and manipulating controls to change the state of the NPP. O'Hara and colleagues developed a framework for task classification. Reinerman-Jones and colleagues modified this framework such that monitoring and detection are separate task types. The task types (i.e., checking, detection, and response implementation) selected for experimentation are composed of steps within defined operating procedures that are rule-based. Testing workload using sufficient numbers of ROs is impractical due to limited availability. The HPTF has developed the (")equal but different(") principle. This principle attempts to simplify complex tasks, such that novices can perform them and experience equivalent workload trends as an expert would when performing the original task. The validity of using the (")equal but different(") principle with novices in place of experts is uncertain. This research addresses this uncertainty by comparing novices and experts using the (")equal but different(") principle. Novices performed four tasks within each of the three task types using a simplified Instrument and Control (I(&)C) panel and a reduced 3-way communication instruction set. Experts performed the same four tasks within each task type with a fully configured I(&)C panel and a complete 3-way instruction set. Overall, the experts across the three task types tended to rate level of perceived workload lower than novices. However, experts also rated themselves as performing worse for the three task types than novices. Experts performed better than novices when it came to identifying correct I(&)C; however, their 3-way communication performance was worse. Physiological measures from EEG between the two groups were not statistically different. ECG findings did show a slight difference.The methodology and associated findings has applicability for MCR designs and regulation recommendations. Novice populations are easier to access than experts and the present research shows that when properly designed, novices can serve in complex operator positions.
Show less
Date Issued: 2017
Identifier: CFE0006946, ucf:51634
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0006946

Title: Investigation of Tactile Displays for Robot to Human Communication.
Creator: Barber, Daniel, Reinerman, Lauren, Jentsch, Florian, Lackey, Stephanie, Leonessa, Alexander, University of Central Florida
Abstract / Description: Improvements in autonomous systems technology and a growing demand within military operations are spurring a revolution in Human-Robot Interaction (HRI). These mixed-initiative human-robot teams are enabled by Multi-Modal Communication (MMC), which supports redundancy and levels of communication that are more robust than single mode interaction. (Bischoff (&) Graefe, 2002; Partan (&) Marler, 1999). Tactile communication via vibrotactile displays is an emerging technology, potentially...
Show moreImprovements in autonomous systems technology and a growing demand within military operations are spurring a revolution in Human-Robot Interaction (HRI). These mixed-initiative human-robot teams are enabled by Multi-Modal Communication (MMC), which supports redundancy and levels of communication that are more robust than single mode interaction. (Bischoff (&) Graefe, 2002; Partan (&) Marler, 1999). Tactile communication via vibrotactile displays is an emerging technology, potentially beneficial to advancing HRI. Incorporation of tactile displays within MMC requires developing messages equivalent in communication power to speech and visual signals used in the military. Toward that end, two experiments were performed to investigate the feasibility of a tactile language using a lexicon of standardized tactons (tactile icons) within a sentence structure for communication of messages for robot to human communication. Experiment one evaluated tactons from the literature with standardized parameters grouped into categories (directional, dynamic, and static) based on the nature and meaning of the patterns to inform design of a tactile syntax. Findings of this experiment revealed directional tactons showed better performance than non-directional tactons, therefore syntax for experiment two composed of a non-directional and a directional tacton was more likely to show performance better than chance. Experiment two tested the syntax structure of equally performing tactons identified from experiment one, revealing participants' ability to interpret tactile sentences better than chance with or without the presence of an independent work imperative task. This finding advanced the state of the art in tactile displays from one to two word phrases facilitating inclusion of the tactile modality within MMC for HRI.
Show less
Date Issued: 2012
Identifier: CFE0004778, ucf:49800
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0004778

Title: Neurophenomenological Methods: Experiences of Earth and Space in Simulation.
Creator: Morrow, Patricia, Reinerman, Lauren, Cash, Mason, Janz, Bruce, Gallagher, Shaun, University of Central Florida
Abstract / Description: The present study explores the nature and structure of spiritual and aesthetic experiences through the interdisciplinary application of neurophenomenology (NP). This approach merges aspects of psychology, neurophysiology, and phenomenology into a unified methodology. The study is nested within a larger project, Space, Science, and Spirituality, and as such, it carries a common goal to use simulation to evoke spiritual and aesthetic responses similar to those expressed by astronauts and...
Show moreThe present study explores the nature and structure of spiritual and aesthetic experiences through the interdisciplinary application of neurophenomenology (NP). This approach merges aspects of psychology, neurophysiology, and phenomenology into a unified methodology. The study is nested within a larger project, Space, Science, and Spirituality, and as such, it carries a common goal to use simulation to evoke spiritual and aesthetic responses similar to those expressed by astronauts and cosmonauts. Careful analysis of previous work in NP provided methodological (")lessons learned("), which guided the experimental design, execution, and analysis of the present study. The data collected provides support for experience as a phenomenon that can be studied through empirical means. Further, the articulation of spiritual and aesthetic experiences akin to astronaut experiences corresponds to specific neurological and psychological indicators. Among those indicators are differences in EEG measures during simulation time relative to expressions of spiritual experience following the simulation and changes in visual processing across theta, alpha, and beta signals as correlated with self-identification. These findings support an embodied theory of experience that incorporates memory, executive function, perception, and consciousness. In addition to its academic contribution, this research holds implications for commercial space flight, long-term space missions, post-traumatic stress disorder therapies, and the entertainment industry.
Show less
Date Issued: 2013
Identifier: CFE0005035, ucf:50018
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0005035

Title: Integration of Multidimensional Signal Detection Theory with Fuzzy Signal Detection Theory.
Creator: O'Connell, Maureen, Szalma, James, Hancock, Peter, Bohil, Corey, Reinerman, Lauren, University of Central Florida
Abstract / Description: Signal detection theory (SDT) has proven to be a robust and useful statistical model for analyzing human performance in detection and decision making tasks. As with many models extensions have been proposed in order capture and represent the real world to a greater degree. Multidimensional Signal Detection Theory (MSDT) has had success in describing and modeling complex signals, signals that are comprised by more than one identifiable component dimension. Fuzzy Signal Detection Theory (FSDT)...
Show moreSignal detection theory (SDT) has proven to be a robust and useful statistical model for analyzing human performance in detection and decision making tasks. As with many models extensions have been proposed in order capture and represent the real world to a greater degree. Multidimensional Signal Detection Theory (MSDT) has had success in describing and modeling complex signals, signals that are comprised by more than one identifiable component dimension. Fuzzy Signal Detection Theory (FSDT) has had success in modeling and measuring human performance in cases where there exist ambiguity in the signal or response dimension characteristics, through the application of fuzzy set theory to the definition of the performance outcome categories. Multidimensional Fuzzy Signal Detection Theory (MFSDT) was developed to accommodate simultaneously both the multidimensionality of a signal and the fuzzification of outcome categories in order to integrate the two extensions. A series of three studies were performed to develop and test the theory. One study's purpose was to develop and derive multidimensional mapping functions, the aspect of MFSDT where MSDT and FSDT were integrated. Two receiver operating characteristic (ROC) studies were performed, one simulated and one empirical. The results from both ROC analysis indicated that for perceptually separable and perceptually integral complex stimuli that MFDST is a viable methodological approach to analyzing performance of signal detection tasks where there are complex signals with ambiguous signal characteristics.
Show less
Date Issued: 2015
Identifier: CFE0005983, ucf:50763
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0005983

Title: Enhancing the effectiveness of Human-Robot teaming with a closed-loop system.
Creator: Teo, Grace, Szalma, James, Jentsch, Florian, Hancock, Peter, Matthews, Gerald, Reinerman, Lauren, University of Central Florida
Abstract / Description: With the development in robotics and the increasing deployment of robots, human-robot teams are set to be a mainstay in the future. However, our understanding of the effectiveness and impact of this new form of teaming is limited. Previous experience with technology and automa-tion has shown that technological aids do not always result in the intended consequences of im-proved performance and alleviation of workload and stress. No doubt a large part of this is due to the fact that the...
Show moreWith the development in robotics and the increasing deployment of robots, human-robot teams are set to be a mainstay in the future. However, our understanding of the effectiveness and impact of this new form of teaming is limited. Previous experience with technology and automa-tion has shown that technological aids do not always result in the intended consequences of im-proved performance and alleviation of workload and stress. No doubt a large part of this is due to the fact that the relationships among taskload, workload and performance are complex as hu-man operators interact dynamically with tasks and technology. Measures of workload are also varied and differentially sensitive. There is also the added challenge posed by multi-tasking envi-ronments which typify most real-world situations. Given all this, efforts in designing technologi-cal aids, such as an adaptive robot aid in the context of human-robot teaming, would require a workload model that reflects the intricate relationship between taskload and the individual opera-tor's experience of workload. Such a model can then be used to drive a closed-loop system on which adaptive robot aiding can be based. The present research sought to investigate the effec-tiveness of a closed-loop system, based on a model of workload, in enhancing performance in a simulated military mission involving a human-robot team. Results showed that adaptive robot aid driven by workload needs as assessed by physiological measures resulted in greater improve-ments in performance compared to robot aid that was imposed by the system.
Show less
Date Issued: 2015
Identifier: CFE0006403, ucf:51485
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0006403

Title: The Impact of Automation Reliability and Fatigue on Reliance.
Creator: Wohleber, Ryan, Matthews, Gerald, Reinerman, Lauren, Szalma, James, Funke, Gregory, Jentsch, Florian, University of Central Florida
Abstract / Description: The objective of this research is to inform th(&)#172;(&)#172;e design of dynamic interfaces to optimize unmanned aerial vehicle (UAV) operator reliance on automation. A broad goal of the U.S. military is to improve the ratio of UAV operators to UAVs controlled. Accomplishing this goal requires the use of automation; however, the benefits of automation are jeopardized without appropriate operator reliance. To improve reliance on automation, this effort sought to accomplish several objectives...
Show moreThe objective of this research is to inform th(&)#172;(&)#172;e design of dynamic interfaces to optimize unmanned aerial vehicle (UAV) operator reliance on automation. A broad goal of the U.S. military is to improve the ratio of UAV operators to UAVs controlled. Accomplishing this goal requires the use of automation; however, the benefits of automation are jeopardized without appropriate operator reliance. To improve reliance on automation, this effort sought to accomplish several objectives organized into phases. The first phase aimed to validate metrics that could be used to gauge operator fatigue online, to understand how the reliability of automated systems influences subjective and objective responses, and to understand how the impact of automation reliability changes with different levels of fatigue. To that end, this study employed a multiple UAV simulation containing several tasks. Findings for a challenging Image Analysis task indicated a decrease in accuracy and reliance with time. Both accuracy and reliance were lower with an unreliable automated decision making aid (60% reliability) than with a reliable automated decision making aid (86.7% reliability). Further, a significant interaction indicated that reliance diminished more quickly when the automated aid was less reliable. Concerning the identification of possible eye tracking measures for fatigue, metrics for percentage of eye closure (PERCLOS), blinks, fixations, and dwell time registered changes with time on task. Fixation metrics registered reliability differences. The second phase sought to use outcomes from the first phase to build two algorithms, based on eye tracking, to drive continuous diagnostic monitoring, one simple and another complex. These algorithms were intended to diagnose the passive fatigue state of UAV operators and used subjective task engagement as the dependent variable. The simple algorithm used PERCLOS and total dwell time within the automated tasking area. The complex algorithm added percent of cognitive fixations and frequency of express fixations. The complex algorithm successfully predicted task engagement, primarily on the strength of percentage of cognitive fixations and express fixation frequency metrics.
Show less
Date Issued: 2016
Identifier: CFE0006548, ucf:51323
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0006548

Title: The Perception and Measurement of Human-Robot Trust.
Creator: Schaefer, Kristin, Hancock, Peter, Jentsch, Florian, Kincaid, John, Reinerman, Lauren, Billings, Deborah, Lee, John, University of Central Florida
Abstract / Description: As robots penetrate further into the everyday environments, trust in these robots becomes a crucial issue. The purpose of this work was to create and validate a reliable scale that could measure changes in an individual's trust in a robot. Assessment of current trust theory identified measurable antecedents specific to the human, the robot, and the environment. Six experiments subsumed the development of the 40 item trust scale. Scale development included the creation of a 172 item pool. Two...
Show moreAs robots penetrate further into the everyday environments, trust in these robots becomes a crucial issue. The purpose of this work was to create and validate a reliable scale that could measure changes in an individual's trust in a robot. Assessment of current trust theory identified measurable antecedents specific to the human, the robot, and the environment. Six experiments subsumed the development of the 40 item trust scale. Scale development included the creation of a 172 item pool. Two experiments identified the robot features and perceived functional characteristics that were related to the classification of a machine as a robot for this item pool. Item pool reduction techniques and subject matter expert (SME) content validation were used to reduce the scale to 40 items. The two final experiments were then conducted to validate the scale. The finalized 40 item pre-post interaction trust scale was designed to measure trust perceptions specific to HRI. The scale measured trust on a 0-100% rating scale and provides a percentage trust score. A 14 item sub-scale of this final version of the test recommended by SMEs may be sufficient for some HRI tasks, and the implications of this proposition were discussed.
Show less
Date Issued: 2013
Identifier: CFE0004931, ucf:49634
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0004931

EEG (5)	+ -
workload (4)	+ -
TCD (3)	+ -
fNIR (3)	+ -
ECG (2)	+ -

Human-Robot Interaction (2)	+ -
ISR (2)	+ -
automation (2)	+ -
eye tracking (2)	+ -
multiple resource theory (2)	+ -
physiological measures (2)	+ -
3D (1)	+ -
Adaptive Automation (1)	+ -
Automation (1)	+ -
Cognitive Workload (1)	+ -
Cyberbullying (1)	+ -
Cybersecurity (1)	+ -
Discrete-Event Simulation (1)	+ -
EKG (1)	+ -
Eye Tracking (1)	+ -
Fuzzy Signal Detection Theory (1)	+ -
Game-Based Training (1)	+ -
Gaming Environment (1)	+ -
Human Performance Modeling (1)	+ -
Human Robot Interaction (1)	+ -
Human factors (1)	+ -
Human-Agent Teaming (1)	+ -
Human-Robot Communication (1)	+ -
ISA (1)	+ -
Implicit Communication (1)	+ -

Reinerman, Lauren (22)	+ -
University of Central Florida (22)	+ -
Hancock, Peter (9)	+ -
Karwowski, Waldemar (8)	+ -
Szalma, James (8)	+ -

Barber, Daniel (5)	+ -
Jentsch, Florian (5)	+ -
Matthews, Gerald (5)	+ -
Lackey, Stephanie (4)	+ -
Kincaid, John (3)	+ -
Funke, Gregory (2)	+ -
Goldiez, Brian (2)	+ -
Taylor, Grant (2)	+ -
Xanthopoulos, Petros (2)	+ -
Abich, Julian (1)	+ -
Ahram, Tareq (1)	+ -
Alhujailli, Ashraf (1)	+ -
Billings, Deborah (1)	+ -
Bohil, Corey (1)	+ -
Cash, Mason (1)	+ -
Descheneaux, Charles (1)	+ -
Elshennawy, Ahmad (1)	+ -
Fanfarelli, Joseph (1)	+ -
Gallagher, Shaun (1)	+ -
Geiger, Christopher (1)	+ -
Goldberg, Benjamin (1)	+ -
Goodwin, Martin (1)	+ -
Guznov, Svyatoslav (1)	+ -
Harris, Jonathan (1)	+ -
Janz, Bruce (1)	+ -

Search In

Pages

Pages

Sort Results By:

Narrow results by:

Topical Subject

Collection

Type of Resource

Language

Creator

Format

Owner