Current Search:   Lackey, Stephanie (x)

View All Items

  • CSV Spreadsheet
(1 - 8 of 8)
PREDICTION AND ALLOCATION OF LIVE TO VIRTUAL COMMUNICATION BRIDGING RESOURCES
Title
PREDICTION AND ALLOCATION OF LIVE TO VIRTUAL COMMUNICATION BRIDGING RESOURCES.
Creator
lackey, stephanie, Malone, Linda, University of Central Florida
Abstract / Description
This document summarizes a research effort focused on improving live-to-virtual (L-V) communication systems. The purpose of this work is to address a significant challenge facing the tactical communications training community through the development of the Live-to-Virtual Relay Radio Prediction Algorithm and implementation of the algorithm into an Integrated Live-to-Virtual Communications Server prototype device. The motivation for the work and the challenges of integrating live and virtual...
Show moreThis document summarizes a research effort focused on improving live-to-virtual (L-V) communication systems. The purpose of this work is to address a significant challenge facing the tactical communications training community through the development of the Live-to-Virtual Relay Radio Prediction Algorithm and implementation of the algorithm into an Integrated Live-to-Virtual Communications Server prototype device. The motivation for the work and the challenges of integrating live and virtual communications are presented. Details surrounding the formulation of the prediction algorithm and a description of the prototype system, hardware, and software architectures are shared. Experimental results from discrete event simulation analysis and prototype functionality testing accompany recommendations for future investigation. If the methods and technologies summarized are implemented, an estimated equipment savings of 25%-53% and an estimated cost savings of $150,000.00 - $630,000.00 per site are anticipated. Thus, a solution to a critical tactical communications training problem is presented through the research discussed.
Show less
Date Issued
2006
Identifier
CFE0001401, ucf:47072
Format
Document (PDF)
PURL
http://purl.flvc.org/ucf/fd/CFE0001401
Investigating the universality and comprehensive ability of measures to assess the state of workload
Title
Investigating the universality and comprehensive ability of measures to assess the state of workload.
Creator
Abich, Julian, Reinerman, Lauren, Lackey, Stephanie, Szalma, James, Taylor, Grant, University of Central Florida
Abstract / Description
Measures of workload have been developed on the basis of the various definitions, some are designed to capture the multi-dimensional aspects of a unitary resource pool (Kahneman, 1973) while others are developed on the basis of multiple resource theory (Wickens, 2002). Although many theory based workload measures exist, others have often been constructed to serve the purpose of specific experimental tasks. As a result, it is likely that not every workload measure is reliable and valid for all...
Show moreMeasures of workload have been developed on the basis of the various definitions, some are designed to capture the multi-dimensional aspects of a unitary resource pool (Kahneman, 1973) while others are developed on the basis of multiple resource theory (Wickens, 2002). Although many theory based workload measures exist, others have often been constructed to serve the purpose of specific experimental tasks. As a result, it is likely that not every workload measure is reliable and valid for all tasks, much less each domain. To date, no single measure, systematically tested across experimental tasks, domains, and other measures is considered a universal measure of workload. Most researchers would argue that multiple measures from various categories should be applied to a given task to comprehensively assess workload. The goal for Study 1 to establish task load manipulations for two theoretically different tasks that induce distinct levels of workload assessed by both subjective and performance measures was successful. The results of the subjective responses support standardization and validation of the tasks and demands of that task for investigating workload. After investigating the use of subjective and objective measures of workload to identify a universal and comprehensive measure or set of measures, based on Study 2, it can only be concluded that not one or a set of measures exists. Arguably, it is not to say that one will never be conceived and developed, but at this time, one does not reside in the psychometric catalog. Instead, it appears that a more suitable approach is to customize a set of workload measures based on the task. The novel approach of assessing the sensitivity and comprehensive ability of conjointly utilizing subjective, performance, and physiological workload measures for theoretically different tasks within the same domain contributes to the theory by laying the foundation for improving methodology for researching workload. The applicable contribution of this project is a stepping-stone towards developing complex profiles of workload for use in closed-loop systems, such as human-robot team interaction. Identifying the best combination of workload measures enables human factors practitioners, trainers, and task designers to improve methodology and evaluation of system designs, training requirements, and personnel selection.
Show less
Date Issued
2013
Identifier
CFE0005119, ucf:50675
Format
Document (PDF)
PURL
http://purl.flvc.org/ucf/fd/CFE0005119
Cognitive Flexibility: Using Mental Simulation to Improve Script Adaptation
Title
Cognitive Flexibility: Using Mental Simulation to Improve Script Adaptation.
Creator
Rivera, Javier, Jentsch, Florian, Shumaker, Randall, Lackey, Stephanie, Sims, Valerie, University of Central Florida
Abstract / Description
Human behavior and decision-making depend largely on past experiences that generate specific action patterns (i.e., scripts, Gioia (&) Manz, 1985) for specific situations. In an ideal world, in which changes in the environment do not conflict with these action patterns, humans would be able to operate consistently, efficiently, and automatically. However, real-world environments are dynamic and fluid, thus altering behavior and forcing changes in scripts. Research suggests that to implement...
Show moreHuman behavior and decision-making depend largely on past experiences that generate specific action patterns (i.e., scripts, Gioia (&) Manz, 1985) for specific situations. In an ideal world, in which changes in the environment do not conflict with these action patterns, humans would be able to operate consistently, efficiently, and automatically. However, real-world environments are dynamic and fluid, thus altering behavior and forcing changes in scripts. Research suggests that to implement alternate solutions to changing situations, humans select from a (")library(") of learned scripts. Since humans tend to implement scripts to the degree that these are successful over a period of time, implementing alternate scripts can be difficult. That is, unless one has the cognitive flexibility to adapt scripts, implementing a new solution to a problem can be difficult and/or unsuccessful. Cognitive flexibility allows one to restructure knowledge to form an adaptive response to changes set forth by the environment. At issue is the difference between possessing a repertoire of scripts that can be selected and implemented to solve a problem, and having the cognitive flexibility to effectively switch between scripts when a change in context occurs. The purpose of this dissertation is to: (a) evaluate the effectiveness of possessing alternate scripts to respond to situations, and (b) assess the effectiveness of cognitive flexibility training on the ability to switch between scripts. The ultimate goal is to improve mental flexibility in situations where a specific approach should be revised and adjusted to conform to changes in context. A total of 48 participants were randomly assigned to one of four conditions in a 2 (number of scripts) x 2 (training present or absent) design: (a) single script, (b) single script and cognitive flexibility training, (c) two scripts, and (d) two scripts and cognitive flexibility training. Participants either learned one script or two scripts on how to respond to a car engine overheat. In addition, depending on the study condition, participants completed a cognitive flexibility training that used a mental simulation approach. The cognitive flexibility training was intended to allow participants to imagine a number of different scenarios that may impact that task, evaluate assumptions, check assumptions against the situation, imagine a response to such scenarios, and review the effectiveness of the developed solutions. The results of this research suggested that for situations requiring a change or an adaptation to an alternate script, possessing two scripts facilitated correct decision-making, whereas cognitive flexibility training may have hindered decision-making. In addition, for situations requiring a standard script, possessing two scripts was detrimental to decision-making performance, regardless of cognitive flexibility training. Theoretical implications in terms of script-processing and cognitive flexibility, as well as practical implications for training design are provided.
Show less
Date Issued
2016
Identifier
CFE0006381, ucf:51528
Format
Document (PDF)
PURL
http://purl.flvc.org/ucf/fd/CFE0006381
Investigation of Tactile Displays for Robot to Human Communication
Title
Investigation of Tactile Displays for Robot to Human Communication.
Creator
Barber, Daniel, Reinerman, Lauren, Jentsch, Florian, Lackey, Stephanie, Leonessa, Alexander, University of Central Florida
Abstract / Description
Improvements in autonomous systems technology and a growing demand within military operations are spurring a revolution in Human-Robot Interaction (HRI). These mixed-initiative human-robot teams are enabled by Multi-Modal Communication (MMC), which supports redundancy and levels of communication that are more robust than single mode interaction. (Bischoff (&) Graefe, 2002; Partan (&) Marler, 1999). Tactile communication via vibrotactile displays is an emerging technology, potentially...
Show moreImprovements in autonomous systems technology and a growing demand within military operations are spurring a revolution in Human-Robot Interaction (HRI). These mixed-initiative human-robot teams are enabled by Multi-Modal Communication (MMC), which supports redundancy and levels of communication that are more robust than single mode interaction. (Bischoff (&) Graefe, 2002; Partan (&) Marler, 1999). Tactile communication via vibrotactile displays is an emerging technology, potentially beneficial to advancing HRI. Incorporation of tactile displays within MMC requires developing messages equivalent in communication power to speech and visual signals used in the military. Toward that end, two experiments were performed to investigate the feasibility of a tactile language using a lexicon of standardized tactons (tactile icons) within a sentence structure for communication of messages for robot to human communication. Experiment one evaluated tactons from the literature with standardized parameters grouped into categories (directional, dynamic, and static) based on the nature and meaning of the patterns to inform design of a tactile syntax. Findings of this experiment revealed directional tactons showed better performance than non-directional tactons, therefore syntax for experiment two composed of a non-directional and a directional tacton was more likely to show performance better than chance. Experiment two tested the syntax structure of equally performing tactons identified from experiment one, revealing participants' ability to interpret tactile sentences better than chance with or without the presence of an independent work imperative task. This finding advanced the state of the art in tactile displays from one to two word phrases facilitating inclusion of the tactile modality within MMC for HRI.
Show less
Date Issued
2012
Identifier
CFE0004778, ucf:49800
Format
Document (PDF)
PURL
http://purl.flvc.org/ucf/fd/CFE0004778
Investigating Simulation-Based Pattern Recognition Training For Behavior Cue Detection
Title
Investigating Simulation-Based Pattern Recognition Training For Behavior Cue Detection.
Creator
Maraj, Crystal, Lackey, Stephanie, Kincaid, John, Shumaker, Randall, Keebler, Joseph, University of Central Florida
Abstract / Description
The U.S. military uses pattern recognition training to observe anomalies in human behavior. An examination of the pattern recognition training literature for Warfighters reveals a gap in training to discern patterns of human behavior in live environments. Additionally, the current state of warfare is evolving and requires operations to change. As a result, pattern recognition training must accommodate new practices to improve performance. A technique used to improve memory for identifying...
Show moreThe U.S. military uses pattern recognition training to observe anomalies in human behavior. An examination of the pattern recognition training literature for Warfighters reveals a gap in training to discern patterns of human behavior in live environments. Additionally, the current state of warfare is evolving and requires operations to change. As a result, pattern recognition training must accommodate new practices to improve performance. A technique used to improve memory for identifying patterns in the environment is Kim's game. Kim's game establishes patterns to identify inanimate objects, of which information retains in memory for later recall. The paper discusses the fundamental principles of Kim's game applied to virtual Simulation-Based Training. The virtual version of Kim's game contains customized scenarios for training behavior cue analysis. Virtual agents display kinesic cues that exhibit aggressive (i.e., slap hands and clench fist) and nervous behaviors including wring hands and check six. This research takes a novel approach by animating the kinesics cues in the virtual version of Kim's game for pattern recognition training. Detection accuracy, response time, and false positive detection serve as the performance data for analysis. Additional survey data collected include engagement, flow, and simulator sickness. All collected data was compared to a control condition to examine its effectiveness of behavior cue detection. A series of one-way between subjects design ANOVA's were conducted to examine the differences between Kim's game and control on post-test performance. Although, the results from this experiment showed no significance in post-test performance, the percent change in post-test performance provide further insight into the results of the Kim's game and control strategies. Specifically, participants in the control condition performed better than the Kim's game group on detection accuracy and response time. However, the Kim's game group outperformed the control group on false positive detection. Further, this experiment explored the differences in Engagement, Flow, and Simulator Sickness after the practice scenario between Kim's game group and the control group. The results found no significant difference in Engagement, partial significance for Flow, and significant difference for Simulator Sickness between the Kim's game and control group after the practice scenario. Next, a series of Spearman's rank correlations were conducted to assess the relationships between Engagement, Flow, Simulator Sickness, and post-test performance, as well as examine the relationship between working memory and training performance; resulting in meaningful correlations to explain the relationships and identifying new concepts to explain unrelated variables. Finally, the role of Engagement, Flow, and Simulator Sickness as a predictor of post-test performance was examined using a series of multiple linear regressions. The results highlighted Simulator Sickness as a significant predictor of post-test performance. Overall, the results from this experiment proposes to expand the body of pattern recognition training literature by identifying strategies that enhance behavior cue detection training. Furthermore, it provides recommendations to training and education communities for improving behavior cue analysis. ?
Show less
Date Issued
2015
Identifier
CFE0005659, ucf:50166
Format
Document (PDF)
PURL
http://purl.flvc.org/ucf/fd/CFE0005659
Influence of Task-Role Mental Models on Human Interpretation of Robot Motion Behavior
Title
Influence of Task-Role Mental Models on Human Interpretation of Robot Motion Behavior.
Creator
Ososky, Scott, Jentsch, Florian, Shumaker, Randall, Fiore, Stephen, Lackey, Stephanie, University of Central Florida
Abstract / Description
The transition in robotics from tools to teammates has begun. However, the benefit autonomous robots provide will be diminished if human teammates misinterpret robot behaviors. Applying mental model theory as the organizing framework for human understanding of robots, the current empirical study examined the influence of task-role mental models of robots on the interpretation of robot motion behaviors, and the resulting impact on subjective ratings of robots. Observers (N = 120) were exposed...
Show moreThe transition in robotics from tools to teammates has begun. However, the benefit autonomous robots provide will be diminished if human teammates misinterpret robot behaviors. Applying mental model theory as the organizing framework for human understanding of robots, the current empirical study examined the influence of task-role mental models of robots on the interpretation of robot motion behaviors, and the resulting impact on subjective ratings of robots. Observers (N = 120) were exposed to robot behaviors that were either congruent or incongruent with their task-role mental model, by experimental manipulation of preparatory robot task-role information to influence mental models (i.e., security guard, groundskeeper, or no information), the robot's actual task-role behaviors (i.e., security guard or groundskeeper), and the order in which these robot behaviors were presented. The results of the research supported the hypothesis that observers with congruent mental models were significantly more accurate in interpreting the motion behaviors of the robot than observers without a specific mental model. Additionally, an incongruent mental model, under certain circumstances, significantly hindered an observer's interpretation accuracy, resulting in subjective sureness of inaccurate interpretations. The strength of the effects that mental models had on the interpretation and assessment of robot behaviors was thought to have been moderated by the ease with which a particular mental model could reasonably explain the robot's behavior, termed mental model applicability. Finally, positive associations were found between differences in observers' interpretation accuracy and differences in subjective ratings of robot intelligence, safety, and trustworthiness. The current research offers implications for the relationships between mental model components, as well as implications for designing robot behaviors to appear more transparent, or opaque, to humans.
Show less
Date Issued
2013
Identifier
CFE0005391, ucf:50457
Format
Document (PDF)
PURL
http://purl.flvc.org/ucf/fd/CFE0005391
Assessing the Effectiveness of Workload Measures in the Nuclear Domain
Title
Assessing the Effectiveness of Workload Measures in the Nuclear Domain.
Creator
Mercado, Joseph, Reinerman, Lauren, Hancock, Peter, Lackey, Stephanie, Szalma, James, University of Central Florida
Abstract / Description
An operator's performance and mental workload when interacting with a complex system, such as the main control room (MCR) of a nuclear power plant (NPP), are major concerns when seeking to accomplish safe and successful operations. The impact of performance on operator workload is one of the most widely researched areas in human factors science with over five hundred workload articles published since the 1960s (Brannick, Salas, (&) Prince, 1997; Meshkati (&) Hancock, 2011). Researchers have...
Show moreAn operator's performance and mental workload when interacting with a complex system, such as the main control room (MCR) of a nuclear power plant (NPP), are major concerns when seeking to accomplish safe and successful operations. The impact of performance on operator workload is one of the most widely researched areas in human factors science with over five hundred workload articles published since the 1960s (Brannick, Salas, (&) Prince, 1997; Meshkati (&) Hancock, 2011). Researchers have used specific workload measures across domains to assess the effects of taskload. However, research has not sufficiently assessed the psychometric properties, such as reliability, validity, and sensitivity, which delineates and limits the roles of these measures in workload assessment (Nygren, 1991). As a result, there is no sufficiently effective measure for indicating changes in workload for distinct tasks across multiple domains (Abich, 2013). Abich (2013) was the most recent to systematically test the subjective and objective workload measures for determining the universality and sensitivity of each alone or in combination. This systematic approach assessed taskload changes within three tasks in the context of a military intelligence, surveillance, and reconnaissance (ISR) missions. The purpose for the present experiment was to determine if certain workload measures are sufficiently effective across domains by taking the findings from one domain (military) and testing whether those results hold true in a different domain, that of nuclear. Results showed that only two measures (NASA-TLX frustration and fNIR) were sufficiently effective at indicating workload changes between the three task types in the nuclear domain, but many measures were statistically significant. The results of this research effort combined with the results from Abich (2013) highlight an alarming problem. The ability of subjective and physiological measures to indicate changes in workload varies across tasks (Abich, 2013) and across domain. A single measure is not able to measure the complex construct of workload across different tasks within the same domain or across domains. This research effort highlights the importance of proper methodology. As researchers, we have to identify the appropriate workload measure for all tasks regardless of the domain by investigating the effectiveness of each measure. The findings of the present study suggest that responsible science include evaluating workload measures before use, not relying on prior research or theory. In other words, results indicate that it is only acceptable to use a measure based on prior findings if research has tested that measure on the exact task and manipulations within that specific domain.
Show less
Date Issued
2014
Identifier
CFE0005666, ucf:50188
Format
Document (PDF)
PURL
http://purl.flvc.org/ucf/fd/CFE0005666
Instructional Strategies for Scenario-Based Training of Human Behavior Cue Analysis with Robot-Aided Intelligence, Surveillance, Reconnaissance
Title
Instructional Strategies for Scenario-Based Training of Human Behavior Cue Analysis with Robot-Aided Intelligence, Surveillance, Reconnaissance.
Creator
Salcedo, Julie, Lackey, Stephanie, Reinerman, Lauren, Barber, Daniel, Kincaid, John, Matthews, Gerald, University of Central Florida
Abstract / Description
The U.S. Army desires to improve safety during Intelligence, Surveillance, Reconnaissance (ISR) operations by removing Warfighters from direct line-of-fire by enhancing ISR operational capabilities with unmanned systems, also known as Robot-Aided ISR (RAISR) (DOD, 2013). Additionally, RAISR presents an opportunity to fulfill ISR capability requirements of modern combat environments including: detection of High-Value Individuals (HVI) from safer distances, identification of baseline behavior,...
Show moreThe U.S. Army desires to improve safety during Intelligence, Surveillance, Reconnaissance (ISR) operations by removing Warfighters from direct line-of-fire by enhancing ISR operational capabilities with unmanned systems, also known as Robot-Aided ISR (RAISR) (DOD, 2013). Additionally, RAISR presents an opportunity to fulfill ISR capability requirements of modern combat environments including: detection of High-Value Individuals (HVI) from safer distances, identification of baseline behavior, and interpretation of adversarial intent (U.S. Army, 2008). Along with the demand and projected acquisition of RAISR technology, there is the added need to design training requirements for system operation and task execution instruction. While documentation identifying specific training standards and objectives for ISR tasks utilizing unmanned systems is limited (DOD, 2013), simulation-based training has been identified as a critical training medium for RAISR (U.S. Army, 2008). ISR analysts will primarily conduct RAISR tasks via Indirect Vision Displays (IVD) which transition well into multimodal simulations (Salcedo, Lackey, (&) Maraj, 2014). However, simulation alone may not fulfill the complex training needs of RAISR tasks, therefore, incorporating instructional support may improve the effectiveness of training (Oser, Gualtieri, Cannon-Bowers, (&) Salas, 1999). One method to accomplish this is to utilize a Scenario-Based Training (SBT) framework enhanced with instructional strategies to target specific training objectives.The purpose for the present experiment was to assess the effectiveness of SBT enhanced with selected instructional strategies for a PC-based RAISR training simulation. The specific task type was the identification of HVIs within a group through behavior cue analysis. The instructional strategies assessed in this experiment, Highlighting and Massed Exposure, have shown to improve attentional weighting, visual search, and pattern recognition skills, which are critical for successful behavior cue analysis. Training effectiveness was evaluated by analyzing the impact of the instructional strategies on performance outcomes, including detection accuracy, classification accuracy, and median response time, and perceptions of the level of engagement, immersion, and presence during training exercises. Performance results revealed that the Massed Exposure strategy produced significantly faster response times for one subtle and one familiar target behavior cue. Perception results indicated that Highlighting was the least challenging instructional strategy and the Control offered the preferred level of challenge. The relationships between performance and perception measures revealed that higher levels of engagement, immersion, and presence were associated with better performance in the Control, but this trend did not always hold for Massed Exposure and Highlighting. Furthermore, presence emerged as the primary predictor of performance for select target behavior cues in the Control and Massed Exposure conditions, while immersion and engagement predicted performance of select cues in the Highlighting condition. The findings of the present experiment point to the potential benefit of SBT instructional strategies to improve effectiveness of simulation-based training for behavior cue analysis during RAISR operations. Specifically, the findings suggest that the Massed Exposure strategy has the potential to improve response time when detecting both familiar and novel targets. The results also highlight directions for future research to investigate methods to alter instructional strategy design and delivery in order to improve trainee perceptions of the instruction.
Show less
Date Issued
2014
Identifier
CFE0005705, ucf:50151
Format
Document (PDF)
PURL
http://purl.flvc.org/ucf/fd/CFE0005705