View All Items

Title: NETWORK PERFORMANCE MANAGEMENT USING APPLICATION-CENTRIC KEY PERFORMANCE INDICATORS.
Creator: McGill, Susan, Shumaker, Randall, University of Central Florida
Abstract / Description: The Internet and intranets are viewed as capable of supplying "Anything, Anywhere, Anytime" and e-commerce, e-government, e-community, and military C4I are now deploying many and varied applications to serve their needs. Network management is currently centralized in operations centers. To assure customer satisfaction with the network performance they typically plan, configure and monitor the network devices to insure an excess of bandwidth, that is overprovision. If this proves uneconomical...
Show moreThe Internet and intranets are viewed as capable of supplying "Anything, Anywhere, Anytime" and e-commerce, e-government, e-community, and military C4I are now deploying many and varied applications to serve their needs. Network management is currently centralized in operations centers. To assure customer satisfaction with the network performance they typically plan, configure and monitor the network devices to insure an excess of bandwidth, that is overprovision. If this proves uneconomical or if complex and poorly understood interactions of equipment, protocols and application traffic degrade performance creating customer dissatisfaction, another more application-centric, way of managing the network will be needed. This research investigates a new qualitative class of network performance measures derived from the current quantitative metrics known as quality of service (QOS) parameters. The proposed class of qualitative indicators focuses on utilizing current network performance measures (QOS values) to derive abstract quality of experience (QOE) indicators by application class. These measures may provide a more user or application-centric means of assessing network performance even when some individual QOS parameters approach or exceed specified levels. The mathematics of functional analysis suggests treating QOS performance values as a vector, and, by mapping the degradation of the application performance to a characteristic lp-norm curve, a qualitative QOE value (good/poor) can be calculated for each application class. A similar procedure could calculate a QOE node value (satisfactory/unsatisfactory) to represent the service level of the switch or router for the current mix of application traffic. To demonstrate the utility of this approach a discrete event simulation (DES) test-bed, in the OPNET telecommunications simulation environment, was created modeling the topology and traffic of three semi-autonomous networks connected by a backbone. Scenarios, designed to degrade performance by under-provisioning links or nodes, are run to evaluate QOE for an access network. The application classes and traffic load are held constant. Future research would include refinement of the mathematics, many additional simulations and scenarios varying other independent variables. Finally collaboration with researchers in areas as diverse as human computer interaction (HCI), software engineering, teletraffic engineering, and network management will enhance the concepts modeled.
Show less
Date Issued: 2007
Identifier: CFE0001818, ucf:47371
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0001818

Title: TEXT VERSUS VERBAL REAL-TIME FEEDBACK DURING SIMULATION-BASED TRAINING OF HIGHER-ORDER COGNITIVE SKILLS.
Creator: Fiorella, Christopher, Shumaker, Randall, University of Central Florida
Abstract / Description: A crucial component of instructional design for simulation-based training systems involves optimizing the presentation of complex material in order to maximize knowledge acquisition and application. One approach toward facilitating the learning of this complex information is to instantiate instructional strategies within the training systems themselves. However, there are few established guidelines in place which are meant specifically for real-time guidance strategies within simulation-based...
Show moreA crucial component of instructional design for simulation-based training systems involves optimizing the presentation of complex material in order to maximize knowledge acquisition and application. One approach toward facilitating the learning of this complex information is to instantiate instructional strategies within the training systems themselves. However, there are few established guidelines in place which are meant specifically for real-time guidance strategies within simulation-based environments. Consequently, this study aims to apply findings from the literature on instructional information presentation to drive decisions for how to most effectively provide real-time feedback during training of simulated decision-making tasks. Research has shown that presenting text information in an auditory mode during direct instruction of operational tasks enhances learning and reduces the probability of learners experiencing cognitive overload. Similar effects have been found regarding the presentation modality of feedback during operational tasks. In the current study, this principle was extended by comparing text versus verbal real-time feedback presentation during learning of higher-level cognitive skills in a virtual environment. Participants were instructed on how to perform a simulated decision-making task, while receiving text, verbal or no instructional feedback in real-time, based on their performance. Participants then completed an assessment scenario in which no feedback was provided to any group. It was hypothesized that a linear relationship would exist across each of the three conditions, with the verbal group making the best decisions, followed by the text group, and then by the control group. Additionally, reduced cognitive load was expected throughout the instructional process for those receiving verbal feedback prompts compared to those receiving text prompts and the control. Analyses revealed several significant linear trends across conditions regarding measures of knowledge acquisition and application. The results provide support for the hypothesis that verbal real-time feedback is more effective than text during training of primarily visual tasks for the acquisition of higher-order cognitive skills such as decision making. There were no significant linear trends regarding the amount of cognitive load subjectively reported during training and assessment. The results of this study indicate that instructional systems intended to train primarily visual tasks should present real-time feedback in verbal rather than text form.
Show less
Date Issued: 2010
Identifier: CFE0003555, ucf:48915
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0003555

Title: Identifying Type of Expertise as a Means to Measure CRM Knowledge Structures.
Creator: Jimenez, Camilo, Jentsch, Florian, Shumaker, Randall, Burke, Shawn, Sims, Valerie, University of Central Florida
Abstract / Description: Crew Resource Management (CRM) training has evolved since its inception in the 1980s to better accommodate the operational needs of flight crews. However, even as the aviation and research communities have pointed to the potential benefit of providing CRM training, some criticism continues to emerge periodically which claims that there is no concrete evidence of its impact on flight deck performance and safety. Therefore, it is imperative to develop tools that allow researchers and, more...
Show moreCrew Resource Management (CRM) training has evolved since its inception in the 1980s to better accommodate the operational needs of flight crews. However, even as the aviation and research communities have pointed to the potential benefit of providing CRM training, some criticism continues to emerge periodically which claims that there is no concrete evidence of its impact on flight deck performance and safety. Therefore, it is imperative to develop tools that allow researchers and, more importantly, practitioners, to more effectively and objectively assess training effectiveness and identify whether or not desired CRM behaviors are being put to practice during line operations.This study focused on evaluating pilots' CRM schemas and identifying differences in CRM knowledge structures among pilots. Differences in CRM knowledge and opinions about training could be an indication of the existence of what Hatano and Inagaki (1986) have described as two distinct types of expertise, namely, routine and adaptive expertise. The study sought to identify differences among routine and adaptive expert pilots in CRM knowledge structures (schemas), their perceptions on the value and efficacy of current CRM training evaluation, along with their opinion on how CRM training effectiveness could be more accurately assessed. Results from over 250 pilots showed that, in general, participants had a positive view of CRM training and training evaluation, regardless of their type of expertise. Some evidence of potential differences in the structural knowledge of CRM between routine and adaptive experts, as well as, differences in their opinions about CRM training, evaluation, and automation on the flight deck was also identified. Additionally, analysis of survey scores and free response items indicate the existence of a third category of experts, between routine and adaptive expertise (whom I call transitional experts). The study results provide evidence that assessment of CRM schemas could potentially be used as a way to evaluate CRM training effectiveness. The results of the study also indicate that identification of specific training needs for each group of expert may be possible through the assessment of CRM schemas and type of expertise. Implications for practice and theory, limitations of the study, and suggestions for future research are also provided.
Show less
Date Issued: 2018
Identifier: CFE0007200, ucf:52264
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0007200

Title: Modeling the innovation ecosystem and development of a dynamic innovation index.
Creator: Schoen, Henriette, Karwowski, Waldemar, Hoekstra, Robert, Shumaker, Randall, Akbas, Mustafa, University of Central Florida
Abstract / Description: The topic of innovation currently generates a tremendous amount of interest around the world. Innovation is considered an essential part of the solution to creating more jobs and improving the socio-economic conditions of many countries around the globe. Innovation comes about through the existence of many interrelated solutions to socio-economic problems in an extensively interconnected network, which create value for each other. Such a complex creativity and innovation value-creating...
Show moreThe topic of innovation currently generates a tremendous amount of interest around the world. Innovation is considered an essential part of the solution to creating more jobs and improving the socio-economic conditions of many countries around the globe. Innovation comes about through the existence of many interrelated solutions to socio-economic problems in an extensively interconnected network, which create value for each other. Such a complex creativity and innovation value-creating network is here called an Innovation Ecosystem (IE). The main objective of this dissertation research is to improve the current understanding of the IE by developing a simulation model that uses a broad set of relevant static and dynamic variables and incorporates the principles of system dynamics (SD). The proposed model, which is named the IECO-model is based on the relationships between 91 variables and the combined influences of the 43 parameters. Available data for 32 countries, representing a full span of GDP worldwide, was used to study the level of innovation in each of these countries. The result of the developed IECO-model is a novel ranking of the level of innovation through a dynamic innovation index, called the DII. The DII is a new tool to evaluate the innovation and entrepreneurship level of a given country in the context of the global economy. The most significant differentiator from other existing indices of innovation is that the DII is focusing more on the entrepreneurship qualities in 19 of the 43 parameters by looking at cultural values and belief systems, the social context, existing entrepreneurial culture, innovation attitudes, and mentality of each of the considered countries. According to DII-based ranking, the ten most innovative countries in the world are 1. Switzerland, 2. USA, 3. Finland, 4. Netherlands, 5. Iceland, 6. Sweden, 7. Germany, 8. Denmark, 9. The United Kingdom, and 10. Austria.
Show less
Date Issued: 2018
Identifier: CFE0007586, ucf:52537
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0007586

Title: The Effectiveness of Virtual Humans vs Pre-Recorded Humans in a Standardized Patient Performance Assessment.
Creator: Palathinkal, Joel, Kincaid, John, Shumaker, Randall, Allred, Kelly, Smith, Roger, University of Central Florida
Abstract / Description: A Standardized Patient (SP) is a trained actor who portrays a particular illness to provide training to medical students and professionals. SPs primarily use written scripts and additional paper-based training for preparation of practical and board exams. Many institutions use various methods for training such as hiring preceptors for reenactment of scenarios, viewing archived videos, and computer based training. Currently, the training that is available can be enhanced to improve the level...
Show moreA Standardized Patient (SP) is a trained actor who portrays a particular illness to provide training to medical students and professionals. SPs primarily use written scripts and additional paper-based training for preparation of practical and board exams. Many institutions use various methods for training such as hiring preceptors for reenactment of scenarios, viewing archived videos, and computer based training. Currently, the training that is available can be enhanced to improve the level of quality of standardized patients. The following research is examining current processes in standardized patient training and investigating new methods for clinical skills education in SPs. The modality that is selected for training can possibly affect the performance of the actual SP case.This paper explains the results of a study that investigates if there is a difference in the results of an SP performance assessment. This difference can be seen when comparing a virtual human modality to that of a pre-recorded human modality for standardized patient training. The sample population navigates through an interactive computer based training module which provides informational content on what the roles of an SP are, training objectives, a practice session, and an interactive performance assessment with a simulated Virtual Human medical student. Half of the subjects interact with an animated virtual human medical student while the other half interacts with a pre-recorded human. The interactions from this assessment are audio-recorded, transcribed, and then graded to see how the two modalities compare. If the performance when using virtual humans for standardized patients is equal to or superior to pre-recorded humans, this can be utilized as a part task trainer that brings standardized patients to a higher level of effectiveness and standardization. In addition, if executed properly, this tool could potentially be used as a part task trainer which could provide savings in training time, resources, budget, and staff to military and civilian healthcare facilities.
Show less
Date Issued: 2011
Identifier: CFE0004149, ucf:49037
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0004149

Title: Evaluating Human-Robot Implicit Communication through Human-Human Implicit Communication.
Creator: Richardson, Andrew, Karwowski, Waldemar, Hancock, Peter, Shumaker, Randall, Reinerman, Lauren, University of Central Florida
Abstract / Description: Human-Robot Interaction (HRI) research is examining ways to make human-robot (HR) communication more natural. Incorporating natural communication techniques is expected to make HR communication seamless and more natural for humans. Humans naturally incorporate implicit levels of communication, and including implicit communication in HR communication should provide tremendous benefit. The aim for this work was to evaluate a model for human-robot implicit communication. Specifically, the...
Show moreHuman-Robot Interaction (HRI) research is examining ways to make human-robot (HR) communication more natural. Incorporating natural communication techniques is expected to make HR communication seamless and more natural for humans. Humans naturally incorporate implicit levels of communication, and including implicit communication in HR communication should provide tremendous benefit. The aim for this work was to evaluate a model for human-robot implicit communication. Specifically, the primary goal for this research was to determine whether humans can assign meanings to implicit cues received from autonomous robots as they do for identical implicit cues received from humans.An experiment was designed to allow participants to assign meanings to identical, implicit cues (pursuing, retreating, investigating, hiding, patrolling) received from humans and robots. Participants were tasked to view random video clips of both entity types, label the implicit cue, and assign a level of confidence in their chosen answer. Physiological data was tracked during the experiment using an electroencephalogram and eye-tracker. Participants answered workload and stress measure questionnaires following each scenario.Results revealed that participants were significantly more accurate with human cues (84%) than with robot cues (82%), however participants were highly accurate, above 80%, for both entity types. Despite the high accuracy for both types, participants remained significantly more confident in answers for humans (6.1) than for robots (5.9) on a confidence scale of 1 - 7.Subjective measures showed no significant differences for stress or mental workload across entities. Physiological measures were not significant for the engagement index acrossentity, but robots resulted in significantly higher levels of cognitive workload for participants via the index of cognitive activity.The results of this study revealed that participants are more confident interpreting human implicit cues than identical cues received from a robot. However, the accuracy of interpreting both entities remained high. Participants showed no significant difference in interpreting different cues across entity as well. Therefore, much of the ability of interpreting an implicit cue resides in the actual cue rather than the entity. Proper training should boost confidence as humans begin to work alongside autonomous robots as teammates, and it is possible to train humans to recognize cues based on the movement, regardless of the entity demonstrating the movement.
Show less
Date Issued: 2012
Identifier: CFE0004429, ucf:49352
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0004429

Title: Application of Modeling and Simulation to Reduce Costs of Acquisition within Triple Constraints.
Creator: Mohammad, Syed, Kincaid, John, Shumaker, Randall, Wiegand, Rudolf, Richardson, Paul, University of Central Florida
Abstract / Description: A key component of defense acquisition programs operating using the Integrated Defense Acquisition, Technology, and Logistics Life Cycle Management System is the reliance on the triple constraints of cost, schedule, and performance. While the use of Modeling and Simulation tools and capabilities is prevalent and well established in the Research and Development, Analysis, and Training domains, acquisition programs have been reluctant to use Modeling and Simulation in any great depth due to...
Show moreA key component of defense acquisition programs operating using the Integrated Defense Acquisition, Technology, and Logistics Life Cycle Management System is the reliance on the triple constraints of cost, schedule, and performance. While the use of Modeling and Simulation tools and capabilities is prevalent and well established in the Research and Development, Analysis, and Training domains, acquisition programs have been reluctant to use Modeling and Simulation in any great depth due to inaccessibility of tools, Subject Matter Experts, and implications to cost and schedule. This presents a unique Simulation Management challenge which requires an in-depth understanding of the technical capabilities available within an organization, their applicability to support immediate needs, and the flexibility to utilize these capabilities within the programmatic environment to provide a value added service. The focus of this dissertation is to study the use of Modeling and Simulation in the Defense arena, and to review the applicability of Modeling and Simulation within programmatic acquisition environments which are constrained by cost, schedule, and performance. This research draws comparisons between Modeling and Simulation to other Process Improvement initiatives, such as Lean and Six Sigma, and reviews case studies involving the application of Modeling and Simulation within triple constrained environments. The development of alternate scenarios allows cost benefit analysis to be conducted for each scenario and alternate scenario, developing a case for whether or not the application of Modeling and Simulation within the triple constrained environment delivered any consequential benefit to the acquisition process. Observations are made regarding the level of Modeling and Simulation as applied within each case study, and generalized recommendations are made for the inclusion of cost benefit analysis methodologies for analyzing proposed Modeling and Simulation activities within acquisition programs. Limitations and shortcomings of the research activity are discussed, along with recommendations for potential future work in the Simulation Management field, both with respect to the specific case studies reviewed in this study and the general field.
Show less
Date Issued: 2012
Identifier: CFE0004415, ucf:49396
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0004415

Title: Gauging Training Effectiveness of Virtual Environment Simulation Based Applications for an Infantry Soldier Training Task.
Creator: Maxwell, Douglas, Kincaid, John, Shumaker, Randall, Barber, Daniel, Sottilare, Robert, University of Central Florida
Abstract / Description: The U.S. Army Training and Doctrine Command's Army Learning Concept 2015 and Army Training Concept 2025 are documents that discuss the need for an adaptive soldier learning model with a flexible training delivery methodology. The U.S. Army has been investing in serious gaming technology for the past two decades as a cost effective means to teach tactics and strategy. Today, the U.S. Army is seeking to expand its application of virtual environment training to areas such as cultural awareness...
Show moreThe U.S. Army Training and Doctrine Command's Army Learning Concept 2015 and Army Training Concept 2025 are documents that discuss the need for an adaptive soldier learning model with a flexible training delivery methodology. The U.S. Army has been investing in serious gaming technology for the past two decades as a cost effective means to teach tactics and strategy. Today, the U.S. Army is seeking to expand its application of virtual environment training to areas such as cultural awareness and human network analysis for the infantry soldier. These new expanded applications will require a higher level of non-determinant behavior inside the virtual environment. To meet more of the training needs of the war fighter, the U.S. Army is looking beyond first person perspective games to the cooperative and social gaming experience offered by the MMOG (Massively Multiplayer Online Game) and the VWT (Virtual World Technology). Altogether, these classes of games have the potential to teach leadership skills, social acclimation skills, cultural awareness and practice skills, and critical thinking skills for problem solving in a cost effective manner. Unfortunately, even today there is a paucity of scientific research to support whether this potential may be realized or not. A literature review was performed which covers current concepts in the usage of virtual environments for military individual and team training in the U.S. Army infantry soldier domains. There are many variables involved with the lifecycle of the virtual training activity including the acquisition, information assurance and cyber security, deployment, proper employment, content development and maintenance, and retirement. This discussion goes beyond the traditional topics of graphics and game engine technology and delves deeper into concepts of the importance of proper usage of the environments by the trainees. This dissertation is composed of three studies with two subject pools: experienced soldiers and novice soldiers. The participants in the studies were randomly assigned to one of two training conditions. The training conditions were either a traditional slide-show in a classroom or a virtual environment based training system. The participants were then provided with training for a room clearing tasks in each of the conditions. The independent variables are training condition and soldier condition. The dependent variables are individual performance, team performance, stress questionnaire scores, and workload questionnaire scores. A number of relationships are explored in this dissertation. The first objective of these studies is to attempt to identify any effect the training conditions have on either individual performance or team performance. Lastly, these studies attempt to identify if there is any difference the training conditions have on novice versus experienced subjects' performance during a live assessment.
Show less
Date Issued: 2015
Identifier: CFE0005840, ucf:50924
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0005840

Title: Cognitive Flexibility: Using Mental Simulation to Improve Script Adaptation.
Creator: Rivera, Javier, Jentsch, Florian, Shumaker, Randall, Lackey, Stephanie, Sims, Valerie, University of Central Florida
Abstract / Description: Human behavior and decision-making depend largely on past experiences that generate specific action patterns (i.e., scripts, Gioia (&) Manz, 1985) for specific situations. In an ideal world, in which changes in the environment do not conflict with these action patterns, humans would be able to operate consistently, efficiently, and automatically. However, real-world environments are dynamic and fluid, thus altering behavior and forcing changes in scripts. Research suggests that to implement...
Show moreHuman behavior and decision-making depend largely on past experiences that generate specific action patterns (i.e., scripts, Gioia (&) Manz, 1985) for specific situations. In an ideal world, in which changes in the environment do not conflict with these action patterns, humans would be able to operate consistently, efficiently, and automatically. However, real-world environments are dynamic and fluid, thus altering behavior and forcing changes in scripts. Research suggests that to implement alternate solutions to changing situations, humans select from a (")library(") of learned scripts. Since humans tend to implement scripts to the degree that these are successful over a period of time, implementing alternate scripts can be difficult. That is, unless one has the cognitive flexibility to adapt scripts, implementing a new solution to a problem can be difficult and/or unsuccessful. Cognitive flexibility allows one to restructure knowledge to form an adaptive response to changes set forth by the environment. At issue is the difference between possessing a repertoire of scripts that can be selected and implemented to solve a problem, and having the cognitive flexibility to effectively switch between scripts when a change in context occurs. The purpose of this dissertation is to: (a) evaluate the effectiveness of possessing alternate scripts to respond to situations, and (b) assess the effectiveness of cognitive flexibility training on the ability to switch between scripts. The ultimate goal is to improve mental flexibility in situations where a specific approach should be revised and adjusted to conform to changes in context. A total of 48 participants were randomly assigned to one of four conditions in a 2 (number of scripts) x 2 (training present or absent) design: (a) single script, (b) single script and cognitive flexibility training, (c) two scripts, and (d) two scripts and cognitive flexibility training. Participants either learned one script or two scripts on how to respond to a car engine overheat. In addition, depending on the study condition, participants completed a cognitive flexibility training that used a mental simulation approach. The cognitive flexibility training was intended to allow participants to imagine a number of different scenarios that may impact that task, evaluate assumptions, check assumptions against the situation, imagine a response to such scenarios, and review the effectiveness of the developed solutions. The results of this research suggested that for situations requiring a change or an adaptation to an alternate script, possessing two scripts facilitated correct decision-making, whereas cognitive flexibility training may have hindered decision-making. In addition, for situations requiring a standard script, possessing two scripts was detrimental to decision-making performance, regardless of cognitive flexibility training. Theoretical implications in terms of script-processing and cognitive flexibility, as well as practical implications for training design are provided.
Show less
Date Issued: 2016
Identifier: CFE0006381, ucf:51528
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0006381

Title: Assessment of Tattoo and Silicone Wounds in Terms of Time of Treatment and Perceived Treatment Quality.
Creator: Pettitt, M, Karwowski, Waldemar, Shumaker, Randall, Cendan, Juan, Sottilare, Robert, University of Central Florida
Abstract / Description: At the point of injury, critical medical tasks include locating and identifying an injury as well as applying the appropriate initial care. Over the past decade, to increase the fidelity of wound representation and ultimately the quality of medical care, a considerable amount of research and development has occurred to improve simulated wounds during training, primarily at the point of injury. As material and techniques mature and as more relevant data is collected on tissue properties,...
Show moreAt the point of injury, critical medical tasks include locating and identifying an injury as well as applying the appropriate initial care. Over the past decade, to increase the fidelity of wound representation and ultimately the quality of medical care, a considerable amount of research and development has occurred to improve simulated wounds during training, primarily at the point of injury. As material and techniques mature and as more relevant data is collected on tissue properties, examining what fidelity is required for training at the point of injury is crucial. The main objective of this effort was to assess a three dimensional silicone wound versus a two dimensional tattoo wound for training and to examine differences in user perceptions and treatment time. This was accomplished with a test population of 158 City of Orlando Fire Department First Responders which were randomly assigned to each group (three dimensional silicone wound group versus a two dimensional tattoo wound group). The data analyses incorporated the use of non-parametric statistics (Mann-Whitney U Test) to compare the differences between the two groups on depth perception, sense of urgency, immersion, and time on task. Other factors that were examined included the costs for the average tattoo wound and silicone wound as well as the number of uses before the synthetic wound is visibly damaged. The data results indicated that at the point of injury, there were relatively few statistically significant differences in the survey data or time on task between the silicone and tattoo wounds. Additionally, the cost analysis revealed that the silicone wound is significantly more expensive than the tattoo wound. Supporting the military and civilian first responder communities, the results of this study provides statistically reliable data on the use of trauma tattoos as a tool for mastering point of injury treatment during training exercises.
Show less
Date Issued: 2017
Identifier: CFE0006904, ucf:51733
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0006904

Title: Supporting situation awareness through robot-to-human information exchanges under conditions of visuospatial perspective taking.
Creator: Phillips, Elizabeth, Jentsch, Florian, Sims, Valerie, Bowers, Clint, Shumaker, Randall, University of Central Florida
Abstract / Description: The future vision of military Soldier(-)robot teams is one in which Soldiers and robots work together to complete separate, but interdependent tasks that advance the goals of the mission. However, in the near term, robots will be limited in their ability to successfully perform tasks without, at least, occasional assistance from their human teammates. A need exists to design, in robots, mechanisms that can support human situation awareness (SA) regarding the operations of the robot, which...
Show moreThe future vision of military Soldier(-)robot teams is one in which Soldiers and robots work together to complete separate, but interdependent tasks that advance the goals of the mission. However, in the near term, robots will be limited in their ability to successfully perform tasks without, at least, occasional assistance from their human teammates. A need exists to design, in robots, mechanisms that can support human situation awareness (SA) regarding the operations of the robot, which humans can use to provide interventions in robot tasks. The purpose of the current study was to test the effects of information exchanges provided by a robot on the development of SA in a human partner, under differing levels of visual perspective taking, and the consequential effects on the quality of human assistance provided to a robot. After data screening, fifty-six male participants ranging in age from 18 to 29 (M= 18.89, SD= 3.412) were included in the analysis of the results. Hierarchical multiple regression and a series of ANOVAs with comparisons between individual within-subjects study conditions were conducted to analyze five Hypotheses. The results of this study revealed that if robots, through robot-to-human information exchanges, can increasingly support a human's understanding of when assistance is needed, humans will be better able to provide that assistance. As opposed to originally hypothesized, this study also showed that fewer instances in which robots share status information with their human counterparts may be more beneficial for supporting awareness, assistance, and dual task performance than more information sharing, by guarding against performance decrements that could be the result of receiving too many robot-to-human information exchanges. It was also thought that anchoring robot-to-human information sharing with spatial information in reference to the human's view of the environment would be most beneficial for supporting awareness regarding the robot and assistance provided to the robot. This notion was not supported. Instead, results suggested that if extra spatial information is added to robot-to-human information exchanges, representing that spatial information in reference to a cardinal, global-relative perspective of the environment may be better for supporting awareness and assistance than representing that information in reference to the human's view of the environment.
Show less
Date Issued: 2016
Identifier: CFE0006162, ucf:51143
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0006162

Title: Investigating Simulation-Based Pattern Recognition Training For Behavior Cue Detection.
Creator: Maraj, Crystal, Lackey, Stephanie, Kincaid, John, Shumaker, Randall, Keebler, Joseph, University of Central Florida
Abstract / Description: The U.S. military uses pattern recognition training to observe anomalies in human behavior. An examination of the pattern recognition training literature for Warfighters reveals a gap in training to discern patterns of human behavior in live environments. Additionally, the current state of warfare is evolving and requires operations to change. As a result, pattern recognition training must accommodate new practices to improve performance. A technique used to improve memory for identifying...
Show moreThe U.S. military uses pattern recognition training to observe anomalies in human behavior. An examination of the pattern recognition training literature for Warfighters reveals a gap in training to discern patterns of human behavior in live environments. Additionally, the current state of warfare is evolving and requires operations to change. As a result, pattern recognition training must accommodate new practices to improve performance. A technique used to improve memory for identifying patterns in the environment is Kim's game. Kim's game establishes patterns to identify inanimate objects, of which information retains in memory for later recall. The paper discusses the fundamental principles of Kim's game applied to virtual Simulation-Based Training. The virtual version of Kim's game contains customized scenarios for training behavior cue analysis. Virtual agents display kinesic cues that exhibit aggressive (i.e., slap hands and clench fist) and nervous behaviors including wring hands and check six. This research takes a novel approach by animating the kinesics cues in the virtual version of Kim's game for pattern recognition training. Detection accuracy, response time, and false positive detection serve as the performance data for analysis. Additional survey data collected include engagement, flow, and simulator sickness. All collected data was compared to a control condition to examine its effectiveness of behavior cue detection. A series of one-way between subjects design ANOVA's were conducted to examine the differences between Kim's game and control on post-test performance. Although, the results from this experiment showed no significance in post-test performance, the percent change in post-test performance provide further insight into the results of the Kim's game and control strategies. Specifically, participants in the control condition performed better than the Kim's game group on detection accuracy and response time. However, the Kim's game group outperformed the control group on false positive detection. Further, this experiment explored the differences in Engagement, Flow, and Simulator Sickness after the practice scenario between Kim's game group and the control group. The results found no significant difference in Engagement, partial significance for Flow, and significant difference for Simulator Sickness between the Kim's game and control group after the practice scenario. Next, a series of Spearman's rank correlations were conducted to assess the relationships between Engagement, Flow, Simulator Sickness, and post-test performance, as well as examine the relationship between working memory and training performance; resulting in meaningful correlations to explain the relationships and identifying new concepts to explain unrelated variables. Finally, the role of Engagement, Flow, and Simulator Sickness as a predictor of post-test performance was examined using a series of multiple linear regressions. The results highlighted Simulator Sickness as a significant predictor of post-test performance. Overall, the results from this experiment proposes to expand the body of pattern recognition training literature by identifying strategies that enhance behavior cue detection training. Furthermore, it provides recommendations to training and education communities for improving behavior cue analysis. ?
Show less
Date Issued: 2015
Identifier: CFE0005659, ucf:50166
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0005659

Title: Influence of Task-Role Mental Models on Human Interpretation of Robot Motion Behavior.
Creator: Ososky, Scott, Jentsch, Florian, Shumaker, Randall, Fiore, Stephen, Lackey, Stephanie, University of Central Florida
Abstract / Description: The transition in robotics from tools to teammates has begun. However, the benefit autonomous robots provide will be diminished if human teammates misinterpret robot behaviors. Applying mental model theory as the organizing framework for human understanding of robots, the current empirical study examined the influence of task-role mental models of robots on the interpretation of robot motion behaviors, and the resulting impact on subjective ratings of robots. Observers (N = 120) were exposed...
Show moreThe transition in robotics from tools to teammates has begun. However, the benefit autonomous robots provide will be diminished if human teammates misinterpret robot behaviors. Applying mental model theory as the organizing framework for human understanding of robots, the current empirical study examined the influence of task-role mental models of robots on the interpretation of robot motion behaviors, and the resulting impact on subjective ratings of robots. Observers (N = 120) were exposed to robot behaviors that were either congruent or incongruent with their task-role mental model, by experimental manipulation of preparatory robot task-role information to influence mental models (i.e., security guard, groundskeeper, or no information), the robot's actual task-role behaviors (i.e., security guard or groundskeeper), and the order in which these robot behaviors were presented. The results of the research supported the hypothesis that observers with congruent mental models were significantly more accurate in interpreting the motion behaviors of the robot than observers without a specific mental model. Additionally, an incongruent mental model, under certain circumstances, significantly hindered an observer's interpretation accuracy, resulting in subjective sureness of inaccurate interpretations. The strength of the effects that mental models had on the interpretation and assessment of robot behaviors was thought to have been moderated by the ease with which a particular mental model could reasonably explain the robot's behavior, termed mental model applicability. Finally, positive associations were found between differences in observers' interpretation accuracy and differences in subjective ratings of robot intelligence, safety, and trustworthiness. The current research offers implications for the relationships between mental model components, as well as implications for designing robot behaviors to appear more transparent, or opaque, to humans.
Show less
Date Issued: 2013
Identifier: CFE0005391, ucf:50457
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0005391

Title: The Effects of Diagnostic Aiding on Situation Awareness under Robot Unreliability.
Creator: Schuster, David, Jentsch, Florian, Szalma, James, Mouloua, Mustapha, Shumaker, Randall, University of Central Florida
Abstract / Description: In highly autonomous robotic systems, human operators are able to attend to their own, separate tasks, but robots still need occasional human intervention. In this scenario, it may be difficult for human operators to determine the status of the system and environment when called upon to aid the robot. The resulting lack of situation awareness (SA) is a problem common to other automated systems, and it can lead to poor performance and compromised safety. Existing research on this problem...
Show moreIn highly autonomous robotic systems, human operators are able to attend to their own, separate tasks, but robots still need occasional human intervention. In this scenario, it may be difficult for human operators to determine the status of the system and environment when called upon to aid the robot. The resulting lack of situation awareness (SA) is a problem common to other automated systems, and it can lead to poor performance and compromised safety. Existing research on this problem suggested that reliable automation of information processing, called diagnostic aiding, leads to better operator SA. The effects of unreliable diagnostic aiding, however, were not well understood. These effects are likely to depend on the ability of the operator to perform the task unaided. That is, under conditions in which the operator can reconcile their own sensing with that of the robot, the influence of unreliable diagnostic aiding may be more pronounced. When the robot is the only source of information for a task, these effects may be weaker or may reverse direction. The purpose of the current experiment was to determine if SA is differentially affected by unreliability at different levels of unaided human performance and at different stages of diagnostic aiding. This was accomplished by experimentally manipulating the stage of diagnostic aiding, robot reliability, and the ability of the operator to build SA unaided. Results indicated that while reliable diagnostic aiding is generally useful, unreliable diagnostic aiding has effects that depend on the amount of information available to operators in the environment. This research improves understanding of how robots can support operator SA and can guide the development of future robots so that humans are most likely to use them effectively.
Show less
Date Issued: 2013
Identifier: CFE0005247, ucf:50577
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0005247

Title: Human Factor Effects of Simulating Battlefield Malodors in Field Training.
Creator: Pike, William, Proctor, Michael, Shumaker, Randall, Sims, Valerie, Ness, James, Burgess, Deborah, University of Central Florida
Abstract / Description: In order to explore how to better utilize simulated odors for live training, a study of 180 United States Military Academy at West Point cadets was undertaken to determine whether pre-exposure to a simulated malodor may result in an amelioration of performance issues, as well as improving performance of a complex task. Exposure to malodors has long been shown to increase stress and escape behavior, and reduce performance of complex tasks, in addition to degrading other human factor areas....
Show moreIn order to explore how to better utilize simulated odors for live training, a study of 180 United States Military Academy at West Point cadets was undertaken to determine whether pre-exposure to a simulated malodor may result in an amelioration of performance issues, as well as improving performance of a complex task. Exposure to malodors has long been shown to increase stress and escape behavior, and reduce performance of complex tasks, in addition to degrading other human factor areas. However, desensitization to a particular odor through a process known as olfactory adaptation, could ameliorate these performance issues. In this study, cadets were assigned to one of three conditions: Adaptation (odor/odor, to denote presence or absence of the simulated malodor in each of two phases), No Adaptation (no odor/odor), or Control (no odor/no odor). Participants wore a device to track electrodermal activity, a predictor of stress. Participants spent 12 minutes in a tent taking a quiz involving a common military task. After two minutes, a scent delivery system was turned on, delivering either the simulated malodor (burnt human flesh) or no odor. Participants exited the tent after the full 12 minutes and rated the air quality of the tent. They repeated the exercise in a second tent, with a similar quiz. Metrics of interest included perceived intensity and detection time, common metrics for gauging olfactory adaption, as well as electrodermal activity, escape behavior, and task performance. Results indicate participants in the Adaptation condition were partially desensitized to the malodor. Performance metrics did not show any statistical significance for stress, escape behavior, or performance improvement for the Adaptation condition, although there was a strong negative correlation of performance and perceived mental demand. Performance improvement and stress results were trending in the expected directions. This study differed from previous work in olfactory adaptation studies by linking adaptation to performance during a relevant complex task, and provides valuable lessons for future olfactory studies. From a more applied viewpoint, this study also provides insight for future research into the incorporation of malodors in live training.
Show less
Date Issued: 2018
Identifier: CFE0007357, ucf:52097
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0007357

Title: Leveraging Help Requests in POMDP Intelligent Tutors.
Creator: Folsom-Kovarik, Jeremiah, Sukthankar, Gita, Schatz, Sarah, Gonzalez, Avelino, Shumaker, Randall, Schatz, Sarah, University of Central Florida
Abstract / Description: Intelligent tutoring systems (ITSs) are computer programs that model individual learners and adapt instruction to help each learner differently. One way ITSs differ from human tutors is that few ITSs give learners a way to ask questions. When learners can ask for help, their questions have the potential to improve learning directly and also act as a new source of model data to help the ITS personalize instruction. Inquiry modeling gives ITSs the ability to answer learner questions and refine...
Show moreIntelligent tutoring systems (ITSs) are computer programs that model individual learners and adapt instruction to help each learner differently. One way ITSs differ from human tutors is that few ITSs give learners a way to ask questions. When learners can ask for help, their questions have the potential to improve learning directly and also act as a new source of model data to help the ITS personalize instruction. Inquiry modeling gives ITSs the ability to answer learner questions and refine their learner models with an inexpensive new input channel.In order to support inquiry modeling, an advanced planning formalism is applied to ITS learner modeling. Partially observable Markov decision processes (POMDPs) differ from more widely used ITS architectures because they can plan complex action sequences in uncertain situations with machine learning. Tractability issues have previously precluded POMDP use in ITS models. This dissertation introduces two improvements, priority queues and observation chains, to make POMDPs scale well and encompass the large problem sizes that real-world ITSs must confront. A new ITS was created to support trainees practicing a military task in a virtual environment. The development of the Inquiry Modeling POMDP Adaptive Trainer (IMP) began with multiple formative studies on human and simulated learners that explored inquiry modeling and POMDPs in intelligent tutoring. The studies suggest the new POMDP representations will be effective in ITS domains having certain common characteristics.Finally, a summative study evaluated IMP's ability to train volunteers in specific practice scenarios. IMP users achieved post-training scores averaging up to 4.5 times higher than users who practiced without support and up to twice as high as trainees who used an ablated version of IMP with no inquiry modeling. IMP's implementation and evaluation helped explore questions about how inquiry modeling and POMDP ITSs work, while empirically demonstrating their efficacy.
Show less
Date Issued: 2012
Identifier: CFE0004506, ucf:49262
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0004506

Title: Information Propagation Algorithms for Consensus Formation in Decentralized Multi-Agent Systems.
Creator: Hollander, Christopher, Wu, Annie, Shumaker, Randall, Wiegand, Rudolf, Turgut, Damla, Song, Zixia, University of Central Florida
Abstract / Description: Consensus occurs within a multi-agent system when every agent is in agreement about the value of some particular state. For example, the color of an LED, the position or magnitude of a vector, a rendezvous location, the most recent state of data within a database, or the identity of a leader are all states that agents might need to agree on in order to execute their tasking.The task of the decentralized consensus problem for multi-agent systems is to design an algorithm that enables agents to...
Show moreConsensus occurs within a multi-agent system when every agent is in agreement about the value of some particular state. For example, the color of an LED, the position or magnitude of a vector, a rendezvous location, the most recent state of data within a database, or the identity of a leader are all states that agents might need to agree on in order to execute their tasking.The task of the decentralized consensus problem for multi-agent systems is to design an algorithm that enables agents to communicate and exchange information such that, in finite time, agents are able to form a consensus without the use of a centralized control mechanism. The primary goal of this research is to introduce and provide supporting evidence for Stochastic Local Observation/Gossip (SLOG) algorithms as a new class of solutions to the decentralized consensus problem for multi-agent systems that lack a centralized controller, with the additional constraints that agents act asynchronously, information is discrete, and all consensus options are equally preferable to all agents. Examples of where these constraints might apply include the spread of social norms and conventions in artificial populations, rendezvous among a set of specific locations, and task assignment.This goal is achieved through a combination of theory and experimentation. Information propagation process and an information propagation algorithm are derived by unifying the general structure of multiple existing solutions to the decentralized consensus problem. They are then used to define two classes of algorithms that spread information across a network and solve the decentralized consensus problem: buffered gossip algorithms and local observation algorithms. Buffered gossip algorithms generalize the behavior of many push-based solutions to the decentralized consensus problem. Local observation algorithms generalize the behavior of many pull-based solutions to the decentralized consensus problem. In the language of object oriented design, buffered gossip algorithms and local observation algorithms are abstract classes; information propagation processes are interfaces. SLOG algorithms combine the transmission mechanisms of buffered gossip algorithms and local observation algorithms into a single "hybrid" algorithm that is able to push and pull information within the local neighborhood. A common mathematical framework is constructed and used to determine the conditions under which each of these algorithms are guaranteed to produce a consensus, and thus solve the decentralized consensus problem. Finally, a series of simulation experiments are conducted to study the performance of SLOG algorithms. These experiments compare the average speed of consensus formation between buffered gossip algorithms, local observation algorithms, and SLOG algorithms over four distinct network topologies.Beyond the introduction of the SLOG algorithm, this research also contributes to the existing literature on the decentralized consensus problem by: specifying a theoretical framework that can be used to explore the consensus behavior of push-based and pull-based information propagation algorithms; using this framework to define buffered gossip algorithms and local observation algorithms as generalizations for existing solutions to the decentralized consensus problem; highlighting the similarities between consensus algorithms within control theory and opinion dynamics within computational sociology, and showing how these research areas can be successfully combined to create new and powerful algorithms; and providing an empirical comparison between multiple information propagation algorithms.
Show less
Date Issued: 2015
Identifier: CFE0005629, ucf:50229
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0005629

Title: A Program Manager's Dilemma: Measuring the Effect on Performance of Different Visual Modalities in Mixed Reality Aerial Door Gunnery.
Creator: Stevens, Jonathan, Kincaid, John, Shumaker, Randall, Karwowski, Waldemar, Mohammad, Syed, Sottilare, Robert, University of Central Florida
Abstract / Description: The United States Army continues to develop new and effective ways to use simulation for training. One example is the Non-Rated Crew Member Manned Module (NCM3), a simulator designed to train helicopter crewmembers in critical, high risk tasks such as crew coordination, flight, aerial gunnery, hoist and sling load related tasks. The goal of this study was to evaluate visual modalities' effect on performance in mixed reality aerial door gunnery.There is a strong belief in the United States...
Show moreThe United States Army continues to develop new and effective ways to use simulation for training. One example is the Non-Rated Crew Member Manned Module (NCM3), a simulator designed to train helicopter crewmembers in critical, high risk tasks such as crew coordination, flight, aerial gunnery, hoist and sling load related tasks. The goal of this study was to evaluate visual modalities' effect on performance in mixed reality aerial door gunnery.There is a strong belief in the United States Army that the greater the degree of immersion in a virtual simulation, the more effective that simulation is. However, little scientific research exists that supports this notion. In fact, the true goal of training simulation is to optimize the degree of transfer to the trainee - not to create the most immersive experience possible. As a result, the Army Program Manager frequently faces trade-off dilemmas during the simulation design phase, balancing user desires with cost and schedule constraints. One of those trade-off predicaments, and the unscientific manner in which it was resolved, served as the motivation for this research.A review of the literature was conducted in order to investigate the benefits of simulation for training. The taxonomy of reality, as well as the training efficacy of virtual and mixed reality simulation, were examined. Major concepts, applications and components of virtual and mixed reality simulation training were studied. Prior visual modality research was reviewed and discussed. Two discrete groups of subjects, expert (n = 20) and novice (n = 76), were employed in this study. Participants were randomly assigned to one of two visual modality treatments (Liquid Crystal Display (LCD) flat panel screen or Head-Mounted Display (HMD)) and executed three aerial door gunnery training scenarios in the NCM3. Independent variables were visual modality, trial, immersive tendency and simulator sickness questionnaire scores. Dependent variables included performance, presence and simulator sickness change scores. The results of the study indicate no main effect of visual modality on performance for the expert population while a main effect of visual modality on performance was discovered for the novice population. Both visual treatment groups experienced the same degree of presence and simulator sickness. No relationship between an individual's immersive tendency and their performance and level of presence was found. Results of this study's primary objective are conflicting, by expertise group, and thus both support and challenge the commonly held notion that higher immersive simulation leads to better performance.
Show less
Date Issued: 2014
Identifier: CFE0005422, ucf:50427
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0005422

Title: An approach to improve the failure rate model of a solid state laser by utilizing the Physics of Failure Methodology.
Creator: Thompson, Omar, Kincaid, John, Bass, Michael, Clarke, Thomas, Wiegand, Rudolf, Shumaker, Randall, Bass, Michael, University of Central Florida
Abstract / Description: The ability to predict the failure rate of any military laser is very critical. In-field laser usage does not support the troubleshooting and repairing of a complex electro optical system. The only published laser failure rate model was last updated by the Department of Defense in 1975. Consequently, the failure rate predicted is inaccurate due to model deficiencies. This dissertatiodatn has developed a laser failure rate model for diode pumped lasers with improved failure rate prediction...
Show moreThe ability to predict the failure rate of any military laser is very critical. In-field laser usage does not support the troubleshooting and repairing of a complex electro optical system. The only published laser failure rate model was last updated by the Department of Defense in 1975. Consequently, the failure rate predicted is inaccurate due to model deficiencies. This dissertatiodatn has developed a laser failure rate model for diode pumped lasers with improved failure rate prediction accuracy. The model has surpassed the capabilities of the Department of Defense model by the inclusion of key performance attributes that are currently not taken into account. The scope of work completed was based on a tailored Physics of Failure methodology. The research approach implemented was: 1. Integration of Failure Mode and Effects Analysis to evaluate deployed laser failure. 2. Beam simulation for alignment tolerance analysis. 3. Thermal and vibration effects analysis on laser performance. 4. Analysis and development of a methodology to represent a resonator failure rate model. A secondary contribution of this research effort is supporting the update of the current laser failure rate model. The success of revising the current model relies on leveraging the work of other organizations in the area of failure rate modeling and reliability predictions.
Show less
Date Issued: 2011
Identifier: CFE0004587, ucf:49214
Format: Document (PDF)
PURL: http://purl.flvc.org/ucf/fd/CFE0004587

human-robot interaction (3)	+ -
simulation (3)	+ -
Simulation (2)	+ -
situation awareness (2)	+ -
Clinical Skills (1)	+ -

Cognitive flexibility (1)	+ -
Defense Acquisition (1)	+ -
Diode Pumped Lasers (1)	+ -
Dynamic Innovation Index (1)	+ -
Economic Development (1)	+ -
Economic Indices (1)	+ -
Entrepreneurship (1)	+ -
Expertise (1)	+ -
Failure Rate (1)	+ -
Human-Robot Communication (1)	+ -
Human-Robot Interaction (1)	+ -
ITS (1)	+ -
Implicit Communication (1)	+ -
Innovation (1)	+ -
Innovation Ecosystem (1)	+ -
Instructional Strategies (1)	+ -
Kim's Game (1)	+ -
Medical Simulation (1)	+ -
Modeling (1)	+ -
OPNET (1)	+ -
POMDP (1)	+ -
Perfomance Assessment (1)	+ -
Performance (1)	+ -
Physiological (1)	+ -
Presence (1)	+ -

Shumaker, Randall (19)	+ -
University of Central Florida (19)	+ -
Kincaid, John (6)	+ -
Jentsch, Florian (5)	+ -
Karwowski, Waldemar (4)	+ -

Sims, Valerie (4)	+ -
Lackey, Stephanie (3)	+ -
Sottilare, Robert (3)	+ -
Wiegand, Rudolf (3)	+ -
Mohammad, Syed (2)	+ -
Akbas, Mustafa (1)	+ -
Allred, Kelly (1)	+ -
Barber, Daniel (1)	+ -
Bass, Michael (1)	+ -
Bowers, Clint (1)	+ -
Burgess, Deborah (1)	+ -
Burke, Shawn (1)	+ -
Cendan, Juan (1)	+ -
Clarke, Thomas (1)	+ -
Fiore, Stephen (1)	+ -
Fiorella, Christopher (1)	+ -
Folsom-Kovarik, Jeremiah (1)	+ -
Gonzalez, Avelino (1)	+ -
Hancock, Peter (1)	+ -
Hoekstra, Robert (1)	+ -
Hollander, Christopher (1)	+ -
Jimenez, Camilo (1)	+ -
Keebler, Joseph (1)	+ -
Maraj, Crystal (1)	+ -
Maxwell, Douglas (1)	+ -

Search In

Sort Results By:

Narrow results by:

Topical Subject

Collection

Type of Resource

Language

Creator

Format

Owner