Predictive Analysis of Controllers’ Cognitive Errors Using the TRACEr Technique: A Case Study in an Airport Control Tower

authors:

avatar Gholam Abbas Shirali 1 , avatar Maryam Malekzadeh 1 , *

Department of Occupational Health Engineering, School of Health, Ahvaz Jundishapur University of Medical Sciences, Ahvaz, IR Iran

how to cite: Shirali G A, Malekzadeh M. Predictive Analysis of Controllers’ Cognitive Errors Using the TRACEr Technique: A Case Study in an Airport Control Tower. Jundishapur J Health Sci. 2016;8(2):e60322. https://doi.org/10.17795/jjhs-34268.

Abstract

Background:

In complex socio-technical systems like aviation systems, human error is said to be the main cause of air transport incidents, accounting for about 75 percent of these incidents and events. air traffic management (ATM) is considered a highly reliable industry; however, there is a persistent need to identify safety vulnerabilities and reduce them or their effects, as ATM is very human-centered and will remain so, at least in the mid-term (e.g., until 2025).

Objectives:

The current study aimed to conduct a predictive analysis of controllers’ cognitive errors using the TRACEr technique in an airport control tower.

Materials and Methods:

This paper was done as a qualitative case study to identify controllers’ errors in an airport control tower. First, the controllers’ tasks were described by means of interviews and observation, and then the most critical tasks, which were more likely to have more errors, were chosen to be examined. In the next step, the tasks were broken down into sub-tasks using the hierarchical analysis method and presented as HTA charts. Finally, for all the sub-tasks, different error modes and mechanisms of their occurrence were identified and the results were recorded on TRACEr worksheets.

Results:

The analysis of TRACEr worksheets showed that of a total 315 detected errors, perception and memory errors are the most important errors in tower control controllers’ tasks, and perceptual and spatial confusion is the most important psychological factor related to their occurrence.

Conclusions:

The results of this study led to the identification of many of the errors and conditions that affect the performance of controllers, providing the ability to define safety and ergonomic interventions to reduce the risk of human error. Therefore, the results of this study can be a basis for planning ATM to prioritize prevention programs and safety enhancement

1. Background

Air transport is considered one of the infrastructures and most important factors related to the production and consumption cycle of national systems in the service section. According to the official statistics in Iran, direct transport activities account for more than 9% of the gross national product (GNP), 15% of gross capital, and almost 1.3 million workers in the country to itself. Air transport is the best, most secure, fastest, and safest means of transport and involves minimum time and cost, brought the air transport into consideration. The aviation industry has strategic aspects in every region and country and represents the economic and industrial development of that country; therefore, this industry should be considered an important factor in the cultural, social, and economic development of every society. An important part of the aviation industry, air traffic management (ATM), includes the interactions between human operators, procedures, and technical systems (hardware and software), and this complex interaction between them determines air traffic safety, which all of them (human operators, procedures, and technical systems), are used to ensure the safe guidance of aircraft on land and air (1). ATM is considered a highly reliable industry. However, recent events related to ATM have called into question this notion of high reliability, and there is a persistent need to identify security vulnerabilities and reduce them or their effects (2). Because ATM is very human-centered, the potential risks of human error in the process are high (3). Studies on aviation incidents also suggest that human error is the main cause of incidents in aviation transport, accounting for about 75% of these incidents and events (4). Human error in the aviation industry is defined as the incorrect execution of a specific task by a human operator, which causes a series of subsequent reactions to other tasks, and in the end leads to an adverse event or airplane accident (5). Research to identify areas of undesirable events can be a good source of data to reduce or eliminate errors (6). The main focus of research in the field of human error is primarily on error classification schemes and then preventing errors through the design of error tolerant systems (3). Therefore, the use of techniques for human error identification (HEI), which is widely used for the analysis of human operational errors, is useful. Although these techniques have been available for decades and there are many methods for assessing human errors, they are not universal for each domain. There are development processes for various industries, and every technique must be matched with different industrial characteristics. Because ATM performance is very different from nuclear power operation, rail transport, petrochemical, or medical domain performance, there is a need to consider what approaches have been tested for such industries (2). The TRACEr technique was developed in 1999 by England’s national air traffic service as a tool for classifying human errors and their causes in air traffic control (7). In many studies related to air traffic control and the aviation industry, the TRACEr technique was used as means of error identification for retrospective and predictive analysis of cognitive errors (8-11). This technique has been recently used in other studies to identify rail transport errors (12). The following are some of the reasons for using the TRACEr technique:

1. It provides a useful and high-level description of possible errors and their classification.

2. It presents specific information about perceptional functions that have flaws and their mechanisms.

3. It expresses the psychological reasons for any error’s occurrence.

4. It expresses situations that affect the errors’ occurrence.

5. It allows various errors to be retrieved and identified using the key questions.

2. Objectives

Due to the importance of identifying possible errors in the aviation industry and particularly air traffic control, this study was done with the aim of conducting a predictive analysis of controllers’ cognitive errors using the TRACEr technique. For this purpose, the root causes of controllers’ errors were identified in the airport control tower.

3. Materials and Methods

This study is a qualitative case study. The environment for identifying errors is the control tower of an airport in Iran with a population of about 15 controllers in five shifts of three persons. In each shift, there is one person who serves as the main controller and two auxiliary controllers. The main controllers have rating licenses and are responsible for their shift.

3.1. A Description of the Study Environment

To identify and better understand the errors, it is useful to gain familiarity with the environment and equipment in this study. The flight control tower (tower) is responsible for providing air traffic control service in a usually cylindrical area around the airport and up to a certain height; this area often varies according to the number of flights and facilities of each airport. Those who are responsible for controlling the terminal traffic are called controllers. Controllers, according to the work area classification, are divided into three units: the tower, the radar approach control unit (approach), and the flight path control unit (control center). In some airports, controllers work in the tower and the approach simultaneously, while in other areas, the approach and tower are quite separate from each other and work independently. In the environment of this study, controllers should perform both the approach and control tower duties. In the environment of this study, the controllers’ equipment and facilities for flight guidance include meteorological status equipment, current status declaration equipment for the airport area as the ATIS, radio conversation equipment with the pilot and control center, the light screen of the ramps and the airport region in the form of a touch screen with a flashing visual alarm system, and a radar screen to see the flights on the defined airlines. There is also an alarm system and a light gun for emergency situations to guide planes to the airport landing region in the case of losing radio contact, microphones and headsets for conversations with the pilot, and flight strips with certain colors for writing the information of each flight with respect to the flight direction (e.g., blue paper strips for departure flights, red paper strips for arrival flights).

3.2. Method

In this study, the TRACEr technique proposed by Shorrock and Kirwan was used to analyze predictive cognitive errors (8). First, thorough information was gathered on general descriptions of controllers’ air traffic control tasks and the devices (types of devices used by controllers for guidance flights) of this section through interviews and observations, reviewing controllers’ duties, devices, and prior research that has been done in the control tower. Then the most critical tasks that are more likely to cause errors were selected to examine and identify errors. The controllers’ tasks were analyzed hierarchically using hierarchical task analysis (HTA), tasks and sub-tasks were determined. Eleven main tasks were identified. In the next stage, with field surveys and interviews with controllers, the types of errors and different causes of their occurrence based on the structure of the TRACEr method on all sub-tasks derived from the previous step were identified by the researcher in the worksheet, according to the following steps:

1. Determining the external error mode (EEM): The EEM is actually the external and visible mode of actual or potential errors according to the reasonable consequences of one's wrong actions. Thus, the possible errors are described in three categories: qualitative and selection errors, sequence and time errors, and communication errors (Box 1). This classification of the EEM in the TRACEr technique has been adapted from Swain and Guttmann’s classification (13). As an example, the controller transfers incorrect data (communication error) or does not do monitoring (omission error of the qualitative and selection error type), 2. Performance-shaping factors (PSFs): This step classifies the factors that influence or can influence controllers’ performance and enhance error occurrence or help to improve errors in accordance with the factors classification in Box 2. Identifying the internal error mode (IEM): In this step, the IEM is expressed and specific information is presented about what cognitive functions and what method failed or could fail. Error examination at this point is done in, 4.areas: perception, memory, decision-making and planning, and action in accordance with the error classification in Table 1. The TRACEr technique this step is based on a human information processing model (Figure 1) in which human error is considered an error in human information processing and is compatible with Wickens’s model from 1992 (8, 14). 5. Psychological error mechanisms (PEMs): PEMs involve psychological reasons for any internal error (Table 1). For example, the controller forgets to do flight monitoring and the psychological reason for this is that the controller was distracted by other tasks, 6. Error detection and recovery: At this stage, it becomes clear which errors can be identified and which can possibly be recovered. Finally, with the help of EXCEL software, data were analyzed and the percentage and frequency was determined for all errors. The implementation process used in this study based on the TRACEr technique is presented in Figure 2.

Box 1.

EEM Taxonomy

Selection and Quality
Omission
Action too much
Action too Little
Action in Wrong mirection
Wrong Action on right object
Right Action on Wrong object
Wrong Action on Wrong object
Extraneous act
Timing and Sequence
Action too long
Action too short
Action too early
Action too late
Action repeated
Miss-ordering
Communication
Unclear information transmitted
Unclear information recorded
Information not sought/obtained
Information not transmitted
Information not recorded
Incomplete information transmitted
Incomplete information recorded
Incorrect information transmitted
Incorrect information recorded
Box 2.

PSF Taxonomies

PSF Taxonomies
Traffic and airspace. e.g. traffic complexity
Pilot/controller communications. e.g. rt workload
Procedures. e.g. accuracy
Training and experience. e.g. task familiarity
Workplace design, hmi and equipment factors. e.g. radar display
Ambient environment. e.g. noise
Personal factors. e.g. alertness/fatigue
Social and team factors. e.g. handover/takeover
Organisational factors. e.g. conditions of work
Table 1.

IEMs and PEMs

Cognitive Domains
IEMPEM
Perception
No detection (visual) Expectation bias
Late detection (visual) Spatial confusion
Misread Perceptual confusion
Visual misperception Perceptual discrimination failure
Misidentification Perceptual tunneling
No identification Stimulus overload
Late identification (visual)Vigilance failure
No detection (auditory) Distraction/preoccupation
Hearback error
Mishear
Late auditory recognition
Memory
Forget to monitor Similarity interference
Prospective memory failure Memory capacity overload
Forget previous actions Negative transfer
Forget temporary information Mislearning
Misrecall temporary information Insufficient learning
Forget stored information Infrequency bias
Misrecall stored information Memory block
Distraction/preoccupation
Incorrect knowledge
Judgment, Planning, and Decision Making
MisprojectionLack of knowledge
Poor decisionFailure to consider side or long-term effects
Late decisionIntegration failure
No decision Misunderstanding
Poor plan Cognitive fixation
No plan False assumption
Under-plan Prioritization failure
Risk recognition failure
Decision freeze
Action Execution
Selection error Manual variability
Positioning error Spatial confusion
Timing error Habit intrusion
Unclear information transmittedPerceptual confusion
Unclear information recorded Functional confusion
Incorrect information transmittedDysfluency
Incorrect information recordedMisarticulation
Information not transmittedInappropriate intonation
Information not recordedThoughts leading to actions
Environmental intrusion
Other slip
Distraction/preoccupation
Human Information Processing Model
Human Information Processing Model
The Steps of the TRACEr Technique
The Steps of the TRACEr Technique

4. Results

HTA tables have been designed and TRACEr worksheets were also completed for controllers’ 11 major tasks. The HTA image of departure flight guidance tasks along with a part of its completed worksheets has been provided in Appendices of this article. The results of the TRACEr technique application for these tasks showed that in 84 sub-tasks derived by HTA, there were 315 errors in the controllers’ tasks. Regarding the percentage of error rates among external errors shown in Table 2, qualitative and selection errors accounting for 57% and a frequency of 73 form the largest number of external errors, followed by sequence and time errors with 23.40% and communication errors with 19.50% were respectively the most frequent external errors. Among the qualitative and selection errors, omission and then wrong actions on the right objects were the most frequent errors. Regarding the sequence and time errors, most errors were due to controllers’ late action. In the third category of errors, communication errors typically involved inaccurate and unclear transfers of information or unclear records of information. In classifying the internal errors, which include errors of perception, memory, decision-making and action, as shown in Table 3, memory errors (31.5%) were the most common, followed by perception errors (26.7%), action (26.2%), and decision-making (15.5%). Most memory errors are related to forgetting the action, prospective memory failures, and forgetting the previous actions. Perception errors tended to involve inaccurate visual perception, hearback errors, and the misreading of information; in the case of action errors, data transfer errors and then time errors were the most common types of errors. In the case of decision-making and planning errors, poor decision-making and inaccurate prediction were the most frequent. The results of the PEM and PSFs are shown in Tables 4 and 5. Among the PEMs, which account for the most probable reason for error occurrence, preoccupation and distraction were the most common causes, with 29.41%, followed by perceptional confusion, spatial confusion, and memory capacity overload. In the case of PSFs, the workload due to the traffic volume and the conversation load (induce of conversation between controller and pilot, controller and controller in other airport, controller and land safety) with (36.21%), personal factors such as fatigue and alertness (31.35%), and training and experience (9.71%) were the most common factors affecting controllers’ performance.

Table 2.

Summary of EEM Results

Error TypesEEMFrequentTotalPercent
Selection and quality7357
Omission27
Action too little10
Action in wrong direction16
Wrong action on right object20
Timing and sequence3023.40
Action too long1
Action too short2
Action too early5
Action too late21
Miss-ordering1
Communication2519.50
Unclear information transmitted1
Incomplete information transmitted4
Incorrect information transmitted10
Information not transmitted1
Unclear information recorded3
Incorrect information recorded3
Information not recorded1
Incomplete information recorded2
Table 3.

Summary of IEM Results

Cognitive DomainsIEMFrequencyTotalPercent
Perception5026.73
Visual misperception8
Misread6
Misidentification5
Late detection (visual)5
No detection (visual)5
Late auditory recognition3
No detection (auditory)3
Late identification (visual)3
Hearback error7
Mishear5
Memory5931.55
Forget to monitor25
Prospective memory failure12
Forget previous actions10
Forget temporary information3
Misrecall temporary information2
Forget stored information2
Judgment, planning, and decision making2915.50
Misprojection8
Poor decision10
Late decision2
Poor plan7
No plan3
Action execution4926.20
Selection error2
Timing error18
Transmission error16
Record error13
Table 4.

Summary of PEM Results

PEMFrequencyPercent
Distraction/preoccupation5029.41
Memory capacity overload137.64
Vigilance failure74.11
Spatial confusion169.41
Perceptual confusion1911.17
Lack of knowledge74.11
False assumption74.11
Inappropriate intonation63.52
Memory block63.52
Expectation bias52.94
Prioritization failure63.52
Perceptual tunneling52.94
Failure to consider side or long term effects10.58
Stimulus overload10.58
Risk recognition failure21.17
Environmental intrusion31.76
Similarity interference31.76
Incorrect knowledge21.17
Infrequency bias21.17
Risk negation or tolerance21.17
Manual variability42.35
Misarticulation10.58
Insufficient learning10.58
Table 5.

Summary of PSF Results

PSFFrequencyPercent
Traffic and airspace (traffic complexity, rt workload)6736.21
Procedures (complexity, accuracy, number)63.24
Training and experience189.72
Workplace design, hmi and equipment factors158.10
Personal factors (alertness/fatigue)5831.35
Social and team factors52.70
Ambient environment (light, noise)52.70
Organizational factors115.94
Total185100

5. Discussion

To achieve the research aims, a predictive analysis of controllers’ cognitive errors in an airport control tower using the TRACEr technique was conducted. The most commonly applied method for human error identification in ATM is TRACER and this method can be used to ensure that all critical errors and human interactions have been identified (13). Therefore, the use of such a technique that is compatible with the study environment and tested for air traffic increases the accuracy and reliability of the results. The results showed that memory and perception errors are the most frequent in controllers’ tasks. Air traffic controllers’ tasks demand strong audio-visual perception, and controllers have to process a lot of information in a limited period. In addition, they need to constantly maintain their performance. Therefore, it is not surprising that perception errors occur, including information failing to be identified or detected, or inaccurately detected. The results of the current study are similar to those of Corver (2014). In Cover’s study, done in a control center, perception and memory errors were the most common errors. However, in this respect that perception errors prior considered memory errors Is incompatible So that in the Corver’s study, perception errors were more frequent than memory errors; this difference may be due to the different nature of the duties of the controller in the control tower versus in a control center (15). The results of another study involving 143 aviation accidents by Jones and Endsley, showed that 72% of the errors caused by controllers are related to perception errors (16). Regarding the types of perception errors, identifying errors are more related to tasks such as radio conversations, marking flight data on the flight progress strips, and monitoring the radar that appear usually as mishearing and hearback error. Regarding visual identification errors that is one item of types perception errors (Table 2), they mostly involved, wrong visual identification, not identifying or misreading that due to the use of handheld and radio devices by controller in directing flights, That, in this study, showed a greater proportion of the perception errors. Other types perception errors are detection errors that involve visual and aural recognition, more frequently involved in radar monitoring duties, in the form of flashing visual and aural warnings recognition, therefore in current study because use of flight strips, procedural method for guidance flights, Since the radar screen in the environment of this study shows flights on airlines on a monitor and has no means of seeing and hearing alerts. the controller does not use it in this field as a working tool, This error is less extensive, visual and hearing recognition errors have small frequency in the controller duties in current study. The types of perception errors (e.g., visual identification, hearback, and misread errors) identified in this study partially correspond with the types of perception errors in Corver’s study in 2014 (15) and Shorrock’s study in 2007 (9). Regarding the importance of the role of memory in the controllers’ tasks, it can also be said that memory lapses cause many events related to ATC (17, 18). This is due to the fact that memory is a significant determining factor of the air traffic controllers’ performance and the controller forms a mental picture of the various aspects of a plane and airspace using his/her working memory and long-term memory. Thus, understanding perception and memory errors can prevent many related events. Regarding memory errors, as shown in the results, forgetting tasks and prospective memory failure accounted for most of the memory errors in this study. The failure to remember scheduled tasks, such as writing a new height on the strip, updating, and adjusting the paths on the strip, coordination with the aircrafts, and the early transfer of a plane to the control center, usually occur when traffic is high. Shorrock also reported the highest frequency of this type of memory error in the results obtained by interviews with controllers in the control center and the results obtained by examining aircraft proximity incidents (10). The controllers’ tasks in a control tower are operational not operating (the characteristic of an operational task is to carry out an activity through perceptional paths to obtain information and then make a decision by retrieving information from memory and then taking action). Thus, in carrying out an activity at each stage of this process, some slips may occur that, in the result, appear as an error. Slips can occur just in the perception and memory stage and also involve other processing routes at the same time. In addition, the results of a study conducted in 2012 by Hassanzadeh confirm that the human error of cognitive failure that occurs in one or all three steps of processing information arises (19). Therefore, the controller should maintain continuously conscious attention to reduce the amount of possible errors. As also shown in the results, the most common psychological reason for the controllers’ errors was preoccupation and distraction. When a controller attends to other tasks, it can decrease his/her attention and lead to an error. As Jones also mentioned, this factor is the most common cause of controllers’ failure in monitoring or observing the data (16). Considering the fact that the controller can engage in various types of behaviors under certain circumstances, the identification and evaluation of factors that influence performance is a necessity for preventing and reducing human error to improve safety (20). Therefore, in this study, by identifying these factors, it was found that a high workload due to traffic volume, conversation load, and traffic complexity is the most important factor impacting controllers’ performance. Personal factors, such as controller’s fatigue, and then experience and training followed as the second and third most effective factors related to controllers’ performance. These results, of course, correspond with the findings of De Ambroggi, who examined all the factors that influence controllers’ performance in a safety case in a control tower (21). To assess the volume of air traffic and its impact on the incidence of human error in air traffic control, Moon et al. in 2011 showed that various types of human error in ATC are affected by traffic volume and a significant correlation exists between the traffic volume and human errors, which also shows the importance of the traffic volume factor. Therefore, it is necessary to estimate the appropriate traffic volume, air traffic control facilities, and aviation sector conditions to be considered (22). The importance of education and experience was also expressed as an important factor shaping performance in this study. A study done in 2010 by Mazlomi based on the CREAM technique, quality training and work experience is one of the factors associated with reduced quality performance (23). Thus, it is necessary to pay attention to training, and special attention should be given to the systematic planning and scheduling of training, retraining, and refresher educational materials adapted to the requirements of the job and design and implement, to be able hereby, the occurrence of errors in performing controllers’ duties can be prevented. e.g., through simulators’ design that different working conditions Including emergency situations, types controller performance in high traffic are tested, Strategies teach to deal with such situations. Thus, if we update controllers’ functional equipment and replace electronic equipment like electronic flight strips and electronically send direct orders instead of radio conversations as well as use support equipment to detect interferences, such as short-term interference alerts, we can reduce many perception and memory errors by early detection and by providing an opportunity to correct and improve errors as well as reducing controller’s mental load that is due to keeping high levels of data and at the same time quick and on time reaction, which requires the controllers’ continuous and conscious attention. Indeed. Mental workload will be reduced in various ways. First of all, mental workload has been reduced by either reducing the load on the working memory, or by replacing laborious tasks with tasks involving less actions or require less time with respect to the execution. A study in 2014 was conducted to assess the impact of controllers’ support tools on cognitive errors by performing a comparative analysis of the two operational environments using the TRACEr technique as a means of error identification. The findings indicated that errors related to detection, memory, decision-making, and action would be reduced by changing the operational system and applying modern equipment (15). We can conclude that the TRACEr technique, which was developed as a tool for classifying human errors and their causes in air traffic control, easily identifies and separates many errors due to the cognitive nature of air traffic tasks. The findings of this study led to the identification of many errors and the conditions affecting controllers’ performance, thus providing the ability to define safety and ergonomic interventions to reduce the risk of human errors. Therefore, the results of this study can be the basis of planning ATM to prioritize prevention programs and safety enhancement.

A1. Appendix 1

A2. Appendix 2

Table A1.

TRACEr Worksheet of Some Departure Flight Guidance Tasksa

Task stageEEMIEM PEMPSFIdentificationRecovery
1-2-1 controller’s contact with the control center givingSequence and time contact is done latePerception: wrong reading, wrong visual perceptionConfusion and preoccupation Equipment factor like cutting off the phoneBy the controller after monitoringBy the controller
Departure flight information and flight destination and time of airplane’s exit- Communication; incorrect data is transferred (such as radar code or aircraft type)Action; transmission error (incorrect data is transmitted) and time errorEnvironmental interference High workload due to calls and traffic volume
Radar code for confirming the altitude or changing the altitudePerceptional confusion, spatial confusionPersonal factorsuch as fatigue and lack of concentration and alertness

Acknowledgements

References

  • 1.

    In: Blom H, Bakker GJ, Everdij MHC, Van der Park MNJ editors. . Proceedings of European Control Conference. 2003.

  • 2.

    Kirwan B, Gibson H. CARA: A human reliability assessment tool for air traffic safety management—Technical basis and preliminary architecture. The safety of systems.: Springer; 2007. p. 197-214.

  • 3.

    Hollnagel E. Cognitive Reliability Assessment Methodology. Academic Press, London; 1997.

  • 4.

    Shappell SA, Wiegmann DA. US naval aviation mishaps, 1977-92: differences between single-and dual-piloted aircraft. ASEM. 1996;67(1):65-9.

  • 5.

    Netjasov F, Janic M. A review of research on risk and safety modelling in civil aviation. J AIR TRANSP MANAG. 2008;14(4):213-20. https://doi.org/10.1016/j.jairtraman.2008.04.008.

  • 6.

    Espin S, Levinson W, Regehr G, Baker GR, Lingard L. Error or "act of God"? A study of patients' and operating room team members' perceptions of error definition, reporting, and disclosure. Surgery. 2006;139(1):6-14. [PubMed ID: 16364712]. https://doi.org/10.1016/j.surg.2005.07.023.

  • 7.

    Isaac A, Shorrock ST, Kirwan B. Human error in European air traffic management: the HERA project. Reliability Engineering & System Safety. 2002;75(2):257-72. https://doi.org/10.1016/s0951-8320(01)00099-0.

  • 8.

    Shorrock ST, Kirwan B. Development and application of a human error identification tool for air traffic control. Applied Ergonomics. 2002;33(4):319-36. https://doi.org/10.1016/s0003-6870(02)00010-8.

  • 9.

    Shorrock ST. Errors of perception in air traffic control. Safety Science. 2007;45(8):890-904. https://doi.org/10.1016/j.ssci.2006.08.018.

  • 10.

    Shorrock ST. Errors of memory in air traffic control. Safety Science. 2005;43(8):571-88. https://doi.org/10.1016/j.ssci.2005.04.001.

  • 11.

    Gordon R, Shorrock ST, Pozzi S. Predicting and simulating human errors in using the airborne separation assurance. Human factors and aerospace safety. 2005;5(1):43-60.

  • 12.

    Baysari MT, Caponecchia C, McIntosh AS. A reliability and usability study of TRACEr-RAV: The technique for the retrospective analysis of cognitive errors – For rail, Australian version. Appl Ergon. 2011;42(6):852-9. https://doi.org/10.1007/978-1-4471-0653-1_2.

  • 13.

    Kirwan B. A guide to practical human reliability assessment. british library: CRC press;. p. 1994. 133-64.

  • 14.

    Baysari MT, Caponecchia C, McIntosh AS. A reliability and usability study of TRACEr-RAV: the technique for the retrospective analysis of cognitive errors for rail, Australian version. Appl Ergon. 2011;42(6):852-9. [PubMed ID: 21354553]. https://doi.org/10.1016/j.apergo.2011.01.009.

  • 15.

    Corver SC, Aneziris ON. The impact of controller support tools in enroute air traffic control on cognitive error modes: A comparative analysis in two operational environments. Safety Science. 2015;71:2-15. https://doi.org/10.1016/j.ssci.2014.07.018.

  • 16.

    Jones DG, Endsley MR. Sources of situation awareness errors in aviation. Aviation, Space, and Environmental Medicine. 1996.

  • 17.

    Pape AM, Wiegmann DA, Shappell S, editors. Air traffic control (ATC) related accidents and incidents: A human factors analysis.; Proceedings of the 11th International Symposium on Aviation Psychology, Columbus, OH, The Ohio State University. 2001.

  • 18.

    Cardosi K. Operational errors in air traffic control towers. Air Traffic Control Quarterly. 2002;10(2).

  • 19.

    Hassanzadeh Rangi N, Allahyari T, Khosravi Y, Zaeri F, Saremi M. Development of an Occupational Cognitive Failure Questionnaire (OCFQ): Evaluation validity and reliability. IOH. 2012;9(1):29-40.

  • 20.

    Park J. Scrutinizing inter-relations between performance influencing factors and the performance of human operators pertaining to the emergency tasks of nuclear power plant – An explanatory study. Ann. Nucl. Energy. 2011;38(11):2521-32. https://doi.org/10.1016/j.anucene.2011.07.006.

  • 21.

    De Ambroggi M, Trucco P. Modelling and assessment of dependent performance shaping factors through Analytic Network Process. Reliability Engineering & System Safety. 2011;96(7):849-60. https://doi.org/10.1016/j.ress.2011.03.004.

  • 22.

    Moon WC, Yoo KE, Choi YC. Air Traffic Volume and Air Traffic Control Human Errors. JTT. 2011;1(3):47-53. https://doi.org/10.4236/jtts.2011.13007.

  • 23.

    Mazlomi A, Hamzeiyan Ziarane M, Dadkhah A, Jahangiri M, Maghsodipour M, Mohadesy P, et al. Assessment of Human Errors in an Industrial Petrochemical Control Room using the CREAM Method with a Cognitive Ergonomics Approach. J Sch Public Health Inst Public Health Res. 2011;8(4):15-30.