Modelling a quantitative assessment method of pilots’ performance in evidence-based training

    Zarif Zabirov   Affiliation
    ; Anvar Zabirov   Affiliation
    ; Vladimir Shestakov   Affiliation


With the improvement in reliability of modern aircraft systems, an increase in their complexity led to the fact that failures became non-standard and problematic to predict. As a result, IATA guided the development of Evidence-Based Training (EBT), which is an innovative approach to the training and assessment of pilots’ competencies based on the evidence obtained from their performance. Yet, operators planning to use this framework should develop line-oriented scenarios based on EBT methodology and a grading system for a clear assessment. In this paper, a method for modelling a quantitative assessment and grading of pilots’ performance is proposed. The method may be used as part of an EBT assessment programme due to its adaptability to different grading strategies according to quantifiable error criteria, the number of occurrences during the evaluation, and prior data on the distribution of pilots by their competency levels.

Keyword : evidence-based training, pilot assessment, core competencies, grading system, error criteria, flight occurrences

How to Cite
Zabirov, Z., Zabirov, A., & Shestakov, V. (2022). Modelling a quantitative assessment method of pilots’ performance in evidence-based training. Aviation, 26(4), 217–223.
Published in Issue
Nov 30, 2022
Abstract Views
PDF Downloads
Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.


European Aviation Safety Agency. (2013). EASA Safety Information Bulletin SIB 2013-05 (pp. 1–3).

European Aviation Safety Agency. (2015). ED Decision 2015-027-R. Implementation of evidence-based training (EBT) within the European regulatory framework (pp. 1–11).

European Aviation Safety Agency. (2016a). EASA Part-FCL.

European Aviation Safety Agency. (2016b). European Aviation Safety Agency Acceptable Means of Compliance (AMC) and Guidance Material (GM) to Annex III-Part-ORO (Issue 2, p. 206).

European Aviation Safety Agency. (2019). European Plan for Aviation Safety (EPAS) 2020–2024.

Federal Aviation Administration. (1988). Advisory Circular 25.1309–1A System Design and Analysis.

Federal Aviation Administration. (2013). SAFO 13002 manual flight operations. In Safety alert for operators.

Flight Safety Foundation. (1997). Facilitating LOS debriefings: A Training Manual (Issue November). FSF.

Hazzauri, M., & Shestakov, V. (2000). Statistical modelling of operative decision making by the ATC controller in conditions of insufficient information. In Nauchnyi vestnik MGTU GA (Issue September, pp. 67–76). MGTUGA.

International Air Transport Association. (2013). Evidence-based training implementation guide (1st ed., Issue July). IATA.

International Civil Aviation Organization. (2013). Manual of Evidence-based Training DOC 9995 (1st ed.). ICAO.

Karaush, V. L. (1991). Statisticheskoe modelirovanie processa prinyatia reshenia operatorom (pilotom) v usloviah ogranichennoi informacii [Doctoral Dissertation, Saint Petersburg State University of Civil Aviation]. Saint Petersburg, Russia.

Mixon, T. R., & Moroney, W. F. (1981). An annotated bibliography of objective pilot performance measures (Technical report: IH-330). Naval Training Equipment Center. Orlando, FL.