Automation reliability, human–machine system performance, and operator compliance: A study with airport security screeners supported by automated explosives detection systems for cabin baggage screening
No Thumbnail Available
Author (Corporation)
Publication date
2020
Typ of student thesis
Course of study
Collections
Type
01A - Journal article
Editors
Editor (Corporation)
Supervisor
Parent work
Applied Ergonomics
Special issue
DOI of the original publication
Link
Series
Series number
Volume
86
Issue / Number
Pages / Duration
1-12
Patent number
Publisher / Publishing institution
Elsevier
Place of publication / Event location
Edition
Version
Programming language
Assignee
Practice partner / Client
Abstract
Using a simulated X-ray screening task, we tested 122 airport security screeners working with the support of explosives detection systems for cabin baggage screening (EDSCB) as low-level automation. EDSCB varied systematically on three automation reliability measures: accuracy, d’, and positive predictive value (PPV). Results showed that when unaided performance was high, operator confidence was high, and automation provided only small benefits. When unaided performance was lower, operator confidence was lower, and automation with higher d’ provided large benefits. Operator compliance depended on the PPV of automation: We found lower compliance for lower PPV. Automation with a high false alarm rate of 20% and a low PPV of .3 resulted in operators ignoring about one-half of the true automation alarms on difficult targets—a strong cry-wolf effect. Our results suggest that automation reliability described by d’ and PPV is more valid than using accuracy alone. When the PPV is below .5, operators should receive clear instructions on how to respond to automation alarms.
Keywords
Human–automation interaction, Airport security baggage screening, Visual search
Subject (DDC)
Event
Exhibition start date
Exhibition end date
Conference start date
Conference end date
Date of the last check
ISBN
ISSN
0003-6870
1872-9126
1872-9126
Language
English
Created during FHNW affiliation
Yes
Strategic action fields FHNW
Publication status
Published
Review
Peer review of the complete publication
Open access category
License
Citation
HÜGLI, David, Sarah MERKS und Adrian SCHWANINGER, 2020. Automation reliability, human–machine system performance, and operator compliance: A study with airport security screeners supported by automated explosives detection systems for cabin baggage screening. Applied Ergonomics. 2020. Bd. 86, S. 1–12. DOI 10.1016/j.apergo.2020.103094. Verfügbar unter: https://irf.fhnw.ch/handle/11654/31922