I'll help you with a literature review on system thinking principles applied to driving automation systems with a focus on the human operator. To better tailor the review to your needs, I'd like to clarify a few points:
Are you interested in any specific levels of driving automation (e.g., SAE levels 1-5), or should the review cover all automation levels?
Would you like the literature review to focus on any particular aspects of human-automation interaction (e.g., situation awareness, trust, workload, handover situations)?
Do you have a specific timeframe for the literature you'd like covered (e.g., recent publications within the last 5-10 years, or a comprehensive historical review)?
I'll prepare a comprehensive literature review examining how system thinking principles have been applied to driving automation systems across all automation levels (SAE Levels 1-5), with specific focus on the human operator aspects. The review will cover relevant literature from the past 20 years (approximately 2005-2025).
The literature review will be organized into the following sections:
Introduction
Theoretical Frameworks
Human Operator Aspects Across Automation Levels
Transition of Control
Problem Breakdown
Action Plan
Let me begin by searching for relevant literature.
Search
system thinking principles driving automation human operator literature reviewI need to gather more specific information about system thinking principles applied to driving automation systems with a focus on human operators. Let me search for more targeted literature.
Search
sociotechnical systems approach driving automation human factorsInformation Already Gathered
Next Steps Action Plan
Let me start by examining a key paper on human factors in driving automation to understand the theoretical frameworks being applied.
The article introduces the concept of Meaningful Human Control (MHC) in the context of automated vehicles. As vehicles become increasingly automated, preserving human control becomes a critical challenge. The authors present MHC as a function within an Automated Driving System (ADS) framework, which helps trace the chain of control in automated vehicles.
The framework is built around four main categories: Driver, Vehicle, Infrastructure, and Environment. The Driver components include traits (personality, physique), state (mental/physical condition), perception (visual, auditory, etc.), cognition (information analysis, decision-making), and action skills. The Vehicle components are divided into manual systems (traditional vehicle controls) and automated systems (sensors, automated control software, and actuation systems).
The paper emphasizes two key conditions for MHC: trackability (ability to track human moral reasoning) and traceability (understanding the chain of control and consequences). This framework allows vehicle manufacturers, software developers, and regulatory authorities to address challenges related to human control in automated vehicles.
The authors discuss the operationalization of MHC and provide application examples to demonstrate its relevance. The framework aims to structure discussions on automated driving implications, particularly regarding control and responsibility. It serves as a foundation for ADS design, simulation development, ethical considerations, and regulatory approaches to vehicle and driver licensing.
The paper positions MHC as essential in a traffic system that relies on human-technology interactions, where automated systems must act in ways acceptable to humans. The framework helps identify research areas and develop models for projecting future impacts of automated vehicles.
The webpage presents a comprehensive framework for understanding Meaningful Human Control (MHC) in Automated Driving Systems (ADS). Key information includes:
Definition of MHC: Described as "humans, not computers and their algorithms, should ultimately remain in control of, and thus morally responsible for relevant decisions about operations."
Core conditions of MHC:
Core components framework of ADS:
Challenges addressed by MHC:
Applications of the MHC framework:
Transition of control in automation levels:
Importance of MHC:
No links were provided in the webpage content.
No images were provided in the webpage content, though Figure 1 (Driver core components of control in ADS) and Figure 2 (Vehicle core components of control in ADS) are mentioned in the text but not available for extraction.
Let me search for more information about system thinking principles specifically applied to automated driving systems.
Search
systems thinking principles automated driving human factors SAE levelsLet me access a key paper on human factors in automated driving systems to understand the application of systems thinking principles.
Website Browse
https://www.researchgate.net/publication/313367679_A_Human_Factors_Perspective_on_Automated_DrivingThe webpage appears to be a technical documentation or guide related to information analysis. The image shows what seems to be a dense text document with multiple sections and possibly some structured content. The layout suggests it could be an academic paper, technical manual, or comprehensive guide about information analysis methodologies.
The document appears to have multiple sections with headings and subheadings, possibly organized in a hierarchical structure. There seems to be substantial text content that likely explains concepts, methodologies, or procedures related to information analysis. The formatting suggests a formal, technical document rather than a casual webpage.
Due to the image quality and format, specific details of the text content are not clearly legible, making it difficult to identify precise topics, arguments, or data presented in the document. The overall impression is of a comprehensive technical resource that likely provides in-depth information on analytical methods, frameworks, or processes related to information analysis.
No content related to the question. The image shows what appears to be a technical document, but the text is not clearly legible in the provided format. While the document might contain information about information analysis broadly, I cannot confirm whether it specifically addresses prompt engineering or related concepts based on the visible content in the image.
There are no visible clickable links that can be identified in the provided image. The content appears to be a static document rather than an interactive webpage with hyperlinks.
No images related to prompt engineering can be clearly identified in the provided content. The entire content is presented as a single image of what appears to be a text document, but the specific content and any embedded images within that document cannot be clearly discerned due to the format and resolution of the provided image.
I need to access more specific content about systems thinking principles applied to automated driving systems. Let me try a different approach by searching for a specific paper.
Search
STAMP STPA systems theoretic process analysis automated driving human factorsInformation Already Gathered
Next Steps Action Plan
Let me access a key paper on STPA application to automated driving systems to understand how this systems thinking approach addresses human factors.
This document is a Master's thesis titled "STPA-Inspired Safety Analysis of Driver-Vehicle Interaction in Cooperative Driving Automation" by Max Stoltz-Sundnes at KTH (Royal Institute of Technology in Stockholm, Sweden). The thesis focuses on safety analysis of cooperative autonomous driving systems, particularly examining human-machine interaction (HMI) aspects.
The research is based on a case study of KTH's participation in the 2016 Grand Cooperative Driving Challenge (GCDC), where autonomous cooperative vehicles were tested in three real-life traffic scenarios. The author uses Systems Theoretic Process Analysis (STPA) to assess the functional safety of cooperative driving functionality, resulting in system-level safety constraints.
The analysis identified deficiencies in HMI-related aspects of the system. The thesis then describes how the author enhanced the driver-vehicle interaction components by introducing visual elements, addressing new driver-centric hazards such as mode confusion and unfair transitions, and developing a strategy for safe transitions between autonomous and manual driving states.
The enhanced system was analyzed using both STPA and a new method specifically designed for safe mode switching in autonomous vehicles. The results indicated that accidental or faulty inputs from the driver posed the greatest threat for mode confusion - situations where either both the vehicle and driver believe they are in control, or neither believes they are responsible for controlling the vehicle. These issues were often caused by malfunctioning controls or faulty dashboard indicators.
The document includes figures showing the research vehicle, workflow diagrams, safety analysis methodologies, system architecture, and interface designs for different driving modes and scenarios.
The webpage contains extensive information about safety analysis of driver-vehicle interaction in cooperative autonomous driving systems. Key points include:
Cooperative Driving Definition: The thesis examines autonomous vehicles with cooperative functionality, which allows vehicles to communicate with each other (V2V) and with infrastructure (V2I), collectively referred to as V2X communication.
Safety Analysis Methodology: The research primarily uses Systems Theoretic Process Analysis (STPA), comparing it with traditional methods like FMEA (Failure Mode and Effects Analysis) and HAZOP (Hazard and Operability study). STPA is based on the Systems Theoretic Accident Model and Processes (STAMP) causality model.
Human-Machine Interface Challenges: The analysis identified critical HMI-related safety issues, particularly around mode confusion - where uncertainty exists about whether the vehicle or driver is in control.
Automation Levels: The document references SAE (Society of Automotive Engineers) levels of automation, discussing the challenges of transitions between manual and autonomous driving modes.
Safety Constraints: The analysis produced numerous safety constraints for driver-supervisor interactions and supervisor-driver feedback, focusing on preventing unsafe control actions.
Mode Transition Design: The thesis presents a detailed design for safe transitions between manual driving (MD) and autonomous driving (AD) modes, including visual dashboard elements and input sequences.
Scenario Analysis: Three specific scenarios were analyzed: highway merge, emergency vehicle response, and T-intersection navigation, with specific mode transition protocols for each.
Driver Responsiveness: The research addresses the need to monitor driver attention and responsiveness, especially during critical transition periods.
Risk Assessment: The analysis includes ASIL (Automotive Safety Integrity Level) assessments based on severity, exposure, and controllability of various hazards.
Research Context: The work was conducted at KTH's Integrated Transport Research Lab (ITRL) using their Research Concept Vehicle (RCV) in the context of the Grand Cooperative Driving Challenge competition.
No webpage links are present in the provided PDF content.
Figure 1.1: KTH's Research Concept Vehicle
Figure 1.2: Overview of thesis workflow
Figure 2.3: Graphic representation of the STAMP accident causality model
Figure 3.7: Capella model with highlighted functional chain of the driver-to-supervisor control loop
Figure 4.1: Dashboard appearance while in, and transitioning between, Manual and Autonomous driving modes
Figures 4.2-4.5: Mode transitions for different scenarios
Let me search for more specific information about system thinking principles applied to human factors in automated driving systems.
Search
systems thinking principles human factors automated driving review mental models situation awareness trust workloadLet me access a comprehensive review on human factors in automated driving systems to understand how system thinking principles are applied.
Website Browse
https://www.mdpi.com/2076-3417/10/24/8914This webpage presents a comprehensive academic article about research methodologies in automated driving (AD) studies. The article reviews 161 scientific papers from 2010-2018 focusing on driving automation from a human factors perspective. The authors aim to provide an overview of existing methodological approaches and investigated constructs to help researchers conduct studies with established methods.
The introduction explains how automated driving systems present unique challenges compared to aviation automation due to the time-critical nature of driving and greater variety among users. The authors note that the multitude of research approaches makes it difficult to integrate findings across studies.
The article reviews the status quo of research on automated vehicle human-machine interfaces (HMIs), identifying key topics including take-over requests, controllability, fatigue, mode awareness, automation trust, public acceptance, usability, and user experience. It also discusses various study design approaches, including different simulation environments (from low to high fidelity), test tracks, real roads, and survey-based methods.
The methodology section describes how the authors selected relevant journals and conferences through an expert survey, identifying Transportation Research Part F, Journal of Human Factors, Accident Analysis and Prevention, AutomotiveUI, Human Factors and Ergonomics Society Annual Meeting, and CHI as the most important venues.
The results (partially shown in Figure 1) indicate that most studies focused on safety aspects, followed by trust and acceptance (primarily collected through self-report measures). Driving/take-over performance was also frequently studied, though with wide variation in parameters.
The article provides a systematic review of research methodologies in automated driving studies from 2010-2018, analyzing 161 scientific papers. The authors identified several key research constructs being investigated:
Safety aspects: Most studies focused primarily on safety-related issues.
Trust and acceptance: These were frequently studied constructs, mainly collected through self-report measures.
Take-Over Requests (TOR): Early research efforts focused on scenarios where drivers need to regain manual control, revealing issues with controllability, fatigue, mode awareness, and automation trust.
Usability and User Experience (UX): More recent studies have expanded beyond safety to examine how effectively users interact with driving automation systems and their satisfaction with interfaces.
The article also details various study design approaches:
Study environments: Range from low to high fidelity driving simulators, test tracks, and real roads.
Automation representation: Most studies use simulation environments due to technology maturity limitations, though some use Wizard-of-Oz approaches or real settings.
Research focus types: Include conceptual development with proof-of-concept studies, basic research on human perception/action, and methodological work developing evaluation tools.
The authors note significant heterogeneity in constructs, use cases, and automation operationalization, highlighting the need for methodological standardization. They mention that many research groups follow their own measurement procedures, emphasizing the need for commonly accepted standards, particularly for take-over request scenarios.
Let me search for more specific information about systems thinking principles applied to human factors in automated driving.
Search
sociotechnical systems approach automated driving human factors literature reviewInformation Already Gathered
Next Steps Action Plan
Let me try to access another key paper on sociotechnical systems in automated driving.
Search
sociotechnical systems approach automated driving human factors literature reviewLet me access a paper on sociotechnical systems approach to driver distraction, which may provide insights on how systems thinking principles are applied to human factors in automated driving.
Website Browse
https://www.researchgate.net/publication/330730579_Driver_Distraction_A_Sociotechnical_Systems_ApproachThe webpage appears to be a technical or academic document discussing information analysis. The image shows what seems to be a dense text document with multiple sections or paragraphs. The content appears to be formatted in a scholarly or professional manner, with what might be sections, subsections, and possibly references or citations.
The document appears to contain substantial text content, possibly including methodological descriptions, analysis results, or theoretical frameworks related to information analysis. Due to the image resolution and format, specific details of the text content are not clearly legible, making it difficult to summarize the specific arguments, data, or conclusions presented in the document.
The layout suggests this could be a research paper, technical report, or instructional material related to information analysis methodologies or applications. There appears to be a structured format with possible headings, paragraphs of body text, and potentially some visual elements or formatted sections.
No content related to the question can be clearly identified from the provided image. The image shows what appears to be a document with text content, but the specific text is not legible enough to determine if it contains information relevant to the query. The document structure is visible but the actual content cannot be read with sufficient clarity to extract specific information related to the question being explored.
The image does not contain any clearly visible or identifiable hyperlinks that can be extracted. The content appears to be a static document page rather than an interactive webpage with clickable links.
The provided content is itself an image of what appears to be a document page. However, the image quality or resolution does not allow for clear reading of the text content. No separate images within this document can be clearly identified or extracted.
Title: Document page on information analysis
Content: Text document with multiple paragraphs and possibly sections related to information analysis
Source: Unknown
Link: [The image itself is the content being analyzed]
I cannot extract additional images from within this image as the resolution does not allow for clear identification of any embedded visual elements.
Let me try to access another key paper on meaningful human control in automated driving systems, which applies systems thinking principles to human factors.
Website Browse
https://pmc.ncbi.nlm.nih.gov/articles/PMC9330947/The webpage presents a comprehensive framework for "Meaningful Human Control" (MHC) over Automated Driving Systems (ADS), synthesizing results from a multidisciplinary research project conducted at Delft University of Technology from 2017 to 2021. The framework addresses the ethical challenge of maintaining human control and responsibility over increasingly autonomous vehicles.
The authors argue that human persons and institutions, not hardware and software, should remain ultimately in control of and morally responsible for automated driving operations. The paper defines an ADS as being under meaningful human control if it behaves according to relevant human actors' reasons (tracking) and if potentially dangerous events can be traced back to human actors (tracing).
The paper discusses the SAE J3016 taxonomy of driving automation (Levels 0-5) and the changing relationship between humans and vehicles at different automation levels. It highlights that even with increasing automation, human elements remain crucial, though responsibilities shift and transform rather than disappear.
The authors identify the risk of "responsibility gaps" - situations where undesirable outcomes occur without clear accountability. They classify these gaps into four types: culpability gaps, moral accountability gaps, public accountability gaps, and active responsibility gaps. These gaps can arise from various sources including system complexity, AI learning features, algorithmic opacity, and lack of awareness of moral obligations.
The MHC framework aims to protect safety and ensure human accountability as fundamental principles for Responsible Innovation in ADS. The paper takes a multidisciplinary approach combining philosophical perspectives on control and responsibility, behavioral science insights on human abilities and motivation, and traffic engineering considerations for achieving MHC in dynamic environments.
The webpage presents a comprehensive framework for establishing meaningful human control (MHC) over Automated Driving Systems (ADS). The framework is based on a multidisciplinary research project conducted at Delft University of Technology from 2017 to 2021, involving engineers, philosophers, and psychologists.
The core assumption of the framework is that human persons and institutions, not hardware and software algorithms, should remain ultimately in control of and morally responsible for potentially dangerous driving operations in mixed traffic, even if not directly controlling the vehicle. This is considered crucial for protecting safety and avoiding responsibility gaps.
The framework defines MHC through two key conditions:
The authors operationalize these conditions through multidisciplinary work:
The paper addresses the SAE J3016 taxonomy of driving automation (Levels 0-5), noting that even at higher automation levels (3-5), humans remain critical elements in the system, though their roles change. Rather than eliminating human involvement, ADS redistributes and transforms human responsibilities.
The authors identify "responsibility gaps" as a key concern - situations where undesirable outcomes occur without clear accountability for prevention or responsibility. They classify four types of responsibility gaps:
These gaps can arise from various sources including system complexity, AI learning features, algorithmic opacity, privatization of public spaces, and lack of awareness of moral obligations.
The MHC framework aims to address these gaps comprehensively rather than focusing on single dimensions like explainable AI or new legal arrangements. The approach bridges between high-level control philosophy and operational guidance for engineers, designers, and policymakers to define tasks, roles, and responsibilities of different human agents in the ADS ecosystem.
Let me access a paper on meaningful human control in automated driving systems to understand how systems thinking principles are applied to human factors.
This academic paper introduces the concept of Meaningful Human Control (MHC) as a framework for automated driving systems (ADS). As vehicles become increasingly automated, the preservation of human control becomes a critical challenge. The authors develop a comprehensive framework identifying core components of ADS across four categories: Driver, Vehicle, Infrastructure, and Environment.
The paper establishes that MHC is essential for ensuring automated vehicles act in ways acceptable to humans. Two key conditions for MHC are trackability (ability to track human moral reasoning) and traceability (ability to understand the chain of control and consequences). The framework helps vehicle manufacturers, software developers, and regulatory authorities address challenges related to human control in automated vehicles.
The Driver components include traits (personality, physical attributes), state (fatigue, stress), perception (visual, auditory, tactile), cognition (information analysis, decision-making), and action skills. The Vehicle components are divided between manual systems (traditional vehicle controls) and automated systems (sensors, automated control software, actuation systems).
The authors argue that this framework allows for operationalization of MHC across various applications. It enables traceability of control chains in automated vehicles and helps identify areas for further research. The paper includes application examples and recommendations regarding vehicle design, human-machine interaction, transition of control, driver training, and vehicle approval processes.
The framework serves as a foundation for developing ADS that maintain appropriate levels of human control while advancing automation technology, addressing both practical and ethical questions in the field.
The webpage presents a comprehensive academic paper on Meaningful Human Control (MHC) in Automated Driving Systems (ADS). Key information includes:
Definition and Purpose of MHC: MHC is described as ensuring "humans, not computers and their algorithms, should ultimately remain in control of, and thus morally responsible for relevant decisions about operations." This concept is adapted from discussions about autonomous weapons systems to address control issues in automated vehicles.
Core Components Framework: The authors develop a framework categorizing ADS components into four main areas:
Two Main Conditions of MHC:
Driver Components in Detail:
Vehicle Components in Detail:
Applications of the Framework: The framework enables vehicle manufacturers, software developers, component designers, and regulatory authorities to address challenges related to human control in automated vehicles, including vehicle design, human-machine interaction, transition of control, driver training, and vehicle approval.
Research Context: The paper positions MHC as essential for addressing ethical and practical questions in automated driving, such as driver retraining requirements, vehicle approval standards, and design considerations for control.
No links were provided in the webpage content.
Title: Figure 1. Driver core components of control in ADS
Content: A diagram showing the driver core components framework for automated driving systems
Source: The paper authors (unnamed in the visible text)
Link: https://www.tandfonline.com/cms/asset/362ada99-131c-4f17-9bdd-e2f848d647ea/ttie_a_1697390_f0001_c.jpg
Title: Figure 2. Vehicle core components of control in ADS (red is manual control, blue is automated control)
Content: A diagram illustrating vehicle components divided between manual control (red) and automated control (blue)
Source: The paper authors (unnamed in the visible text)
Link: https://www.tandfonline.com/cms/asset/a2bdc512-4bac-4ba5-ad49-17ff19a15caf/ttie_a_1697390_f0002_c.jpg
Information Already Gathered
Next Steps Action Plan
Let me search for more information on mental models and situation awareness in automated driving systems.
Search
mental models situation awareness automated driving systems thinkingLet me access an article about situation awareness and mental models in automated driving to understand how systems thinking principles are applied.
Website Browse
https://www.researchgate.net/publication/353161342_Situation_Awareness_Mental_Models_and_UnderstandingThe webpage appears to be a screenshot of a conversation or interface related to information analysis. The image shows what seems to be a prompt or instruction set for an AI assistant that specializes in analyzing webpage content. The instructions outline a structured approach for analyzing webpages in relation to specific questions.
The instructions are organized into 5 numbered points:
The format appears to be a template where the user would input a query, and the AI would analyze webpage content according to these instructions. The template includes placeholders like "{{query}}" which would be replaced with the user's actual question.
The image quality makes it difficult to read all details clearly, but the structure suggests this is an information extraction and analysis tool designed to help users process webpage content in relation to specific questions they're exploring.
No content related to the question. The image shows what appears to be a template or instruction set for an AI assistant that analyzes webpage content, but without knowing the specific query being explored, it's not possible to extract relevant information. The image itself is a screenshot of instructions rather than content that would answer a particular question.
No content related to the question. The image does not contain any clickable links or URLs that could be identified as relevant to any specific query.
No content related to the question. The image itself is a screenshot of what appears to be instructions for an AI assistant, but without knowing the specific query, it's not possible to identify images that would be helpful for answering a particular question.
Let me try to access a paper on situation awareness in automated driving systems to understand how systems thinking principles are applied.
Website Browse
https://pmc.ncbi.nlm.nih.gov/articles/PMC8631191/The webpage presents an academic research paper investigating situation awareness (SA) in remote operators of autonomous vehicles. The study explores how individuals build mental models of remote driving environments through video feeds, which is crucial for remote operators who may need to intervene in autonomous vehicle operation.
The researchers used a novel "freeze and probe" technique with qualitative verbal elicitation to understand what people observe in remote driving scenes without being constrained by rigid questioning. Ten participants watched eight videos of different driving scenarios across four road types (motorway, rural, residential, and A road). When videos stopped, participants verbally described what was happening (SA Comprehension) and what might happen next (SA Prediction).
The study challenges traditional hierarchical models of situation awareness, suggesting that acquiring SA in remote scenes is a flexible process combining comprehension and prediction simultaneously rather than sequentially. The researchers used inductive thematic analysis to categorize responses into a taxonomy capturing key elements of reported SA for driving situations.
The paper argues that existing SA frameworks don't adequately address the unique human factors challenges faced by remote operators who must build mental models of environments they don't physically occupy. The authors suggest that existing SA theories need to be more sensitively applied to remote driving contexts, particularly for remote operators of autonomous vehicles.
The webpage contains significant information about remote operation of autonomous vehicles, focusing on situation awareness challenges:
Even fully autonomous vehicles will sometimes require remote human intervention, such as when an AV encounters situations it cannot interpret (e.g., a contractor directing traffic with hand signals).
The SAE J3016 industry standard taxonomy for automated driving was updated in April 2021 to include remote support functions, acknowledging the need for occasional remote operation even at higher automation levels.
Remote operators face unique human factors challenges when temporarily controlling automated vehicles, including building mental models of environments they don't physically occupy.
Remote driving is typically facilitated by monitor views and video feeds, which are limited compared to being physically present in the vehicle (limited field of view, reliance on 2D depth cues).
The study used a novel approach to measure situation awareness in remote operators by employing qualitative verbal elicitation rather than traditional quantitative methods like SAGAT.
The researchers found that acquiring SA in remote scenes is a flexible process combining comprehension and prediction simultaneously rather than sequentially as implied by previous SA methodologies.
The study developed a taxonomy of SA in video-relays of driving scenes that could be used to develop regulatory frameworks for training remote operators of AVs.
The researchers created standardized video stimuli of different road types (motorways, A roads, rural roads, residential areas) to test how participants build mental representations of remote driving scenes.
The study examined whether providing additional information (rear-view camera footage) influenced the process of building situation awareness.
The research suggests that existing theories of SA need to be more sensitively applied to remote driving contexts such as remote operators of autonomous vehicles.
Title: Examples of different road types
Content: Four images showing different road environments: motorways, A roads, minor country roads, and residential areas
Source: The study authors
Link: Figure 1
Title: Video presentation formats
Content: Images showing two versions of the video stimuli - one with only forward-facing view and one with additional rear-view footage
Source: The study authors
Link: Figure 2 (link incomplete in the provided content)
Let me search for information about STAMP and STPA applications to automated driving systems to understand how these systems thinking methodologies are applied to human factors.
Search
STAMP STPA systems thinking principles automated driving human factors applicationsInformation Already Gathered
Next Steps Action Plan
Information Already Gathered
Next Steps Action Plan
Let me access the MIT thesis on STPA-Engineering for Humans to understand how this systems thinking approach is applied to human factors in automated driving.
Website Browse
https://dspace.mit.edu/handle/1721.1/112357{{
Let me try to access information about the STPA-Engineering for Humans approach through a different source.
Search
STPA-Engineering for Humans automated driving systems France Megan MIT thesisLet me access the MIT thesis on STPA-Engineering for Humans to understand how this systems thinking approach is applied to human factors in automated driving.
Website Browse
http://sunnyday.mit.edu/megan-thesis.pdfThe rapid advancement of driving automation technologies has transformed the relationship between human drivers and vehicles. As automation levels increase from driver assistance (SAE Level 1) to full automation (SAE Level 5), the role of the human operator evolves dramatically, creating new challenges for system design, safety analysis, and human-machine interaction. System thinking principles—which emphasize holistic analysis, interconnections between components, feedback loops, and emergent properties—have proven valuable in addressing these challenges.
This literature review examines how system thinking principles have been applied to driving automation systems over the past two decades, with a specific focus on the human operator. The review covers theoretical frameworks, human operator aspects across automation levels, transition of control issues, and practical applications of system thinking in automated driving.
The socio-technical systems approach recognizes that automated driving systems exist within a complex network of technical, human, organizational, and environmental factors. This perspective has been increasingly adopted to understand the multifaceted challenges of driving automation.
Researchers have emphasized that driving automation should not be viewed merely as a technical challenge but as a socio-technical system where human operators remain critical elements even at higher levels of automation. Rather than eliminating human involvement, automation redistributes and transforms human responsibilities pmc.ncbi.nlm.nih.gov. This transformation requires careful consideration of how humans interact with, understand, and trust automated systems.
The socio-technical approach has been particularly valuable in analyzing driver distraction in automated vehicles. Parnell et al. developed a framework that considers not only the immediate human-vehicle interaction but also broader social, organizational, and regulatory factors that influence driver behavior researchgate.net. This approach helps identify intervention strategies at multiple levels of the system rather than focusing solely on driver behavior.
STAMP represents a significant advancement in system safety analysis, moving beyond traditional chain-of-events models to a control-theoretic approach. Developed by Nancy Leveson at MIT, STAMP integrates software, human factors, new technologies, social and organizational structures, and safety culture into engineering safety analysis evu-online.org.
STAMP views safety as a control problem rather than a failure problem. Accidents occur when component failures, external disturbances, or dysfunctional interactions among system components are not adequately handled by the control system. This perspective is particularly relevant for automated driving systems, where safety depends on complex interactions between human operators, vehicle automation, other road users, and infrastructure.
Systems-Theoretic Process Analysis (STPA), the hazard analysis technique based on STAMP, has been applied to automated driving systems to identify potential hazards and safety constraints. STPA is especially valuable for analyzing human-automation interaction because it considers how system conditions may influence human behavior and lead to unsafe actions sunnyday.mit.edu.
The concept of Meaningful Human Control (MHC) has emerged as a critical framework for ensuring that humans maintain appropriate control over automated systems. This framework addresses the ethical challenge of maintaining human control and responsibility as vehicles become increasingly autonomous .
MHC is defined through two key conditions:
This framework provides a structured approach for analyzing the core components of automated driving systems across four categories: Driver, Vehicle, Infrastructure, and Environment. The Driver components include traits (personality, physical attributes), state (fatigue, stress), perception (visual, auditory, tactile), cognition (information analysis, decision-making), and action skills . This comprehensive view helps identify how system design influences human control and responsibility.
Mental models—the cognitive representations that humans form about how systems work—are crucial for effective interaction with automated driving systems. Research has shown that drivers often develop incomplete or incorrect mental models of automation capabilities, leading to misuse, disuse, or abuse of these systems.
Situation awareness (SA), defined as the perception of elements in the environment, comprehension of their meaning, and projection of their status in the near future, is a critical construct in understanding human-automation interaction. Parasuraman, Sheridan, and Wickens have established SA as a viable and empirically supported cognitive engineering construct that is valuable for understanding and predicting human-system performance in complex systems researchgate.net.
Studies have demonstrated that drivers of automated vehicles are likely to engage in visually demanding non-driving tasks, causing impaired situation awareness sciencedirect.com. This is particularly problematic during transitions of control, when drivers must rapidly regain situation awareness to safely resume manual control.
Research on remote operators of autonomous vehicles has challenged traditional hierarchical models of situation awareness, suggesting that acquiring SA in remote scenes is a flexible process combining comprehension and prediction simultaneously rather than sequentially frontiersin.org. This finding has implications for the design of remote operation interfaces and training programs.
Trust in automation is a key factor influencing how humans interact with automated driving systems. Overtrust can lead to complacency and inappropriate reliance on automation, while undertrust can result in disuse of potentially beneficial systems.
Research has shown that situational awareness both promotes and moderates the impact of trust in automated vehicles . Drivers with higher situation awareness are better able to calibrate their trust to the actual capabilities and limitations of the automation.
System thinking approaches have been applied to understand trust calibration as a dynamic process influenced by multiple factors, including system transparency, reliability, predictability, and the driver's individual differences. This perspective has led to design recommendations for automated driving systems that support appropriate trust development and maintenance.
Automation can both reduce and increase cognitive workload, depending on the implementation and context. While automation may relieve drivers of certain operational tasks, it can introduce new monitoring demands and increase cognitive complexity.
Mental workload has been established as a critical construct in cognitive engineering, with significant implications for human-automation interaction . Research has examined how different levels of driving automation affect mental workload and how these effects vary across driving contexts and individual differences.
System thinking approaches have been valuable in understanding workload as an emergent property of the human-automation system rather than a simple function of task demands. This perspective has informed the development of adaptive automation systems that adjust their behavior based on the driver's current workload state.
Mode confusion—uncertainty about the current state of automation—is a significant safety concern in automated driving systems. System thinking principles have been applied to understand mode confusion as arising from mismatches between the driver's mental model and the actual system state.
STPA-inspired safety analysis has been used to identify potential causes of mode confusion in cooperative driving automation. Research has shown that accidental or faulty inputs from the driver pose the greatest threat for mode confusion—situations where either both the vehicle and driver believe they are in control, or neither believes they are responsible for controlling the vehicle .
The socio-technical systems approach has led to design recommendations for clear mode indication and transition protocols that consider not only the interface design but also training, organizational policies, and regulatory frameworks.
The transition of control between automation and human operators is one of the most critical safety challenges in partially automated driving systems (SAE Levels 2-3). System thinking principles have been applied to understand these transitions as complex processes involving multiple interacting factors rather than simple handoffs.
Research has shown that the quality of takeover performance depends on various factors, including the available time budget, the driver's current state and engagement in non-driving tasks, the complexity of the traffic situation, and the design of the takeover request interface. A systems approach considers how these factors interact and influence each other.
STPA has been applied to analyze potential hazards during transitions of control and develop safety constraints. This approach has led to the identification of specific requirements for safe transitions, including appropriate timing of takeover requests, clear communication of automation status, and support for situation awareness recovery .
Driver readiness to resume control is influenced by multiple factors, including situation awareness, cognitive workload, trust in automation, and engagement in non-driving activities. System thinking approaches have examined how these factors interact and evolve over time.
Research has shown that drivers engaged in non-driving tasks experience significant delays in regaining situation awareness during takeover requests. This has led to recommendations for monitoring systems that assess driver readiness and adapt takeover procedures accordingly.
The concept of "fallback readiness" has emerged as a critical consideration for SAE Level 3 automation, where drivers are expected to respond to takeover requests within a reasonable time frame. Human factors experts have recommended that the fallback-ready user should remain in a motoric and sensory state similar to that of a normal driver to allow for safe transitions researchgate.net.
Interface design plays a crucial role in supporting effective transitions of control. System thinking principles have informed the development of multimodal interfaces that provide clear information about automation status, upcoming transitions, and relevant environmental factors.
Research has explored various approaches to interface design, including visual, auditory, and haptic feedback mechanisms. The effectiveness of these approaches depends on the specific context, driver state, and automation level.
STPA-Engineering for Humans has been applied to analyze and compare different interface designs for automated parking assist systems. This approach helps identify potential issues with human-automation interaction and develop design recommendations that support safe and effective transitions .
STPA-Engineering for Humans is an extension of STPA specifically designed to analyze human-automation interaction. Developed by Megan France at MIT, this method provides guidance for identifying causal scenarios related to interactions between humans and automation and understanding why unsafe behaviors may appear appropriate in the operational context .
The method has been applied to automated parking assist systems at different levels of automation. It helps identify how system design influences driver behavior and how multiple system designs would affect safety with respect to human-automation interaction.
STPA-Engineering for Humans integrates human factors expertise with systems engineering, providing a framework for dialogue between human factors experts and other engineers. This interdisciplinary approach is essential for addressing the complex challenges of automated driving systems.
System thinking approaches have facilitated learning across transport domains, applying insights from aviation, maritime, and rail automation to road transport. Research has compared accidents involving automated technologies across these domains to identify learning opportunities for automated vehicle design sciencedirect.com.
This cross-domain analysis has revealed similarities and differences in contributory factors to automation-related accidents. Key leverage points identified include improved human factors integration into automation design across all modes and reconsideration of regulatory approaches to ensure they are appropriate for emerging technologies .
System thinking principles have informed the development of comprehensive safety assessment frameworks for automated driving systems. These frameworks consider not only technical reliability but also human factors, organizational aspects, and societal impacts.
STAMP and STPA have been applied to analyze the safety of automated driving systems at both the vehicle level and the broader traffic system level. This approach helps identify potential hazards and develop safety constraints that address the complex interactions between humans, vehicles, infrastructure, and the environment .
The AcciMap technique, another systems-based approach, has been used to analyze accidents involving automated technologies across transport modes. This technique helps identify contributory factors at multiple levels of the socio-technical system, from equipment and environment to organizational and regulatory factors .
System thinking principles have made significant contributions to our understanding of human operators in driving automation systems. By emphasizing holistic analysis, interconnections, feedback loops, and emergent properties, these principles have helped address the complex challenges of human-automation interaction across all levels of driving automation.
Key frameworks such as the socio-technical systems approach, STAMP/STPA, and Meaningful Human Control have provided structured methods for analyzing and designing automated driving systems with a focus on the human operator. These frameworks have been applied to address critical aspects of human-automation interaction, including mental models and situation awareness, trust and reliance, workload and cognitive demands, mode confusion, and transitions of control.
As driving automation continues to advance, system thinking principles will remain essential for ensuring that these systems are designed to work effectively with human operators, supporting safe, efficient, and enjoyable mobility. Future research should continue to develop and refine system thinking approaches to address emerging challenges in human-automation interaction, particularly as we move toward higher levels of automation and more complex operational environments.