< Back to Schedule View

251-Safety-driven V&V and Assessment: The Great International Debate 

Date and Time: Tuesday, July 11, 2023: 1:30 PM - 5:00 PM
Location: Imperial B

Session Moderators and Organizers

MODERATORS
Gil Amid, Chief Regulatory Affairs Officer, VP Operations and Co-Founder, Foretellix Ltd.
Boris van Waterschoot, Senior Advisor Human Factors and Automated Driving, Dutch Road Authority (Rijkswaterstaat, RWS)
Sagar Behere, Vice President of Safety, Foretellix Ltd.

ORGANIZERS
Session Contact 1: Gil Amid, Foretellix Ltd.
Session Contact 2: Boris van Waterschoot, RWS (Dutch Road Authority)

TRB Sponsoring Committees and Partners

Session Description and Agenda

DESCRIPTION

It remains unclear how authorities should assess the safety of ADS and what corresponding metrics and information should be generated by the ADS V&V processes for supporting the assessments. Although recent regulations from UNECE provide preconditions for the arrival of ADS, relevant criteria are not yet available to determine the safety aspect. This session introduces various positions on this topic, offering the perspectives and the opinions of the authorities, and will contrast them with the opinion of ADS and solutions providers.

AGENDA

The session is split into two main phases:
The first phase will include position statements from representatives of authorities( US and international) and representatives of ADS and solutions suppliers – see list below. Each presenter will get 7-8 minutes to present their perspectives on their approach to ADS safety Driven V&V, Assessment, and the metrics to be used.

The second phase is structured to let the audience discuss, and prepare questions for the presenters, in order to debate their positions, challenge them or bring up new ideas.

List of Speakers: [ BOLD Is confirmed]
Regulators, Authorities:
● Richard Damm - President of KBA(Germany) , Chairperson of UNECE GRVA
● Rino Brouwer - Dutch Ministry of Infrastructure and Water management
● Jean-Michel Roy, Senior Regulatory Development Engineer , Transport Canada
● Espedito Rusciano - Type Approval Authority, RDW, The Netherlands


ADS and solutions stakeholders:
● Scott Schnelle -Waymo
● Quresh Sutarwala KODIAK
● Japan – Jama ( Japan Automobile Manufacturers Association) - Sato, Hideaki
● Sagar Behere – Foretellix , VP Safety , Safety Driven Validation
● Jeff Wishart – Science Foundation Arizona , ASU - SAE J3237 Safety metrics
● Ed Straub – SAE AVSC – Best practices for minimum safety report
● Arturo Tejada Ruiz – TNO , The Netherlands - competent driving behavior
● Erik Antonsson – CTO, Streetscope - Safety Assessment Measures
● VV Methods Germany project – Kirschbaum Thomas

Detailed Agenda [180 Minutes +30 minutes coffee break]:

[10 Min] Intro of the session, teasers, examples - Gil Amid
Phase 1:
Position statements by each speaker:
Each panelist presents his position - 7 minutes per person.
Currently: 14 x 112 minutes.
Authorities/regulators are expected to state what they need or would like to see (Metrics, validation, testing ) to see in order to be convinced that the ADS is validated and safe enough.
Solutions suppliers are expected to state how to approach safety assessment and/or validation: what metrics are needed, how measurements of safety will impact their validation.

Coffee Break – [ We may chop it to15 to 20 minutes. ]

Phase 2:
Logistics: We expect the room to be a set of round tables.
20 minutes:
Each table is spending 20 minutes on one the following assignment:
Based on ’the various position statements you just heard, please prepare either:
1. challenging question to the presenter[s] (not necessarily the moderator in your table )
2. A proposal on how to solve the challenge.
3. A “beat the experts” report- what are the shortcomings in each approach.
4. Some round tables will be preassigned to directed debate between speakers – list of topics:
a. Assessment vs. V&V – what is the right order and content? (Erik, Sagar )

The presenters are expected also to serve as moderators of the discussion in each table. We have additional volunteers if needed list::
Jace Allen

35 minutes: The presenters are back on stage, each round table gets to debate the panelist or report out!

5 minutes – Summary and proposal for next steps – Gil Amid

List of contributors:

Richard Damm
Rino Brouwer
Tejada Ruiz, A. (Arturo)
Edward Straub
Erik Antonsson
Rusciano, Espedito
Jace Allen
Jeffrey Wishart
Tool, Onno
Sagar Behere
Scott Schnelle
Kirschbaum Thomas
Sato, Hideaki
Quresh Sutarwala

Session Objectives

- Understand positions of various authorities around the world on criteria for safety assessments of ADS, what metrics are they seeking?
- Understand how various ADS developers and solution providers are thinking about safety V&V assessments and the corresponding V&V work they are doing, what safety metrics they are using.
- Understand how the efforts of Safety V&V feed into a safety assessment program for ADS by the authorities
- Understand the latest thinking on "How safe is safe enough?" for ADS and what metrics can support it ?