Skip to content

Collect relevant safety metrics from scenario execution #115

Open

Description

@diegoyabuki

Checklist

  • I've read the contribution guidelines.
  • I've searched other issues and no duplicate issues were found.
  • I've agreed with the maintainers that I can plan this task.

Description

This task involves aligning the required safety metrics with the Safety Assurance WG and ensure that either the metrics, or the data required for their offline calculation is collected during scenario execution

Purpose

To ensure that the scenario execution contributes to the safety argumentation of the system.

Possible approaches

First the metrics required need to be determined by the Safety Assurance WG. In the absence of this information, we can proceed with commonly used metrics, such as Time-to-collision (TTC), Post-Encroachment Time (PET) and Deceleration Rate to Avoid Collision (DRAC).

Definition of done

The following is achieved:

  • The safety metrics to be calculated are defined
  • The metrics can be calculated online or offline from the scenario execution

Activity

  1. self-assigned this
    on Feb 19, 2026
  2. added theissue type on Feb 19, 2026
  3. moved this from Ready to Blocked in ODD Working Groupon Feb 19, 2026
  4. changed the title [-]Integrate the scenario interpreter with the CARLA simulator[/-] [+]Collect relevant safety metrics from scenario execution[/+] on Feb 19, 2026
  5. moved this from Blocked to Ready in ODD Working Groupon Feb 23, 2026
  6. diegoyabuki commented on Mar 9, 2026

    @diegoyabuki
    CollaboratorAuthor

    After alignment with the Safety Assurance WG, it was determined that it is still too soon to decide which metrics should be observed/ The decision should be made after the safety plan and safety case are established. For now, we can focus on obtaining as much information as possible such as to enable supporting a broad set of possible safety argumentations.

    The approach moving forward is:

    • Investigating commonly used safety metrics in the automotive industry
    • Check overlap with metrics already calculated by Autoware, such as RSS
    • Define an initial set of metrics to support, with a plan of how and where it will be calculated
  7. moved this from Ready to In Progress in ODD Working Groupon Mar 9, 2026
  8. moved this from In Progress to Blocked in ODD Working Groupon Apr 8, 2026
  9. removed this from the 2026 Phase 1 Goals milestone on Apr 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions