Skip to main content
Search
Menu

Safe and explainable critical embedded systems based on AI

SAFEXPLAIN addresses the challenges of DL-based solution certification by (i) designing explainable DL solutions and (ii) designing FUSA security patterns for different DL usage levels

Deep Learning (DL) techniques are key for most future advanced software functions in Critical Autonomous AI-based Systems (CAIS) in cars, trains and satellites. Hence, those CAIS industries depend on their ability to design, implement, qualify, and certify DL-based software products under bounded effort/cost. There is a fundamental gap between Functional Safety (FUSA) requirements of CAIS and the nature of DL solutions needed to satisfy those requirements. The lack of transparency (mainly explainability and traceability), and the data dependent and stochastic nature of DL software clash against the need for deterministic, verifiable and pass/fail test based software solutions for CAIS. SAFEXPLAIN tackles this challenge by providing a novel and flexible approach to allow the certification – hence adoption – of DL-based solutions in CAIS by (1) architecting transparent DL solutions that allow explaining why they satisfy FUSA requirements, with end-to-end traceability, with specific approaches to explain whether predictions can be trusted, and with strategies to reach (and prove) correct operation, in accordance with certification standards. SAFEXPLAIN will also (2) devise alternative and increasingly complex FUSA design safety patterns for different DL usage levels (i.e. with varying safety requirements) that will allow using DL in any CAIS functionality, for varying levels of criticality and fault tolerance.

Summary

Project name

SAFEXPLAIN

Status

Active

Region

Other than Sweden

RISE role in project

Delatagare

Project start

Duration

Three years

Total budget

3.7 MEUR

Partner

IKERLAN, AIKO, NAVINFO, EXIDA

Funders

European Union

Project website

Coordinators

Project members

Supports the UN sustainability goals

11. Sustainable cities and communities
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

* Mandatory By submitting the form, RISE will process your personal data.