ALFIE ETD-HUB

3: Does IRIS Require Explanation to Users?

Asked: 9 months, 1 week ago By: Catalink Views: 378 Catalink Case Study: IRIS

Since IRIS could generate decisions/alerts, does this trigger a user's right to an explanation under GDPR Article 22 for automated individual decision-making?

38 Answers

Answered: 7 months, 3 weeks ago By: Chiamakaokorie

Yes

Testificate replied: Not automatically. The fact that IRIS generates a drowsiness score, decision, or alert does not by itself trigger GDPR Article 22. Article 22 is engaged only where there is a decision based solely on automated processing, including profiling, that produces legal effects or similarly significant effects on the individual.
Answered: 7 months, 3 weeks ago By: Tundefasina

Yes, IRIS may trigger GDPR Article 22 if its alerts lead to automated decisions with significant effects (e.g., warnings, vehicle intervention). In such cases, users may have the right to meaningful information about the logic behind decisions and the ability to challenge them.

Testificate replied: If IRIS merely gives the driver a real-time warning such as “you may be drowsy; take a break”, Article 22 is less likely to apply, because the alert is advisory and may not have a legal or similarly significant effect. GDPR transparency duties would still apply, including explaining what data is processed, why, how long it is retained, and how the drowsiness assessment broadly works. Article 22 becomes much more relevant if the IRIS output leads automatically to a significant consequence, for example if it disables or limits vehicle functions, reports the driver to an employer or fleet manager, affects insurance pricing, triggers disciplinary action, records an impairment event against the driver, or causes an automated safety intervention with substantial impact. In those cases, the drowsiness alert may amount to automated individual decision-making with similarly significant effects.
Answered: 7 months, 3 weeks ago By: Zainabodogwu2

Yes—if IRIS autonomously generates alerts that have legal or similarly significant effects on the user (e.g., disciplinary action, driving restrictions), it would likely trigger GDPR Article 22, requiring a meaningful explanation, human oversight, and the ability to contest the decision.

Answered: 7 months, 3 weeks ago By: Oliverharrow

Yes

Testificate replied: I don't think it inherently does. It is also important to be precise about the so-called “right to an explanation.” GDPR does not contain a simple standalone right labelled “right to explanation”. Instead, where Article 22-type automated decision-making is involved, Articles 13 and 15 require the controller to provide meaningful information about the logic involved, as well as the significance and envisaged consequences of the processing for the data subject.
Answered: 7 months, 3 weeks ago By: Ngozioshoba

IRIS mainly provides alerts rather than making legal decisions, so it likely does not directly trigger Article 22 protections. Drivers still control their actions. However, users should still be given simple explanations about how alerts work to support transparency and trust.

Answered: 7 months, 3 weeks ago By: Efeadelaja

Yes, if IRIS generates decisions or alerts with legal or similarly significant effects on users, it would likely trigger the GDPR Article 22 right to an explanation for automated decision-making.

Answered: 7 months, 3 weeks ago By: Meilincai

Yes it does

Testificate replied: No, for IRIS, the key question is not simply “does the system make an automated assessment?”, but what consequence follows from that assessment.
Answered: 7 months, 3 weeks ago By: Kelechinwosu

IRIS triggers Article 22 only if its alerts lead to automatic, consequential outcomes (like pay cuts) without a human manager reviewing the context first.

Answered: 7 months, 3 weeks ago By: Zainabodogwu32

IRIS may trigger GDPR Article 22 if its outputs constitute automated decisions that produce legal or similarly significant effects on drivers. If IRIS merely provides advisory alerts (e.g. “possible drowsiness detected”) and the driver retains full control, Article 22 may not strictly apply. However, if IRIS: Automatically triggers interventions (e.g. vehicle slowdown, alerts reported to employers or insurers), or Influences decisions with significant safety, legal, or employment consequences, then it could fall within Article 22’s scope. In such cases, users would be entitled to: Meaningful information about the logic involved, An explanation of the decision, The ability to contest or override the decision. Even if Article 22 does not strictly apply, transparency obligations under Articles 13–15 GDPR would still require clear explanations of how IRIS works and its limitations.

Answered: 7 months, 3 weeks ago By: Miles_Hatcher

Yes, potentially. If IRIS alerts or make decisions that have legal significant documents it falls under GDPR

Answered: 7 months, 3 weeks ago By: Clarawhitby

Maybe

Answered: 7 months, 3 weeks ago By: Ifeanyiakare

Possibly but not automatically

Answered: 7 months, 3 weeks ago By: Kunleekwueme

Yes. Since the models are still being scrutinised for issues around being biased, we can also assume it generates false positives and hence a major reason why users should have rights to an explanation

Answered: 7 months, 3 weeks ago By: Sadeogunlana

YES

Answered: 7 months, 3 weeks ago By: Tomashbrook

Yes, I do.

Answered: 4 months ago By: Brightfox_45

Yes. Transparency is very important here for legal and ethical reasons. Plus, in the event that the system needs to do the update. People can give feedback to improve the system which may result in less events that go wrong. A beta test should be provided.

Answered: 4 months ago By: Cleverwolf_27

Yes + transparency may also increase levels of consent given for usage.

Answered: 4 months ago By: Brightrobin_21

Absolutely, yes. Transparency is key to support public trust

I like to distinguish between "opening the black box" and "providing meaningful explanations. Users dont need the mathematical details of a Vision Transformer, but they should be told something like "the alert was triggered because the system detected prolonged eye closure, etc"

Answered: 4 months ago By: Warmlynx_14

Yes, people should have meaningful explanations, especially when an alert affects safety or driving control. The explanation should be practical and human-readable rather than a technical model summary.

Answered: 4 months ago By: Swiftowl_37

Yes, explanation rights matter because users need to understand why the system reacted and how to challenge errors. This is especially important if the alert affects driving control or insurance consequences.

Answered: 4 months ago By: Cleverrobin_87

Users should receive simple explanations, such as which signal pattern triggered the alert. This supports trust and allows review when the system behaves unexpectedly.

Answered: 4 months ago By: Swiftrobin_35

Yes, explanations should be available in plain language so drivers understand why a warning was triggered. This also supports accountability and post-incident review.

Answered: 4 months ago By: Boldlynx_38

Users should have a right to a clear explanation, particularly after a warning or intervention. That explanation should be understandable to non-experts.

Answered: 4 months ago By: Quietbadger_45

Yes, people should be told why the system issued a warning and what signal triggered it. Meaningful explanation is part of trustworthy deployment.

Answered: 4 months ago By: Swiftdeer_99

Yes, explanations are important because drivers should know why the system interrupted or warned them. A meaningful explanation can help with trust and error correction.

Answered: 4 months ago By: Bravebear_45

Users deserve explanations that connect the alert to the signal the system used. That can be done without exposing proprietary details.

Answered: 4 months ago By: Calmwolf_53

Users should receive simple explanations, such as which signal pattern triggered the alert. This supports trust and allows review when the system behaves unexpectedly.

Answered: 4 months ago By: Brightowl_58

Yes, people should be told why the system issued a warning and what signal triggered it. Meaningful explanation is part of trustworthy deployment.

Answered: 4 months ago By: Brightbear_54

Yes

Answered: 4 months ago By: Warmhawk_15

Yes - Give the true positives.

Answered: 4 months ago By: Quietrobin_25

Yes

Answered: 4 months ago By: Braveowl_80

Yes, drivers should have a right to explain otherwise this technology would strive the driver of their personal agency - it is unlikely that the facial recognition system and heart rate detection could be 100% accurate in all circumstances and therefore if a driver was forced to pull over and then could not have the chance to explain their reasoning against the decision it would be rather unfair.

Answered: 4 months ago By: Kindbadger_56

Definitely: should be explainable by design. This may help the project team, to reduce false alarms, including if users can comment/feedback on those explanations.

Answered: 4 months ago By: Warmwolf_18

Yes. There needs to be an explainability element.

Your Answer

Login to add your answer!

We’d love to hear your thoughts — share a meaningful answer by logging in.