ALFIE ETD-HUB

3: Does IRIS Require Explanation to Users?

Asked: 7 months, 4 weeks ago By: Catalink Views: 292 Catalink Case Study: IRIS

Since IRIS could generate decisions/alerts, does this trigger a user's right to an explanation under GDPR Article 22 for automated individual decision-making?

38 Answers

Answered: 6 months ago By: Chiamakaokorie

Yes

Testificate replied: Not automatically. The fact that IRIS generates a drowsiness score, decision, or alert does not by itself trigger GDPR Article 22. Article 22 is engaged only where there is a decision based solely on automated processing, including profiling, that produces legal effects or similarly significant effects on the individual.
Answered: 6 months ago By: Tundefasina

Yes, IRIS may trigger GDPR Article 22 if its alerts lead to automated decisions with significant effects (e.g., warnings, vehicle intervention). In such cases, users may have the right to meaningful information about the logic behind decisions and the ability to challenge them.

Testificate replied: If IRIS merely gives the driver a real-time warning such as “you may be drowsy; take a break”, Article 22 is less likely to apply, because the alert is advisory and may not have a legal or similarly significant effect. GDPR transparency duties would still apply, including explaining what data is processed, why, how long it is retained, and how the drowsiness assessment broadly works. Article 22 becomes much more relevant if the IRIS output leads automatically to a significant consequence, for example if it disables or limits vehicle functions, reports the driver to an employer or fleet manager, affects insurance pricing, triggers disciplinary action, records an impairment event against the driver, or causes an automated safety intervention with substantial impact. In those cases, the drowsiness alert may amount to automated individual decision-making with similarly significant effects.
Answered: 6 months ago By: Zainabodogwu2

Yes—if IRIS autonomously generates alerts that have legal or similarly significant effects on the user (e.g., disciplinary action, driving restrictions), it would likely trigger GDPR Article 22, requiring a meaningful explanation, human oversight, and the ability to contest the decision.

Answered: 6 months ago By: Oliverharrow

Yes

Testificate replied: I don't think it inherently does. It is also important to be precise about the so-called “right to an explanation.” GDPR does not contain a simple standalone right labelled “right to explanation”. Instead, where Article 22-type automated decision-making is involved, Articles 13 and 15 require the controller to provide meaningful information about the logic involved, as well as the significance and envisaged consequences of the processing for the data subject.
Answered: 6 months ago By: Ngozioshoba

IRIS mainly provides alerts rather than making legal decisions, so it likely does not directly trigger Article 22 protections. Drivers still control their actions. However, users should still be given simple explanations about how alerts work to support transparency and trust.

Answered: 6 months ago By: Efeadelaja

Yes, if IRIS generates decisions or alerts with legal or similarly significant effects on users, it would likely trigger the GDPR Article 22 right to an explanation for automated decision-making.

Answered: 6 months ago By: Meilincai

Yes it does

Testificate replied: No, for IRIS, the key question is not simply “does the system make an automated assessment?”, but what consequence follows from that assessment.
Answered: 6 months ago By: Kelechinwosu

IRIS triggers Article 22 only if its alerts lead to automatic, consequential outcomes (like pay cuts) without a human manager reviewing the context first.

Answered: 6 months ago By: Zainabodogwu32

IRIS may trigger GDPR Article 22 if its outputs constitute automated decisions that produce legal or similarly significant effects on drivers. If IRIS merely provides advisory alerts (e.g. “possible drowsiness detected”) and the driver retains full control, Article 22 may not strictly apply. However, if IRIS: Automatically triggers interventions (e.g. vehicle slowdown, alerts reported to employers or insurers), or Influences decisions with significant safety, legal, or employment consequences, then it could fall within Article 22’s scope. In such cases, users would be entitled to: Meaningful information about the logic involved, An explanation of the decision, The ability to contest or override the decision. Even if Article 22 does not strictly apply, transparency obligations under Articles 13–15 GDPR would still require clear explanations of how IRIS works and its limitations.

Answered: 6 months ago By: Miles_Hatcher

Yes, potentially. If IRIS alerts or make decisions that have legal significant documents it falls under GDPR

Answered: 6 months ago By: Clarawhitby

Maybe

Answered: 6 months ago By: Ifeanyiakare

Possibly but not automatically

Answered: 6 months ago By: Kunleekwueme

Yes. Since the models are still being scrutinised for issues around being biased, we can also assume it generates false positives and hence a major reason why users should have rights to an explanation

Answered: 6 months ago By: Sadeogunlana

YES

Answered: 6 months ago By: Tomashbrook

Yes, I do.

Answered: 2 months, 2 weeks ago By: Brightfox_45

Yes. Transparency is very important here for legal and ethical reasons. Plus, in the event that the system needs to do the update. People can give feedback to improve the system which may result in less events that go wrong. A beta test should be provided.

Answered: 2 months, 2 weeks ago By: Cleverwolf_27

Yes + transparency may also increase levels of consent given for usage.

Answered: 2 months, 2 weeks ago By: Brightrobin_21

Absolutely, yes. Transparency is key to support public trust

I like to distinguish between "opening the black box" and "providing meaningful explanations. Users dont need the mathematical details of a Vision Transformer, but they should be told something like "the alert was triggered because the system detected prolonged eye closure, etc"

Answered: 2 months, 2 weeks ago By: Warmlynx_14

Yes, people should have meaningful explanations, especially when an alert affects safety or driving control. The explanation should be practical and human-readable rather than a technical model summary.

Answered: 2 months, 2 weeks ago By: Swiftowl_37

Yes, explanation rights matter because users need to understand why the system reacted and how to challenge errors. This is especially important if the alert affects driving control or insurance consequences.

Answered: 2 months, 2 weeks ago By: Cleverrobin_87

Users should receive simple explanations, such as which signal pattern triggered the alert. This supports trust and allows review when the system behaves unexpectedly.

Answered: 2 months, 2 weeks ago By: Swiftrobin_35

Yes, explanations should be available in plain language so drivers understand why a warning was triggered. This also supports accountability and post-incident review.

Answered: 2 months, 2 weeks ago By: Boldlynx_38

Users should have a right to a clear explanation, particularly after a warning or intervention. That explanation should be understandable to non-experts.

Answered: 2 months, 2 weeks ago By: Quietbadger_45

Yes, people should be told why the system issued a warning and what signal triggered it. Meaningful explanation is part of trustworthy deployment.

Answered: 2 months, 2 weeks ago By: Swiftdeer_99

Yes, explanations are important because drivers should know why the system interrupted or warned them. A meaningful explanation can help with trust and error correction.

Answered: 2 months, 2 weeks ago By: Bravebear_45

Users deserve explanations that connect the alert to the signal the system used. That can be done without exposing proprietary details.

Answered: 2 months, 2 weeks ago By: Calmwolf_53

Users should receive simple explanations, such as which signal pattern triggered the alert. This supports trust and allows review when the system behaves unexpectedly.

Answered: 2 months, 2 weeks ago By: Brightowl_58

Yes, people should be told why the system issued a warning and what signal triggered it. Meaningful explanation is part of trustworthy deployment.

Answered: 2 months, 2 weeks ago By: Brightbear_54

Yes

Answered: 2 months, 2 weeks ago By: Warmhawk_15

Yes - Give the true positives.

Answered: 2 months, 2 weeks ago By: Quietrobin_25

Yes

Answered: 2 months, 2 weeks ago By: Braveowl_80

Yes, drivers should have a right to explain otherwise this technology would strive the driver of their personal agency - it is unlikely that the facial recognition system and heart rate detection could be 100% accurate in all circumstances and therefore if a driver was forced to pull over and then could not have the chance to explain their reasoning against the decision it would be rather unfair.

Answered: 2 months, 2 weeks ago By: Kindbadger_56

Definitely: should be explainable by design. This may help the project team, to reduce false alarms, including if users can comment/feedback on those explanations.

Answered: 2 months, 2 weeks ago By: Warmwolf_18

Yes. There needs to be an explainability element.

Your Answer

Login to add your answer!

We’d love to hear your thoughts — share a meaningful answer by logging in.