ALFIE ETD-HUB

3: Does IRIS Require Explanation to Users?

Asked: 6 months, 1 week ago By: Catalink Views: 203 Catalink Case Study: IRIS

Since IRIS could generate decisions/alerts, does this trigger a user's right to an explanation under GDPR Article 22 for automated individual decision-making?

38 Answers

Answered: 4 months, 3 weeks ago By: Chiamakaokorie
Yes
Testificate replied: Not automatically. The fact that IRIS generates a drowsiness score, decision, or alert does not by itself trigger GDPR Article 22. Article 22 is engaged only where there is a decision based solely on automated processing, including profiling, that produces legal effects or similarly significant effects on the individual.
Answered: 4 months, 3 weeks ago By: Tundefasina
Yes, IRIS may trigger GDPR Article 22 if its alerts lead to automated decisions with significant effects (e.g., warnings, vehicle intervention). In such cases, users may have the right to meaningful information about the logic behind decisions and the ability to challenge them.
Testificate replied: If IRIS merely gives the driver a real-time warning such as “you may be drowsy; take a break”, Article 22 is less likely to apply, because the alert is advisory and may not have a legal or similarly significant effect. GDPR transparency duties would still apply, including explaining what data is processed, why, how long it is retained, and how the drowsiness assessment broadly works. Article 22 becomes much more relevant if the IRIS output leads automatically to a significant consequence, for example if it disables or limits vehicle functions, reports the driver to an employer or fleet manager, affects insurance pricing, triggers disciplinary action, records an impairment event against the driver, or causes an automated safety intervention with substantial impact. In those cases, the drowsiness alert may amount to automated individual decision-making with similarly significant effects.
Answered: 4 months, 3 weeks ago By: Zainabodogwu2
Yes—if IRIS autonomously generates alerts that have legal or similarly significant effects on the user (e.g., disciplinary action, driving restrictions), it would likely trigger GDPR Article 22, requiring a meaningful explanation, human oversight, and the ability to contest the decision.
Answered: 4 months, 3 weeks ago By: Oliverharrow
Yes
Testificate replied: I don't think it inherently does. It is also important to be precise about the so-called “right to an explanation.” GDPR does not contain a simple standalone right labelled “right to explanation”. Instead, where Article 22-type automated decision-making is involved, Articles 13 and 15 require the controller to provide meaningful information about the logic involved, as well as the significance and envisaged consequences of the processing for the data subject.
Answered: 4 months, 3 weeks ago By: Ngozioshoba
IRIS mainly provides alerts rather than making legal decisions, so it likely does not directly trigger Article 22 protections. Drivers still control their actions. However, users should still be given simple explanations about how alerts work to support transparency and trust.
Answered: 4 months, 3 weeks ago By: Efeadelaja
Yes, if IRIS generates decisions or alerts with legal or similarly significant effects on users, it would likely trigger the GDPR Article 22 right to an explanation for automated decision-making.
Answered: 4 months, 3 weeks ago By: Meilincai
Yes it does
Testificate replied: No, for IRIS, the key question is not simply “does the system make an automated assessment?”, but what consequence follows from that assessment.
Answered: 4 months, 3 weeks ago By: Kelechinwosu
IRIS triggers Article 22 only if its alerts lead to automatic, consequential outcomes (like pay cuts) without a human manager reviewing the context first.
Answered: 4 months, 3 weeks ago By: Zainabodogwu32
IRIS may trigger GDPR Article 22 if its outputs constitute automated decisions that produce legal or similarly significant effects on drivers. If IRIS merely provides advisory alerts (e.g. “possible drowsiness detected”) and the driver retains full control, Article 22 may not strictly apply. However, if IRIS: Automatically triggers interventions (e.g. vehicle slowdown, alerts reported to employers or insurers), or Influences decisions with significant safety, legal, or employment consequences, then it could fall within Article 22’s scope. In such cases, users would be entitled to: Meaningful information about the logic involved, An explanation of the decision, The ability to contest or override the decision. Even if Article 22 does not strictly apply, transparency obligations under Articles 13–15 GDPR would still require clear explanations of how IRIS works and its limitations.
Answered: 4 months, 3 weeks ago By: Miles_Hatcher
Yes, potentially. If IRIS alerts or make decisions that have legal significant documents it falls under GDPR
Answered: 4 months, 3 weeks ago By: Clarawhitby
Maybe
Answered: 4 months, 3 weeks ago By: Ifeanyiakare
Possibly but not automatically
Answered: 4 months, 3 weeks ago By: Kunleekwueme
Yes. Since the models are still being scrutinised for issues around being biased, we can also assume it generates false positives and hence a major reason why users should have rights to an explanation
Answered: 4 months, 3 weeks ago By: Sadeogunlana
YES
Answered: 4 months, 3 weeks ago By: Tomashbrook
Yes, I do.
Answered: 1 month ago By: Brightfox_45
Yes. Transparency is very important here for legal and ethical reasons. Plus, in the event that the system needs to do the update. People can give feedback to improve the system which may result in less events that go wrong. A beta test should be provided.
Answered: 1 month ago By: Cleverwolf_27
Yes + transparency may also increase levels of consent given for usage.
Answered: 1 month ago By: Brightrobin_21
Absolutely, yes. Transparency is key to support public trust I like to distinguish between "opening the black box" and "providing meaningful explanations. Users dont need the mathematical details of a Vision Transformer, but they should be told something like "the alert was triggered because the system detected prolonged eye closure, etc"
Answered: 1 month ago By: Warmlynx_14
Yes, people should have meaningful explanations, especially when an alert affects safety or driving control. The explanation should be practical and human-readable rather than a technical model summary.
Answered: 1 month ago By: Swiftowl_37
Yes, explanation rights matter because users need to understand why the system reacted and how to challenge errors. This is especially important if the alert affects driving control or insurance consequences.
Answered: 1 month ago By: Cleverrobin_87
Users should receive simple explanations, such as which signal pattern triggered the alert. This supports trust and allows review when the system behaves unexpectedly.
Answered: 1 month ago By: Swiftrobin_35
Yes, explanations should be available in plain language so drivers understand why a warning was triggered. This also supports accountability and post-incident review.
Answered: 1 month ago By: Boldlynx_38
Users should have a right to a clear explanation, particularly after a warning or intervention. That explanation should be understandable to non-experts.
Answered: 1 month ago By: Quietbadger_45
Yes, people should be told why the system issued a warning and what signal triggered it. Meaningful explanation is part of trustworthy deployment.
Answered: 1 month ago By: Swiftdeer_99
Yes, explanations are important because drivers should know why the system interrupted or warned them. A meaningful explanation can help with trust and error correction.
Answered: 1 month ago By: Bravebear_45
Users deserve explanations that connect the alert to the signal the system used. That can be done without exposing proprietary details.
Answered: 1 month ago By: Calmwolf_53
Users should receive simple explanations, such as which signal pattern triggered the alert. This supports trust and allows review when the system behaves unexpectedly.
Answered: 1 month ago By: Brightowl_58
Yes, people should be told why the system issued a warning and what signal triggered it. Meaningful explanation is part of trustworthy deployment.
Answered: 1 month ago By: Brightbear_54
Yes
Answered: 1 month ago By: Warmhawk_15
Yes - Give the true positives.
Answered: 1 month ago By: Quietrobin_25
Yes
Answered: 1 month ago By: Braveowl_80
Yes, drivers should have a right to explain otherwise this technology would strive the driver of their personal agency - it is unlikely that the facial recognition system and heart rate detection could be 100% accurate in all circumstances and therefore if a driver was forced to pull over and then could not have the chance to explain their reasoning against the decision it would be rather unfair.
Answered: 1 month ago By: Kindbadger_56
Definitely: should be explainable by design. This may help the project team, to reduce false alarms, including if users can comment/feedback on those explanations.
Answered: 1 month ago By: Warmwolf_18
Yes. There needs to be an explainability element.

Your Answer

Login to add your answer!

We’d love to hear your thoughts — share a meaningful answer by logging in.