AI Literacy & Critical Thinking

bpb – Automation Bias

Wem vertrauen wir mehr: Mensch oder KI? Nicht nur Schülerinnen und Schüler können Opfer des “Automation Bias” werden – auch Lehrkräfte sollten die Ergebnisse von KI-Tools reflektieren. A concise media-literacy resource explaining automation bias, the tendency to trust recommendations and decisions made by machines more than one’s own judgment. Using AI chatbots and education as […]

★★★★★Up to date

Wem vertrauen wir mehr: Mensch oder KI? Nicht nur Schülerinnen und Schüler können Opfer des “Automation Bias” werden – auch Lehrkräfte sollten die Ergebnisse von KI-Tools reflektieren.

A concise media-literacy resource explaining automation bias, the tendency to trust recommendations and decisions made by machines more than one’s own judgment. Using AI chatbots and education as examples, it highlights why people should critically evaluate AI-generated information rather than accepting it automatically.

Why it matters for ENACT-AI

The resource directly addresses a core AI-literacy skill, maintaining human judgment when using AI. It helps learners recognise overreliance on AI, question AI-generated answers, verify information independently, and understand that AI systems can produce incorrect, biased or contextually inappropriate results.

Learning outcomes

Learners can explain the concept of automation bias, identify situations in which people may overtrust AI systems, recognise that AI-generated information can be incorrect or biased, compare AI outputs with independent sources, and develop strategies for maintaining critical judgment when using AI tools.

Suggested activity

Give learners a short question and ask them to first answer it independently, then ask an AI chatbot the same question. Present a case where the AI answer conflicts with reliable evidence. Learners identify which answer they would initially trust and why, then verify both answers using independent sources. Finish by creating a “Don't blindly trust AI” checklist with practical verification steps.