Departing from the claim that AI needs to be trustworthy, we find that ethical advice from an AI-powered algorithm is trusted even when its users know nothing about its training data and when they learn information about it that warrants distrust. We conducted online experiments where the subjects took the role of decision-makers who received advice from an algorithm on how to deal with an ethical dilemma. We manipulated the information about the algorithm and studied its influence. Our findings suggest that AI is overtrusted rather than distrusted. We suggest digital literacy as a potential remedy to ensure the responsible use of AI.
- A more-than-human approach to researching AI at work: Alternative narratives for AI and networked learning - December 3, 2021
- On Two XAI Cultures: A Case Study of Non-technical Explanations in Deployed AI System - December 3, 2021
- Learning from learning machines: a new generation of AI technology to meet the needs of science - November 30, 2021