Is autonomy – governing yourself – compatible with letting yourself be governed by trust? This paper argues that autonomy is not only compatible with appropriate trust but actually requires it. Autonomy requires appropriate trust because it is undermined by inappropriate mistrust. An autonomous agent treats herself as answerable for her action-guiding commitments, where answerability requires openness to the rational influence of external, critical perspectives on those commitments. This openness to correction makes one vulnerable to manipulation and can be exploited in ways that undermine autonomy instead of supporting it. We argue that autonomy is undermined by inappropriate trust, and that the inappropriateness lies in the agent’s failure to manifest appropriate responsiveness to evidence of untrustworthiness in the one trusted. The problem isn’t that autonomy requires dispensing with trust but that trust must itself be governed by appropriate responsiveness to evidence of untrustworthiness. Our view confronts two challenges. One challenge lies in explaining why you shouldn’t treat your vulnerability to manipulation as a general reason to let your trusting disposition lapse into an untrusting one. We argue that there is no such general reason to let your responsiveness to evidence of untrustworthiness be supplanted by a suspicious disposition to seek and require positive evidence of trustworthiness. A second, and deeper, challenge arises from the fact that in some especially sophisticated cases of manipulation there is no evidence of untrustworthiness to which you could respond. We argue that you cannot rationally cope with even this unresolvable risk of exploited trust by trusting only yourself.
Professor at George Washington University
I am a Professor with Human-Technology Collaboration and Educational Technology programs at George Washington University in Washington DC. I have written 12 books and more than 100 articles, and I co-host of the Parsing Science podcast where scientists tell the stories behind their research. I am also the developer of the WeShareScience.com online platform for sharing research videos, and SciencePods.com where researchers can create free podcasts about their science. My research interests include human interactions with intelligent machines, needs, needs assessments, and instructional design.
Latest posts by Ryan Watkins (see all)
- Risks and Opportunities of Open-Source Generative AI - May 15, 2024
- Is that a Guideline? Addressing Learning in Ethics Guidelines - May 10, 2024
- The Hazards of Putting Ethics on Autopilot - May 9, 2024