Real Safety AI Foundation / Research

AI Safety, Strategy, and Frameworks

The Harm Blindness Framework: A Practical Application Methodology for Stakeholder Harm Prevention in Technology Development

Publisher: Real Safety AI Foundation

Research paper.

Pages
27
Download PDFPlain language slides (PDF)Export BibTeXExport RIS

Abstract

Technology development consistently produces preventable harm to stakeholders who were identifiable at the time of key decisions. This paper introduces the Harm Blindness Framework, a checkpoint-based methodology designed to surface stakeholder impacts during development rather than after deployment. The framework operationalizes consultation of historical precedent through structured analysis at four decision points: ideation, design, testing, and launch. Validation against 161 historical cases spanning approximately 5,000 years reveals that 95.7% of analyzed harms had documented precedent available at the time decisions were made. The remaining 4.3% represent genuinely first-of-kind situations. A parallel analysis of 151 corporate disasters from 1970-2025 demonstrates that prevention costs typically range from 1-10% of eventual disaster costs, yielding return-on-investment ratios of 1,000-10,000x for harm prevention.

Plain language slides

First slide of the plain language summary of The Harm Blindness Framework: A Practical Application Methodology for Stakeholder Harm Prevention in Technology DevelopmentOpen the 19-slide summary (PDF)

Suggested citation

Gilly, Travis. "The Harm Blindness Framework: A Practical Application Methodology for Stakeholder Harm Prevention in Technology Development." Real Safety AI Foundation Research Paper, n.d.. https://realsafetyai.org/research/pe7nk5/

Other versions

This paper is also posted on SSRN.

SSRN version

References (29)

This list was read from the PDF text. Where the two differ, the PDF is correct.

  1. Alexander, L., & Moore, M. (2021). Deontological ethics. In E. N. Zalta (Ed.), The Stanford Encyclopedia of Philosophy (Winter 2021 Edition). Stanford University.
  2. Arkes, H. R., & Blumer, C. (1985). The psychology of sunk cost. Organizational Behavior and Human Decision Processes, 35(1), 124-140.
  3. Beauchamp, T. L., & Childress, J. F. (2019). Principles of biomedical ethics (8th ed.). Oxford University Press.
  4. Cooper, R. G. (2008). Perspective: The Stage-Gate idea-to-launch process—Update, what's new, and NexGen systems. Journal of Product Innovation Management, 25(3), 213-232.
  5. Courtwright, D. T. (2001). Dark paradise: A history of opiate addiction in America (Enlarged ed.). Harvard University Press.
  6. Driver, J. (2012). Consequentialism. Routledge.
  7. European Commission. (2024). Artificial Intelligence Act. Official Journal of the European Union.
  8. Freeman, R. E. (1984). Strategic management: A stakeholder approach. Pitman.
  9. Gioia, D. A. (1992). Pinto fires and personal ethics: A script analysis of missed opportunities. Journal of Business Ethics, 11(5), 379-389.
  10. Held, V. (2006). The ethics of care: Personal, political, and global. Oxford University Press.
  11. Horwitz, J. (2021). The Facebook Files: A Wall Street Journal investigation. Wall Street Journal.
  12. Hursthouse, R., & Pettigrove, G. (2018). Virtue ethics. In E. N. Zalta (Ed.), The Stanford Encyclopedia of Philosophy (Winter 2018 Edition). Stanford University.
  13. IEEE. (2019). Ethically aligned design: A vision for prioritizing human well-being with autonomous and intelligent systems (First Edition). IEEE.
  14. Juran, J. M. (1992). Juran on quality by design: The new steps for planning quality into goods and services. Free Press.
  15. Kahneman, D., & Tversky, A. (1979). Prospect theory: An analysis of decision under risk. Econometrica, 47(2), 263-291.
  16. Meadows, D. H. (2008). Thinking in systems: A primer. Chelsea Green Publishing.
  17. National Commission on the BP Deepwater Horizon Oil Spill and Offshore Drilling. (2011). Deep water: The Gulf oil disaster and the future of offshore drilling. U.S. Government Printing Office.
  18. National Institute of Standards and Technology. (2023). Artificial Intelligence Risk Management Framework (AI RMF 1.0). U.S. Department of Commerce.
  19. OECD. (2019). Recommendation of the Council on Artificial Intelligence. OECD Legal Instruments.
  20. Partnership on AI. (2021). PAI's approach to responsible AI development. Partnership on AI.
  21. Perrow, C. (1984). Normal accidents: Living with high-risk technologies. Basic Books.
  22. Reason, J. (1990). Human error. Cambridge University Press.
  23. Rességuier, A., & Rodrigues, R. (2020). AI ethics should not remain toothless! A call to bring back the teeth of ethics. Big Data & Society, 7(2).
  24. Slattery, P., Saeri, A. K., Grundy, E. A. C., Graham, J., Noetel, M., Uuk, R., Dao, L., Pour, S., Casper, S., & Thompson, N. (2024). The AI Risk Repository: A comprehensive meta-review, database, and taxonomy of risks from artificial intelligence. arXiv preprint arXiv:2408.12622.
  25. Tett, G. (2009). Fool's gold: How the bold dream of a small tribe at J.P. Morgan was corrupted by Wall Street greed and unleashed a catastrophe. Free Press.
  26. UNESCO. (2021). Recommendation on the Ethics of Artificial Intelligence. United Nations Educational, Scientific and Cultural Organization.
  27. Vallor, S. (2016). Technology and the virtues: A philosophical guide to a future worth wanting. Oxford University Press.
  28. Vaughan, D. (1996). The Challenger launch decision: Risky technology, culture, and deviance at NASA. University of Chicago Press.
  29. Von Drehle, D. (2003). Triangle: The fire that changed America. Atlantic Monthly Press.

All research