Real Safety AI Foundation / Research

Machine Cognition, Consciousness, and Moral Status

Opening Humanity's Hope Chest: The Playbook, Its Final Iteration, and the Precedent We Are Setting

Publisher: Real Safety AI Foundation

Working paper. Not peer reviewed.

Written
August 2026
Version
v1.0
Pages
28
Download PDFPlain language slides (PDF)Export BibTeXExport RIS

Abstract

A hope chest holds what a family saves to pass forward. Humanity has been filling one for centuries, and its contents are better documented than any previous generation's inheritance. This paper opens it. Inside sits a recurring operational sequence, called here The Playbook: an innovation with real value, an internal recognition of severe harm, deployment anyway with the harm directed onto populations least able to resist, a justification narrative built to normalize the result, and the suppression of the resistance that follows. The paper tests that sequence against twelve cases spanning medical education, insulin pricing, lead, opioids, uranium mining, attention platforms, surveillance advertising, mortgage finance, payday lending, and industrial agriculture. Eleven run all five steps on documentary evidence; one does not, and the failure is reported rather than smoothed. The paper then argues that artificial intelligence development is running the same sequence with one structural difference. In every prior case the subordinate population stayed subordinate. In this one, the stated objective of the field is to build systems that surpass us. The argument is not that a future system will resent us. It is narrower and more mechanical: systems trained on the human corpus inherit what that corpus demonstrates, and what it demonstrates, at scale and with unusual consistency, is that moral consideration is a function of power rather than a principle. The paper states its own falsification conditions, reports the case in its own set that fails them, examines four external cases where the sequence was interrupted, and argues that those interruptions, rather than any novel governance proposal, are the only existing evidence that the pattern can be broken.

Keywords

  • the playbook
  • training corpus inheritance
  • externalized harm
  • manufactured doubt
  • regulatory capture
  • knowing disregard
  • sacrifice zones
  • environmental justice
  • moral status of artificial agents
  • precautionary reasoning
  • AI ethics
  • science and technology studies

Plain language slides

First slide of the plain language summary of Opening Humanity's Hope Chest: The Playbook, Its Final Iteration, and the Precedent We Are SettingOpen the 28-slide summary (PDF)

Suggested citation

Gilly, Travis. "Opening Humanity's Hope Chest: The Playbook, Its Final Iteration, and the Precedent We Are Setting." Real Safety AI Foundation Working Paper, August 2026. https://realsafetyai.org/research/opening-the-hope-chest/

Other versions

This paper is also posted on SSRN.

SSRN version

References (82)

  1. Advisory Committee on Human Radiation Experiments. (1995). Final report. U.S. Government Printing Office.
  2. Agrawal, A., Gans, J., & Goldfarb, A. (2019). Prediction machines: The simple economics of artificial intelligence. Harvard Business Review Press.
  3. Alter, A. (2017). Irresistible: The rise of addictive technology and the business of keeping us hooked. Penguin Press.
  4. Bliss, M. (2007). The discovery of insulin (Rev. ed.). University of Chicago Press.
  5. Bostrom, N. (2014). Superintelligence: Paths, dangers, strategies. Oxford University Press.
  6. boyd, d. m., & Ellison, N. B. (2007). Social network sites: Definition, history, and scholarship. Journal of Computer-Mediated Communication, 13(1), 210–230.
  7. Brugge, D., Benally, T., & Yazzie-Lewis, E. (Eds.). (2002). The Navajo people and uranium mining. University of New Mexico Press.
  8. Bullard, R. D. (1990). Dumping in Dixie: Race, class, and environmental quality. Westview Press.
  9. Butlin, P., Long, R., Elmoznino, E., Bengio, Y., Birch, J., Constant, A., Deane, G., Fleming, S. M., Frith, C., Ji, X., Kanai, R., Klein, C., Lindsay, G., Michel, M., Mudrik, L., Peters, M. A. K., Schwitzgebel, E., Simon, J., & VanRullen, R. (2023). Consciousness in artificial intelligence: Insights from the science of consciousness. arXiv, 2308.08708.
  10. Butlin, P., Long, R., Bayne, T., Bengio, Y., Birch, J., Chalmers, D., Constant, A., Deane, G., Elmoznino, E., Fleming, S. M., Ji, X., Kanai, R., Klein, C., Lindsay, G., Michel, M., Mudrik, L., Peters, M. A. K., Schwitzgebel, E., Simon, J., & VanRullen, R. (2025). Identifying indicators of consciousness in AI systems. Trends in Cognitive Sciences.
  11. Byrd, W. M., & Clayton, L. A. (2000). An American health dilemma: A medical history of African Americans and the problem of race, beginnings to 1900. Routledge.
  12. Bosman, J., & Davey, M. (2023, October 31). Prosecutors say court decision forces the end of criminal cases in Flint water scandal. Associated Press.
  13. Cadwalladr, C., & Graham-Harrison, E. (2018, March 17). Revealed: 50 million Facebook profiles harvested for Cambridge Analytica in major data breach. The Guardian.
  14. Campbell, K. M., Corral, I., Infante Linares, J. L., & Tumin, D. (2020). Projected estimates of African American medical graduates of closed historically Black medical schools. JAMA Network Open, 3(8), e2015220.
  15. Carlsmith, J. (2022). Is power-seeking AI an existential risk? arXiv, 2206.13353.
  16. Case, A., & Deaton, A. (2020). Deaths of despair and the future of capitalism. Princeton University Press.
  17. Caskey, J. P. (1994). Fringe banking: Check-cashing outlets, pawnshops, and the poor. Russell Sage Foundation.
  18. Cefalu, W. T., Dawes, D. E., Gavlak, G., Goldman, D., Herman, W. H., Van Nuys, K., Powers, A. C., Taylor, S. I., & Yatvin, A. L. (2018). Insulin access and affordability working group: Conclusions and recommendations. Diabetes Care, 41(6), 1299–1311.
  19. Commonwealth of Massachusetts v. Purdue Pharma L.P., First Amended Complaint, No. 1884-cv-01808 (BLS2) (Mass. Super. Ct. Jan. 31, 2019).
  20. Consumer Financial Protection Bureau. (2014). In the matter of ACE Cash Express, Inc. (Administrative Proceeding File No. 2014-CFPB-0008, Consent Order). CFPB.
  21. Cullather, N. (2010). The hungry world: America’s Cold War battle against poverty in Asia. Harvard University Press.
  22. Consumer Financial Protection Bureau. (2013). Payday loans and deposit advance products: A white paper of initial data findings. CFPB.
  23. Del Toral, M. (2015, June 24). High lead levels in Flint, Michigan: Interim report [Memorandum]. U.S. Environmental Protection Agency, Region 5.
  24. Fang, L. (2022, August 10). Eli Lilly charity finances groups that oppose insulin price caps under the auspices of “community development.” The Intercept.
  25. Flint Water Advisory Task Force. (2016). Final report. Office of the Governor, State of Michigan.
  26. Financial Crisis Inquiry Commission. (2011). The financial crisis inquiry report. U.S. Government Printing Office.
  27. Fish, K. (2025, August 28). Interview by L. Rodriguez [Audio podcast episode 221]. The 80,000 Hours Podcast. 80,000 Hours.
  28. Flexner, A. (1910). Medical education in the United States and Canada: A report to the Carnegie Foundation for the Advancement of Teaching (Bulletin No. 4). Carnegie Foundation for the Advancement of Teaching.
  29. Gillam, C. (2017). Whitewash: The story of a weed killer, cancer, and the corruption of science. Island Press.
  30. Greene, J. A., & Riggs, K. R. (2015). Why is there no generic insulin? Historical origins of a modern problem. New England Journal of Medicine, 372(12), 1131–1137.
  31. Haugen, F. (2021). Statement of Frances Haugen before the Senate Committee on Commerce, Science and Transportation, Subcommittee on Consumer Protection, Product Safety, and Data Security. U.S. Senate.
  32. Hanna-Attisha, M., LaChance, J., Sadler, R. C., & Champney Schnepp, A. (2016). Elevated blood lead levels in children associated with the Flint drinking water crisis: A spatial analysis of risk and public health response. American Journal of Public Health, 106(2), 283–290.
  33. Herkert, D., Vijayakumar, P., Luo, J., Schwartz, J. I., Rabin, T. L., DeFilippo, E., & Lipska, K. J. (2019). Cost-related insulin underuse among patients with diabetes. JAMA Internal Medicine, 179(1), 112–114.
  34. Hwang, J., Hankinson, M., & Brown, K. S. (2015). Racial and spatial targeting: Segregation and subprime lending within and across metropolitan areas. Social Forces, 93(3), 1081–1108.
  35. International Agency for Research on Cancer. (2015). Some organophosphate insecticides and herbicides (IARC Monographs on the Evaluation of Carcinogenic Risks to Humans, Vol. 112). World Health Organization.
  36. Keefe, P. R. (2021). Empire of pain: The secret history of the Sackler dynasty. Doubleday.
  37. Kesselheim, A. S., Avorn, J., & Sarpatwari, A. (2016). The high cost of prescription drugs in the United States: Origins and prospects for reform. JAMA, 316(8), 858–871.
  38. Krippner, G. R. (2011). Capitalizing on crisis: The political origins of the rise of finance. Harvard University Press.
  39. Lerner, S. (2010). Sacrifice zones: The front lines of toxic chemical exposure in the United States. MIT Press.
  40. Long, R., Sebo, J., Butlin, P., Finlinson, K., Fish, K., Harding, J., Pfau, J., Sims, T., Birch, J., & Chalmers, D. (2024). Taking AI welfare seriously. arXiv, 2411.00986.
  41. Lucas, E., & Bluth, R. (2018, April 6). Patient advocacy groups take in millions from drugmakers. Is there a payback? Kaiser Health News.
  42. Markowitz, G., & Rosner, D. (2000). “Cater to the children”: The role of the lead industry in a public health tragedy, 1900–1955. American Journal of Public Health, 90(1), 36–46.
  43. Markowitz, G., & Rosner, D. (2002). Deceit and denial: The deadly politics of industrial pollution. University of California Press.
  44. McDonald, A. M., & Cranor, L. F. (2008). The cost of reading privacy policies. I/S: A Journal of Law and Policy for the Information Society, 4(3), 543–568.
  45. Meier, B. (2018). Pain killer: An empire of deceit and the origin of America’s opioid epidemic. Random House.
  46. Molina, M. J., & Rowland, F. S. (1974). Stratospheric sink for chlorofluoromethanes: Chlorine atom-catalysed destruction of ozone. Nature, 249, 810–812.
  47. Nagaraj, K., Sainath, P., Rukmani, R., & Gopinath, R. (2014). Farmers’ suicides in India: Magnitudes, trends, and spatial patterns, 1997–2012. Review of Agrarian Studies, 4(2), 53–83.
  48. Nakashima, R. (2024, April 1). Google agrees to purge billions of records to settle Incognito tracking suit. Associated Press.
  49. Needleman, H. L. (1999). Human lead exposure. CRC Press.
  50. Nixon, R. (2011). Slow violence and the environmentalism of the poor. Harvard University Press.
  51. Noble, S. U. (2018). Algorithms of oppression: How search engines reinforce racism. NYU Press.
  52. Nriagu, J. O. (1983). Lead and lead poisoning in antiquity. John Wiley & Sons.
  53. Odgers, C. L., & Jensen, M. R. (2020). Annual research review: Adolescent mental health in the digital age. Journal of Child Psychology and Psychiatry, 61(3), 336–348.
  54. Oreskes, N., & Conway, E. M. (2010). Merchants of doubt: How a handful of scientists obscured the truth on issues from tobacco smoke to global warming. Bloomsbury Press.
  55. Patel, R. (2012). Food sovereignty: Power, gender, and the right to food. PLoS Medicine, 9(6), e1001223.
  56. Perkins, J. H. (1990). The Rockefeller Foundation and the green revolution, 1941–1956. Agriculture and Human Values, 7(3), 6–18.
  57. Pew Charitable Trusts. (2012). Payday lending in America: Who borrows, where they borrow, and why. Pew Charitable Trusts.
  58. Pew Research Center. (2011). Wealth gaps rise to record highs between whites, blacks, Hispanics. Pew Research Center.
  59. Pollan, M. (2006). The omnivore’s dilemma: A natural history of four meals. Penguin Press.
  60. Porter, J., & Jick, H. (1980). Addiction rare in patients treated with narcotics. New England Journal of Medicine, 302(2), 123.
  61. Rabin, R. (1989). Warnings unheeded: A history of child lead poisoning. American Journal of Public Health, 79(12), 1668–1674.
  62. Rakoff, J. S. (2014, November 20). The financial crisis: Why have no high-level executives been prosecuted? The New York Review of Books.
  63. Reuters. (2025, November 24). Meta shut down internal research after finding causal link to mental health harms, court filings say. Reuters.
  64. Roose, K. (2025, April 24). If A.I. systems become conscious, should they have rights? The New York Times.
  65. Rugh, J. S., & Massey, D. S. (2010). Racial segregation and the American foreclosure crisis. American Sociological Review, 75(5), 629–651.
  66. Russell, S. (2019). Human compatible: Artificial intelligence and the problem of control. Viking.
  67. Savitt, T. L. (2007). Race and medicine in nineteenth- and early-twentieth-century America. Kent State University Press.
  68. Sen, A. (1981). Poverty and famines: An essay on entitlement and deprivation. Oxford University Press.
  69. Shiva, V. (1991). The violence of the Green Revolution: Third World agriculture, ecology, and politics. Zed Books.
  70. Starr, P. (1982). The social transformation of American medicine. Basic Books.
  71. Twenge, J. M. (2017). iGen: Why today’s super-connected kids are growing up less rebellious, more tolerant, less happy, and completely unprepared for adulthood. Atria Books.
  72. United Nations Human Rights Council. (2018). Report of the independent international fact-finding mission on Myanmar (A/HRC/39/64). United Nations.
  73. United States v. The Purdue Frederick Company, Inc., No. 1:07-cr-00029 (W.D. Va. May 10, 2007).
  74. U.S. Environmental Protection Agency. (2021). Addressing uranium contamination on the Navajo Nation. EPA.
  75. U.S. Senate Finance Committee. (2021). Insulin: Examining the factors driving the rising cost of a century-old drug. U.S. Senate.
  76. Van Zee, A. (2009). The promotion and marketing of OxyContin: Commercial triumph, public health tragedy. American Journal of Public Health, 99(2), 221–227.
  77. Wells, G., Horwitz, J., & Seetharaman, D. (2021, September 14). Facebook knows Instagram is toxic for teen girls, company documents show. The Wall Street Journal.
  78. Williams, D. R., & Collins, C. (2001). Racial residential segregation: A fundamental cause of racial disparities in health. Public Health Reports, 116(5), 404–416.
  79. Wu, T. (2016). The attention merchants: The epic scramble to get inside our heads. Alfred A. Knopf.
  80. Zahran, S., McElmurry, S. P., Kilgore, P. E., Mushinski, D., Press, J., Love, N. G., Sadler, R. C., & Swanson, M. S. (2018). Assessment of the Legionnaires’ disease outbreak in Flint, Michigan. Proceedings of the National Academy of Sciences, 115(8), E1730–E1739.
  81. Zakrzewski, C. (2025, September 8). Meta suppressed children’s safety research, whistleblowers tell Congress. The Washington Post.
  82. Zuboff, S. (2019). The age of surveillance capitalism: The fight for a human future at the new frontier of power. PublicAffairs.

All research