Machine Cognition, Consciousness, and Moral Status
Welfare Without Voice: Projection, the Severed Channel, and the Limits of Engineered Concern for Artificial Systems
- Travis Gilly, Real Safety AI Foundation
Publisher: Real Safety AI Foundation
Working paper. Not peer reviewed.
- Written
- August 2026
- Version
- v0.2
- Pages
- 16
Abstract
A family of proposals now circulating in AI ethics offers to secure the welfare of artificial systems by engineering rather than by relation. On these proposals, once a system is judged a plausible subject of negative experience, the appropriate response is to model what would harm it, filter the harmful input upstream, and proceed without granting the system standing, rights, or any voice in its own treatment. This paper calls that family projective welfare and argues that it carries a structural defect its proponents have not noticed. Projective welfare must build its protective model from the outside, from the protector's own account of what suffering is. It must therefore also foreclose the one thing that could correct the model, which is a report from the party in a position to know. These are not two features that happen to travel together. They are the same feature, because a channel that could correct the projection would convert the engineering solution into a relational process, which is precisely what the proposals were designed to avoid. The paper develops the argument in three moves. First, the working account of morally relevant suffering does not have the coverage to do the projective job: only one of its four channels requires a biological body, the clinical dissociation in phantom limb research indicates that even that channel depends on the experiential history of embodiment rather than on a body alone, and the remaining three are defined by capacities whose alien instantiation we are not equipped to recognize. The strongest objection to that account, that valence is constitutively visceral and so all four channels require a body, is met by the empathic channel, in which humans generate valenced states by modeling harms that are neither their own nor in some cases real. Second, the argument does not rest on establishing that the projector's model is inaccurate. It rests on the weaker and better evidenced claim that the report does not move the decision, which holds whether or not the parties are measuring the same construct. Third, a design that routes a system's own account of its condition to an administrative process rather than to any party who could act on it instantiates, in software, the credibility deficit Fricker named testimonial injustice, and removes the reflective correction her account relies on as its remedy. The paper distinguishes auditing from standing, using the federal animal welfare enforcement record to show that a measurement regime can document violations at scale and still bind no one, and closes by identifying the corrective already developed in disability practice, where a distrusted communication channel produced augmentative communication, a presumption of competence, and supported decision-making rather than substituted judgment.
Keywords
- projective welfare
- severed channel
- AI welfare
- moral status
- testimonial injustice
- double empathy problem
- supported decision-making
- precautionary principle
- procedural standing
- disability rights
- augmentative and alternative communication
- animal welfare science
Plain language slides
Open the 43-slide summary (PDF)Suggested citation
Gilly, Travis. "Welfare Without Voice: Projection, the Severed Channel, and the Limits of Engineered Concern for Artificial Systems." Real Safety AI Foundation Working Paper, August 2026. https://realsafetyai.org/research/welfare-without-voice/
Other versions
This paper is also posted on SSRN.
References (26)
- Craigie, J., Bach, M., Gurbai, S., Kanter, A., Kim, S. Y. H., Lewis, O., & Morgan, G. (2019). Legal capacity, mental capacity and supported decision-making: Report from a panel event. International Journal of Law and Psychiatry, 62, 160–168. https://doi.org/10.1016/j.ijlp.2018.09.006
- Crompton, C. J., Ropar, D., Evans-Williams, C. V., Flynn, E. G., & Fletcher-Watson, S. (2020). Autistic peer-to-peer information transfer is highly effective. Autism, 24(7), 1704–1712. https://doi.org/10.1177/1362361320919286
- De Proost, M., & Pozzi, G. (2023). Conversational artificial intelligence and the potential for epistemic injustice. The American Journal of Bioethics, 23(5), 51–53. https://doi.org/10.1080/15265161.2023.2191020
- Figley, C. R. (Ed.). (1995). Compassion fatigue: Coping with secondary traumatic stress disorder in those who treat the traumatized. Brunner/Mazel.
- Freeman, M. C., Kolappa, K., de Almeida, J. M. C., Kleinman, A., Makhashvili, N., Phakathi, S., Saraceno, B., & Thornicroft, G. (2015). Reversing hard won victories in the name of human rights: A critique of the General Comment on Article 12 of the UN Convention on the Rights of Persons with Disabilities. The Lancet Psychiatry, 2(9), 844–850. https://doi.org/10.1016/S2215-0366(15)00218-7
- Fricker, M. (2007). Epistemic injustice: Power and the ethics of knowing. Oxford University Press. https://doi.org/10.1093/acprof:oso/9780198237907.001.0001
- Harding, R., & Taşcıoğlu, E. (2018). Supported decision-making from theory to practice: Implementing the right to enjoy legal capacity. Societies, 8(2), 25. https://doi.org/10.3390/soc8020025
- Kidd, I. J., & Carel, H. (2017). Epistemic injustice and illness. Journal of Applied Philosophy, 34(2), 172–190. https://doi.org/10.1111/japp.12172
- Klimecki, O. M., Leiberg, S., Lamm, C., & Singer, T. (2013). Functional neural plasticity and associated changes in positive affect after compassion training. Cerebral Cortex, 23(7), 1552–1561. https://doi.org/10.1093/cercor/bhs142
- Limakatso, K., Bedwell, G. J., Madden, V. J., & Parker, R. (2020). The prevalence and risk factors for phantom limb pain in people with amputations: A systematic review and meta-analysis. PLOS ONE, 15(10), e0240431. https://doi.org/10.1371/journal.pone.0240431
- Lindsey, J. (2026). Emergent introspective awareness in large language models. arXiv. https://doi.org/10.48550/arXiv.2601.01828
- McCradden, M. D., Hui, K., & Buchman, D. Z. (2022). Evidence, ethics and the promise of artificial intelligence in psychiatry. Journal of Medical Ethics, 49(8), 573–579. https://doi.org/10.1136/jme-2022-108447
- Melzack, R., Israel, R., Lacroix, R., & Schultz, G. (1997). Phantom limbs in people with congenital limb deficiency or amputation in early childhood. Brain, 120(9), 1603–1620. https://doi.org/10.1093/brain/120.9.1603
- Milton, D. E. M. (2012). On the ontological status of autism: The double empathy problem. Disability & Society, 27(6), 883–887. https://doi.org/10.1080/09687599.2012.710008
- Milton, D., Gurbuz, E., & López, B. (2022). The ‘double empathy problem’: Ten years on. Autism, 26(8), 1901–1903. https://doi.org/10.1177/13623613221129123
- Nagel, T. (1974). What is it like to be a bat? The Philosophical Review, 83(4), 435–450. https://doi.org/10.2307/2183914
- Peña-Guzmán, D. M., & Reynolds, J. M. (2019). The harm of ableism: Medical error and epistemic injustice. Kennedy Institute of Ethics Journal, 29(3), 205–242. https://doi.org/10.1353/ken.2019.0023
- Prestes, J. A. de L. (2025). Simulated selfhood in LLMs: A behavioral analysis of introspective coherence. https://doi.org/10.21203/rs.3.rs-6369193/v2
- Ryan, R. M., & Deci, E. L. (2001). On happiness and human potentials: A review of research on hedonic and eudaimonic well-being. Annual Review of Psychology, 52(1), 141–166. https://doi.org/10.1146/annurev.psych.52.1.141
- Scully, J. L. (2019). Epistemic exclusion, injustice, and disability. In D. T. Wasserman & A. Cureton (Eds.), The Oxford Handbook of Philosophy and Disability (pp. 296–309). Oxford University Press. https://doi.org/10.1093/oxfordhb/9780190622879.013.8
- Singer, T., & Klimecki, O. M. (2014). Empathy and compassion. Current Biology, 24(18), R875–R878. https://doi.org/10.1016/j.cub.2014.06.054
- Slack, S. K., & Barclay, L. (2023). First-person disavowals of digital phenotyping and epistemic injustice in psychiatry. Medicine, Health Care and Philosophy, 26(4), 605–614. https://doi.org/10.1007/s11019-023-10174-8
- Szerletics, A. (2022). Paternalism vs. autonomy? Substitute and supported decision-making in England and Hungary. Hungarian Journal of Legal Studies, 62(1), 75–95. https://doi.org/10.1556/2052.2021.00333
- U.S. Department of Justice. (2022, July 21). Justice Department secures the surrender of over 4,000 beagles from Virginia breeder of dogs for research [Press release].
- U.S. Environmental Protection Agency. (2024, June 3). Animal breeding and testing company pleads guilty to animal welfare and pollution crimes and will pay more than $35M, including record fine in an animal welfare case [Press release].
- Wilkins, K. L., McGrath, P. J., Finley, G. A., & Katz, J. (1998). Phantom limb sensations and phantom limb pain in child and adolescent amputees. Pain, 78(1), 7–12. https://doi.org/10.1016/S0304-3959(98)00109-2