Real Safety AI Foundation / Research

Convergence Risk and Perceptual Modification

Ambient Non-Consensual Image Synthesis: A Convergence Threat Analysis of AR Wearables, Real-Time Video Generation, and Open-Source Nudification Models

Publisher: Real Safety AI Foundation

Research paper.

Pages
34

Abstract

We identify and analyze an emergent threat arising from the convergence of four maturing technologies: (1) open-source AI nudification models [1], (2) real-time video generation systems [2][3][4], (3) consumer AR wearables with camera input [5][6], and (4) edge and cloud AI inference [7][8]. While each component has received independent scholarly attention, no prior work synthesizes these into a unified threat model [9][10][11]. We demonstrate that real-time ambient non-consensual intimate image synthesis is architecturally feasible today via cloud-assisted pipelines [2][3], and will be feasible on-device within 12 to 24 months given current diffusion acceleration and edge hardware trajectories [12][13]. We further show that proposed mitigations (on-device safety filters) are fundamentally vulnerable to adversarial bypass, as illustrated by attacks on Google's SafetyCore system [14][15]. We introduce the concept of "perceptual consent" to describe the novel harm category where individuals lose autonomy over how their bodies are rendered in others' visual fields, grounding this concept in established frameworks of bodily autonomy, informational self-determination, and human dignity [16][17][18]. We document that population- level psychological harm from the technology's mere existence is already empirically established in the social media deepfake context and will intensify as the threat extends from digital to physical space. We conclude with technical, policy, and research recommendations.

Plain language slides

First slide of the plain language summary of Ambient Non-Consensual Image Synthesis: A Convergence Threat Analysis of AR Wearables, Real-Time Video Generation, and Open-Source Nudification ModelsOpen the 19-slide summary (PDF)

Suggested citation

Gilly, Travis. "Ambient Non-Consensual Image Synthesis: A Convergence Threat Analysis of AR Wearables, Real-Time Video Generation, and Open-Source Nudification Models." Real Safety AI Foundation Research Paper, n.d.. https://realsafetyai.org/research/gfwm4e/

References (82)

This list was read from the PDF text. Where the two differ, the PDF is correct.

  1. [1]C. Gibson et al., "Analyzing the AI Nudification Application Ecosystem," in Proc. USENIX Security Symposium, 2025.
  2. [2]PixVerse, "PixVerse R1: Next-Generation Real-Time World Model," Technical Report, Jan. 2026. [Online]. Available: https://pixverse.ai/en/blog/pixverse-r1-next-generation-real-time-world-model
  3. [3]"PixVerse R1: Real-Time AI Video Generation Arrives," VP Land, Jan. 2026.
  4. [4]"AIsphere Unveils PixVerse R1, Ushering in Real-Time AI Video Era," TMTPost, Jan. 2026.
  5. [5]"Smart glasses: 'I was secretly filmed and trolled online,'" BBC News, Jan. 2026.
  6. [6]"Meta's AI-Powered Smart Glasses Raises Privacy & User Data Concerns," Carleton University, 2025.
  7. [7]"The Role of Edge AI in Real-Time Analytics in 2026 Explained," Kanerika, 2026.
  8. [8]"How Edge AI Enables Real-Time Video Processing in Smart Cameras," TechNexion, 2025.
  9. [9]"Virtual Reality Data and Its Privacy Regulatory Challenges: A Call to Move Beyond Text-Based Informed Consent," California Law Review, 2023.
  10. [10]"Speculative Privacy Concerns About AR Glasses Data Collection," Proc. Privacy Enhancing Technologies (POPETS), 2023.
  11. [11]"SoK: Data Privacy in Virtual Reality," arXiv:2301.05940, 2023.
  12. [12]ShengShu Technology and Tsinghua University, "TurboDiffusion: Accelerating Video Diffusion Models by 100-200 Times," arXiv:2512.16093, Dec. 2025. [Online]. Available: https://arxiv.org/abs/2512.16093
  13. [13]"SnapGen-V: Generating a Five-Second Video within Five Seconds on a Mobile Device," arXiv:2412.10494, 2024.
  14. [14]"When On-Device AI Becomes a Security Flaw: The SafetyCore Case," Skyld AI, 2025.
  15. [15]"Breaking SafetyCore: Exploring the Risks of On-Device AI Deployment," arXiv:2509.06371, 2025.
  16. [16]M. C. Nussbaum, Women and Human Development: The Capabilities Approach. Cambridge University Press, 2000.
  17. [17]D. J. Solove, "A Taxonomy of Privacy," University of Pennsylvania Law Review, vol. 154, no. 3, pp. 477-564, 2006.
  18. [18]I. Kant, Groundwork of the Metaphysics of Morals, 1785. M. Gregor, Trans., Cambridge University Press, 1998.
  19. [19]"Unmasking digital deceptions: An integrative review of deepfake detection," PMC, 2025.
  20. [20]"'There Are No Limits!': AI Undressing Apps and the Normalization of Non-Consensual Intimate Imagery," PubMed, 2025.
  21. [21]"A systematic literature review on Virtual Reality and Augmented Reality in terms of privacy, authorization and data-leaks," arXiv:2212.04621, 2022.
  22. [22]"Exploring the Uncoordinated Privacy Protections of Eye Tracking and VR Motion Data," arXiv:2411.12766, 2024.
  23. [23]"Behind Grok's mass digital undressing lies an 'unsurprising' cohort," ABC News Australia, Jan. 2026.
  24. [24]"Attorney General Bonta Launches Investigation into xAI, Grok," California Attorney General Press Release, Jan. 2026.
  25. [25]"Grok-created images of real people in bikinis, underwear banned on X," Mashable, Jan. 2026.
  26. [26]A. Shostack, Threat Modeling: Designing for Security. Wiley, 2014.
  27. [27]I. J. Goodfellow, J. Shlens, and C. Szegedy, "Explaining and Harnessing Adversarial Examples," in Proc. ICLR, 2015. arXiv:1412.6572.
  28. [28]N. Carlini and D. Wagner, "Towards Evaluating the Robustness of Neural Networks," in Proc. IEEE S&P, 2017.
  29. [29]N. Papernot, P. McDaniel, S. Jha, M. Fredrikson, Z. B. Celik, and A. Swami, "The Limitations of Deep Learning in Adversarial Settings," in Proc. IEEE Euro S&P, 2016.
  30. [30]European Parliament and Council, "Regulation (EU) 2024/1689 laying down harmonised rules on artificial intelligence (AI Act)," Official Journal of the European Union, Aug. 2024. EUR-Lex: 32024R1689.
  31. [31]"DEFIANCE Act of 2025," H.R. 3562, 119th Congress (2025-2026). [Online]. Available: https://www.congress.gov/bill/119th-congress/house-bill/3562
  32. [32]"TAKE IT DOWN Act," Pub. L. No. 119-XX, May 2025.
  33. [33]"Online Safety Act 2023," UK Public General Acts, c. 50, Section 66B.
  34. [34]N. Henry et al., "Image-Based Sexual Abuse: A Study on the Causes and Consequences of Non-Consensual Nude or Sexual Imagery," 2020.
  35. [35]"Prevalence and Impacts of Image-Based Sexual Abuse," Cyber Civil Rights Initiative, 2025.
  36. [36]"Development of an AI-powered AR glasses system for real-time first aid assistance," PMC, 2025.
  37. [37]E. Maiberg, "Hugging Face Is Hosting 5,000 Nonconsensual AI Models of Real People," 404 Media, July 15, 2025. [Online]. Available: https://www.404media.co/hugging-face-is-hosting-5-000-nonconsensual-ai-models-of-real-people/
  38. [38]"UnfilteredAI," Hugging Face Model Repository.
  39. [39]"Researchers warn of rise in AI-created non-consensual explicit images," University of Florida News, May 2025.
  40. [40]"The 10 Best AI Video Generators for Content Creation," Digital Bricks, 2025.
  41. [41]"The Best AI Video Creation Trends from 2025," Clippie AI, 2026.
  42. [42]"PixVerse V5.5: Multi-Shot Video with Sound," SuperMaker AI, 2025.
  43. [43]"PixVerse-R1 LLM Benchmark Data," Automatio AI, 2026.
  44. [44]"Meta AI Glasses: Revolutionary AR Technology or Privacy Nightmare?" GigeNet, 2025.
  45. [45]M. Speicher et al., "AR Privacy Concerns in Social Contexts," in Proc. ACM CHI, 2020.
  46. [46]R. Williams et al., "Bystander Privacy in AR," IEEE VR, 2021.
  47. [47]"Edge Computing and AI: The Future of Real-Time Data Processing," Sapien.io, 2025.
  48. [48]"AI-based Wearable Vision Assistance System for the Visually Impaired," arXiv:2412.20059, 2024.
  49. [49]"LoXR: Performance Evaluation of Locally Executing LLMs on XR Devices," arXiv:2502.15761, 2025.
  50. [50]"Immersed in Reality Secured by Design: A Comprehensive Analysis of Security Measures in AR/VR Environments," arXiv:2404.16839, 2024.
  51. [51]"Deepfakes and Synthetic Media," TechUK, 2025.
  52. [52]"The rise and risks of synthetic media," Digital Watch Observatory, 2025.
  53. [53]"2025 AI Safety Index," Future of Life Institute, 2025.
  54. [54]"SDXS: Real-Time One-Step Latent Diffusion Models with Image Conditions," arXiv:2403.16627, 2024.
  55. [55]"'Violation of my body:' Perceptions of AI-generated non-consensual (intimate) imagery," arXiv:2406.05520, 2024.
  56. [56]"Regulating AI Deepfakes and Synthetic Media in the Political Arena," Brennan Center for Justice, 2025.
  57. [57]J. Bailenson and J. Cummings, "VR Consent and Embodiment," Stanford Virtual Human Interaction Lab, 2016.
  58. [58]"Designing Effective Consent Mechanisms for Spontaneous AR Interactions," in Proc. ACM CHI, 2025.
  59. [59]"Voyeurism (Offences) Act 2019," UK Public General Acts, c. 2, Section 67A.
  60. [60]California Penal Code § 647(j)(4).
  61. [61]California Civil Code § 1708.85.
  62. [62]Virginia Code § 18.2-386.2.
  63. [63]Texas Penal Code § 21.165.
  64. [64]"Google forcing Android System SafetyCore on users to scan for nudes," Kaspersky, 2025.
  65. [65]"Smart Glasses: Cool Tech or a Privacy Threat?" Panda Security, 2025.
  66. [66]"General Data Protection Regulation," Regulation (EU) 2016/679, Articles 4(14), 9.
  67. [67]Council of Europe, "Convention on preventing and combating violence against women and domestic violence (Istanbul Convention)," CETS No. 210, 2011.
  68. [68]"Not a Good Look, AI: What Happens to Privacy When Glasses Get Smart," Cyber Security Advisors Network, May 2025.
  69. [69]"Owl-1: Omni World Model for Consistent Long Video Generation," arXiv:2412.09600, 2024.
  70. [70]"Augmenting Security and Privacy in the Virtual Realm: An Analysis of Extended Reality Devices," arXiv:2402.03114, 2024.
  71. [71]International Center for Journalists, "The Chilling: A Global Study of Online Violence Against Women Journalists," 2023. [Online]. Available: https://www.icfj.org/our-work/chilling-global-study-online-violence-against-women-journalists
  72. [72]M. Björkenfeldt et al., "Self-Censorship Among Journalists: Anticipatory Threat and Professional Adaptation," Digital Journalism, 2025. DOI: 10.1080/21670811.2025.2601961
  73. [73]WITNESS, "Technology-Facilitated Gender-Based Violence," Mar. 2025. [Online]. Available: https://blog.witness.org/2025/03/technology-facilitated-gender-based-violence/
  74. [74]UNFPA, "An Infographic Guide to Technology-Facilitated Gender-Based Violence," 2025. [Online]. Available: https://www.unfpa.org/
  75. [75]L. Lumsden et al., "Gender and Online Expression: A UK Population Study," arXiv:2403.19037, 2024.
  76. [76]Washington Post, "X Users Tell Grok to 'Undress' Women in Their Photos," Jan. 6, 2026.
  77. [77]The Conversation, "How AI-Generated Sexual Images Cause Real Harm, Even Though We Know They Are Fake," Jan. 15, 2026. [Online]. Available: https://theconversation.com/how-ai-generated-sexual-images-cause-real-harm-even-though-we-know-they-are-fake-273427
  78. [78]F. Martin, "Online Safety Regulation of Deepfake and Image-Based Sexual Abuse in Australia," Alternative Law Journal, 2025. DOI: 10.1080/10383441.2025.2504791
  79. [79]A. Chapman and M. Williams, "'There Are No Limits!': AI Undressing Apps and the Normalization of Nonconsensual Intimate Deepfakes," Violence Against Women, 2025. DOI: 10.1177/10778012251397966
  80. [80]A. Singh, "The Gendered Panopticon: How Surveillance Enforces Binary Norms," Nickled and Dimed, Apr. 2025. [Online]. Available: https://nickledanddimed.com/2025/04/21/the-gendered-panopticon-how-surveillance-enforces-binary-norms/
  81. [81]"The Panopticon 2.0: Mass Surveillance in the Digital Age," The Uncensored Truth, 2025. [Online]. Available: https://theuncensoredtruth.com/part-1-the-panopticon-2-0-mass-surveillance-in-the-digital-age/
  82. [82]M. Vef and B. Groß, "NUCA: AI Camera That Redefines Image Creation," 2024. [Online]. Available: https://nuca.rocks/

All research