WOOT 26 - Are Neuro-Inspired Multi-Modal Vision-Language Models Resilient to Membership... @UsenixOrg
WOOT 26 - Are Neuro-Inspired Multi-Modal Vision-Language Models Resilient to Membership...  @UsenixOrg
Uploaded September 2026 | Updated November 2026, 4 days ago
Are Neuro-Inspired Multi-Modal Vision-Language Models Resilient to Membership Inference Privacy Leakage?

David Amebley and Sayanton Dibbo, The University of Alabama

The growing deployment of multi-modal models (MMs) has introduced new attack vectors that can leak sensitive training data, leading to privacy leakage. This paper investigates black-box membership inference attack (MIA) privacy attack on multi-modal vision-language models (VLMs). State-of-the-art research analyzes privacy vulnerabilities primarily to unimodal AI systems, while recent studies indicate MMs can also be vulnerable to privacy attacks. On the other hand, researchers have demonstrated that biologically inspired neural network representations can enhance the resilience of unimodal systems against adversarial attacks. However, the privacy vulnerability of neuro-inspired MMs remains unexplored. In this work, we introduce a systematic neuroscience-inspired topological regularization framework and expose the resilience of MM VLMs against image-text-based MIA vulnerabilities. We examine this MIA vulnerability using three different VLMs: BLIP, PaliGemma 2, and ViT-GPT2, across three benchmark datasets: COCO, CC3M, and NoCaps. We compare the baseline and neuro VLMs (with topological regularization) defined as neuro (τ =2) and another variant neuro++ (τ =3). Our results on the BLIP model using the COCO dataset demonstrate that neuro-inspired regularization significantly reduces MIA attack success, with neuro (τ=2) achieving an approximately 24% reduction in mean ROC-AUC, while preserving or improving utility as measured by MPNet and ROUGE-2. Additional evaluations on BLIP, PaliGemma 2, and ViT-GPT2 across CC3M and NoCaps indicate that privacy improvements are architecture and dataset-dependent, with stronger regularization (τ =3) generally required to achieve consistent reductions in membership inference risk. This research contributes to the growing understanding of privacy risks in MMs and a pathway to design privacy threat-resilient VLMs.

View the full WOOT '26 program at usenix.org/conference/woot26/technical-sessions
WOOT 26 - Are Neuro-Inspired Multi-Modal Vision-Language Models Resilient to Membership...WOOT 26 - Onelogon: Taking over Active Directory Accounts via NetlogonUSENIX Security 26 (Enigma Track) - Security Tools Dont Detect Attacks—Humans DoUSENIX Security 26 - PatchWeaver: Risk-Bounded Autonomous Vulnerability Remediation Under Change-M…USENIX Security 26 - From Assistance to Autonomy: An Empirical Study of AI Use in a Live Capture-t…WOOT 26 - Exploiting Android Apps with Counterfeit ArtVehicleSec 26 - AutoHack: A Physically Verified Multi-Bus CAN Dataset for Intrusion Detection...USENIX Security 26 - Bridges to Self: Silent Web-to-App Tracking on Mobile via LocalhostDeploying Nagios in a Large Enterprise Environment, at USENIX LISA 07VehicleSec 26 - A Study on Extending the TARA Methodology for Physical AI: A Case Study of ADSOSDI 26 - Jetpack: Consensus Made Generally FastVehicleSec 26 - SLEIGHT: Real-time Closed-Loop Attack Analytics Framework for Holistic Intrusion...
USENIX |

WOOT '26 - Are Neuro-Inspired Multi-Modal Vision-Language Models Resilient to Membership...

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER