AI systems can break in unexpected and interconnected ways. A privacy leak may be enabled by language, an adversarial perturbation may trigger unsafe behaviour, and rare instabilities may emerge only after deployment. This interactive workshop combines perspectives from dynamical systems, privacy-preserving machine learning, NLP, and adversarial robustness to examine how AI vulnerabilities arise, how they can be detected, and what meaningful mitigation or guarantees might look like.

Through expert inputs, structured discussion, and hands-on vulnerability mapping, participants will explore topics such as privacy inference, prompt manipulation, multilingual jailbreaks, data poisoning, adversarial speech, and rare catastrophic failures. The goal is to build a shared vocabulary, map complementary methods, and identify new opportunities for collaboration on trustworthy AI.

Programme

10:00 – Welcome and framing


Brief introduction to the Security, Safety, and Privacy in AI consortium, the motivation for the workshop, and the relevance of the topic for the D3A community. The framing will introduce the workshop’s central structure: understanding AI vulnerabilities, detecting them, and developing mitigation strategies or guarantees.



10:05 – Lightning research perspectives 


Four short research-group pitches will introduce complementary perspectives from the participating research groups. Each pitch will focus on one central vulnerability perspective, the methods used to study it, and the open challenges it raises.

• Abhijit Mazumdar: Safety of AI systems from dynamical and stochastic systems perspectives
• Qiongxiu Li: Privacy risks, inference-based exposure, and security implications of generative AI
• Xiaoyu Luo: Capable yet Parsimonious: Extracting and Characterizing Hidden Chain-of-Thought in Frontier Models
• Zheng-Hua Tan: Adversarial robustness, detection, and generative purification methods



–

10:45 – Structured mingling: What counts as an AI vulnerability for you? 


Participants will take part in a structured mingling exercise designed to establish a shared cross-disciplinary vocabulary. Participants will discuss how their fields define AI vulnerabilities, which forms of failure they consider most serious, and what kinds of evidence or guarantees they consider convincing. The exercise is intended to connect perspectives across the participants’ areas and facilitate discussions about collaboration. 

Moderated by Yuting Hou, Abhijit Mazumdar, Rahul Misra, Kevin Wilkinghoff, Wenrui Yu, and Flavio la Manna.


11:05 – Research Deep-dive 


An invited speaker will provide external perspectives on AI security, safety, privacy, or trustworthy AI. The talk will connect the consortium’s research themes to broader developments in the field and to the interests of the D3A community.

• Yiyi Chen – 15 minutes + 10 minutes Q&A

–


11:30: Lunch 



12:30: Shared methods and collaboration points


Participants will continue in small groups to identify methodological overlaps and possible collaboration points across the perspectives presented in the workshop. The aim is to identify where cross-disciplinary collaboration could lead to stronger approaches for understanding, detecting, and mitigating AI vulnerabilities. 


Moderated by Yuting Hou, Abhijit Mazumdar, Rahul Misra, Kevin Wilkinghoff, Wenrui Yu, and Flavio la Manna.



13:10: Future vision synthesis


Rafal Wisniewski will present a forward-looking synthesis on Classical Dynamical and Stochastic Systems as Tools for Safe AI. This session will connect the workshop themes to mathematical tools such as dynamical systems theory, stochastic stability, certificates, and rare event analysis, and outline how these tools can contribute to principled approaches to AI safety.

13:30: Group debate


Participants will work in small interdisciplinary groups and debate the position set forth in the Future Vision Synthesis. Each group will divide into those “for” and those “against” the position, and debate. The output will be a shared map of AI vulnerabilities and cross-disciplinary methods relevant to the D3A community. 


Moderated by Yuting Hou, Abhijit Mazumdar, Rahul Misra, Kevin Wilkinghoff, Wenrui Yu, and Flavio la Manna.



13:55: Wrap-up


Final synthesis of key takeaways, possible collaborations, and future activities within the Security, Safety, and Privacy in AI consortium and the broader D3A community. The wrap-up will identify concrete next steps emerging from the structured mingling, vulnerability mapping, and group discussions.

Speakers’ list

• Yiyi Chen – Postdoc – AAU-NLP
• Xiaoyu Luo – PhD Student – AAU-NLP
• Qiongxiu Li – Tenure Track Assistant Professor – AAU
• Rafal Wisniewski – Professor – AAU
• Zheng-Hua Tan – AAU

Level

Intermediate: For attendees who have basic understanding or some experience with the subject but are not yet advanced.

Organizers

• Johannes Bjerva (lead organizer) – Professor of Natural Language Processing and Artificial Intelligence – Aalborg University, Department of Computer Science
• Qiongxiu Li – Tenure-Track Assistant Professor, Aalborg University, Department of Electronic Systems
• Rafal Wisniewski – Professor; Head of Research, Aalborg University, Department of Electronic Systems 
• Zheng-Hua Tan – Professor of Machine Learning and Speech Processing, Aalborg University, Department of Electronic Systems
• Yuting Hou, PhD student, AAU
• Abhijit Mazumdar, Postdoc, AAU
• Rahul Misra, Postdoc, AAU
• Kevin Wilkinghoff, Postdoc, AAU
• Wenrui Yu, PhD student, AAU
• Flavio La Manna, PhD student, AAU