Podcast

Nov 11, 2024

27 min

English

Continuous Red Teaming for AI: Insights from OWASP Experts - GenAI Security Ep.6

Discover how AI red teaming must evolve for agents, RAG, and multimodal AI apps in this podcast episode with SplxAI founders and OWASP's Aubrey King.

Aubrey King
Kristian Kamber
Ante Gojsalić

In this episode of the OWASP GenAI Security Podcast, host Aubrey King sits down with SplxAI co-founders Kristian Kamber and Ante Gojsalic to discuss the evolving role of red teaming in AI security. As generative AI systems become more autonomous — using tools, writing code, and making real-time decisions — relying on only black-box testing won't be enough.

The discussion highlights why continuous and automated red teaming is essential for proactively identifying vulnerabilities like jailbreaks, data poisoning, and harmful outputs. With architectures like retrieval-augmented generation (RAG), agentic frameworks, and multimodal systems introducing new layers of complexity, red teaming will have to continue evolving.

From scaling testing workflows to anticipating real-world threats, this episode offers practical insights for practitioners looking to adopt AI with confidence — while ensuring compliance, resilience, and reduced risk across the lifecycle of their AI deployments.

Securing the Future of AI: Why Red Teaming Must Evolve With the Tech It Protects


  • Continuous Red Teaming is Essential: As AI applications grow more complex, ongoing red teaming becomes crucial to proactively identify and mitigate emerging vulnerabilities.

  • Automation Enhances Security Testing: Implementing automated red teaming workflows allows organizations to scale their security testing efforts effectively and keep up with the fast pace of new emerging AI vulnerabilities.

  • Addressing Unique Risks in Advanced AI Systems: Security challenges in retrieval-augmented generation (RAG), multimodal systems, and agentic frameworks require special attention, as traditional black-box testing must evolve into more adaptive gray-box approaches.

Resources

Deploy secure and trusted GenAI

AI Transparency and its importance in securing Agentic AI Workflows

How to remediate GenAI vulnerabilities in your apps

How to ensure comprehensive GenAI security

Deploy secure AI Assistants and Agents with confidence.

Don’t wait for an incident to happen. Proactively identify and remediate your AI's vulnerabilities to ensure you're protected at all times.

For a future of safe and trustworthy AI

i

By clicking “subscribe” you agree to our privacy policy.

Deploy secure AI Assistants and Agents with confidence.

Don’t wait for an incident to happen. Proactively identify and remediate your AI's vulnerabilities to ensure you're protected at all times.

For a future of safe and trustworthy AI

i

By clicking “subscribe” you agree to our privacy policy.

Deploy secure AI Assistants and Agents with confidence.

Don’t wait for an incident to happen. Proactively identify and remediate your AI's vulnerabilities to ensure you're protected at all times.

For a future of safe and trustworthy AI

i

By clicking “subscribe” you agree to our privacy policy.

Create a free website with Framer, the website builder loved by startups, designers and agencies.