F5 AI Guardrails to Secure Model Inference with Red Hat OpenShift AI @devcentral
F5 AI Guardrails to Secure Model Inference with Red Hat OpenShift AI  @devcentral
Uploaded May 2026 | Updated September 2026, 2 hours ago
In this demo, F5 AI Guardrails and Red Hat OpenShift AI work together to combat, secure, and govern GenAI traffic at the inference layer — with LlamaStack and vLLM serving the models entirely on-cluster.

Watch as we tackle the risks traditional API security can't see: OWASP LLM01 prompt injection and jailbreaks, LLM02 sensitive information disclosure, and uncontrolled AI interactions that leak PII, IP, and policy violations downstream. You'll see F5 AI Guardrails inspect every prompt and response in real time, enforce pre-built and custom policies, and produce a full per-request audit trail — all running as a Kubernetes-native operator on Red Hat OpenShift AI.

Explore the Following Key Topics:                                                                                
0:00 Introduction and the AI Inference Risk Landscape 
0:29 AI Inference Risk and F5 AI Guardrails 
1:22 Demo Environment on Red Hat OpenShift AI 
2:12 Infrastructure overview
3:22 Pre-built Guardrails
4:48 Custom Guardrails with Topic, Keyword, and Regex Pattern 
7:35 Audit Trail and Observability 
8:15 Summary and Key Takeaways

Notes:
- Contributed by: Eric Ji
- Related Article: None
- Project Files: None

⬇️⬇️ JOIN THE COMMUNITY! ⬇️⬇️⬇️


DevCentral is an online community of technical peers dedicated to learning, exchanging ideas, and solving problems—together.

Find all our platform links ⬇️ and follow our Community Evangelists! 👋

➡️ DEVCENTRAL: community.f5.com
➡️ YOUTUBE: youtube.com/devcentral
➡️ LINKEDIN: linkedin.com/showcase/f5-devcentral
➡️ X: https://x.com/devcentral

Your Community Evangelists:
👋 Jason Rahm: linkedin.com/in/jrahm | https://x.com/jasonrahm
👋 Buu Lam: linkedin.com/in/buulam | https://x.com/buulam
👋 Chase Abbott: linkedin.com/in/chaseabbott1
F5 AI Guardrails to Secure Model Inference with Red Hat OpenShift AIEverything You Trust Online Could Break — F5 Labs on Q-DaySimplifying and Securing Network Segmentation with F5 Distributed Cloud and Nutanix FlowIntroducing Red Hat AI Quickstarts: Streamlined Deployments for EngineersF5 BIG-IP and NetApp StorageGRID - Providing Fast and Scalable S3 API for AI appsAI and DevOps Evolution: Insights from DevOpsDays Singapore 2025AI Security, Cost Optimization, and Quantum Computing: Insights with NCSWhats New in F5 Insight for ADSP v1.1?F5 Insight for ADSP - A Closer LookUsing F5 NGINX Plus as the Ingress Controller within Nutanix Kubernetes Platform (NKP)Managing WAF Policy in F5 NGINX One ConsoleWasm Proposal Hot Takes Part 2 | Ep 23 | WebAssembly Unleashed
F5 DevCentral Community |

F5 AI Guardrails to Secure Model Inference with Red Hat OpenShift AI

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER