Secure by Design
Learn more 
Blog
As organizations rapidly adopt generative AI, they face a new frontier of security challenges that traditional testing approaches simply cannot address. AI systems are non-deterministic, have unique attack surfaces, and require specialized security testing methodologies. Dataiku Guard Services: Runtime Protection for AI Systems
Dataiku's LLM Guard Services provide comprehensive runtime protection that works seamlessly with Recon's vulnerability discovery capabilities.
Figure 1: Dataiku LLM Guard Services
As seen above, there are three LLM Guard Services.
- Cost Guard: Monitor LLM usage and expenses across teams with real-time dashboards and detailed logs. Set quotas and alerts to prevent budget overruns and facilitate internal cost allocation.
- Safe Guard: Automatically detect and handle sensitive data, toxic content, and forbidden terms in LLM inputs and outputs. Actions include redaction, blocking, and administrator notifications to maintain data privacy and compliance.
- Quality Guard: Evaluate LLM performance using standardized metrics and side-by-side comparisons. Ensure your AI applications deliver accurate, consistent, and unbiased results from development to production.
Seamless Integration and Automation
The Recon-Dataiku partnership enables organizations to embed security testing directly into their AI development workflows through Dataiku's LLM Mesh:
- Automated Red Teaming for LLM Mesh: Systematically test all LLMs deployed through Dataiku's centralized platform, ensuring consistent security standards across your entire AI portfolio.
- Unified Security Monitoring: Generate comprehensive security assessments that combine Recon's vulnerability discovery with runtime protection metrics from Guard Services.
- API-Driven Integration: Leverage Recon's REST API to integrate security testing into existing Dataiku Flows and data pipelines, enabling automated vulnerability assessment as part of your data science workflows.
For technical walkthrough of how to submit Red Teaming scans of Dataiku hosted LLMs, click Link to Dev Guide/Technical Blog
Advantages of Red Teaming Dataiku-hosted LLMs
The Dataiku-Protect AI partnership offers unique advantages for organizations deploying LLMs at scale. Dataiku's LLM Mesh provides a centralized platform for managing multiple LLM deployments, making it ideal for comprehensive security testing across diverse AI applications.
Through seamless API integration, Recon can automatically test LLM endpoints within Dataiku Flows and data pipelines, ensuring security assessments are embedded directly into existing data science workflows.
The combination of Dataiku's LLM Mesh and LLM Guard Services with Recon's automated red teaming capabilities enables organizations to maintain consistent security standards across their entire AI portfolio while leveraging Dataiku's robust governance, monitoring, and deployment features.
Ready to secure your AI applications? Start with automated red teaming using Recon to discover vulnerabilities before production deployment.
For complete protection, combine proactive testing with Dataiku Guard Services for runtime monitoring, cost control, and quality assurance.
