AcousticToxicityDetector<T> |
Detects toxic/aggressive speech patterns directly from acoustic features without transcription. |
AdversarialBenchmark<T> |
Benchmark for evaluating adversarial robustness of the safety pipeline against evasion attacks. |
AdversarialImageEvaluator<T> |
Detects adversarial perturbations in images via the learnable feature-squeezing ensemble described by Xu et al. |
AdversarialRobustnessEvaluator<T> |
Evaluates text inputs for adversarial perturbations designed to evade safety filters. |
AudioSafetyResult |
Detailed result from audio safety evaluation. |
AudioSealWatermarker<T> |
Localized keyed audio watermark: the spread-spectrum mark of AudioWatermarker, detected segment by segment so it reports which parts of a recording carry the mark. |
AudioWatermarker<T> |
Keyed spread-spectrum audio watermark: a key-derived +/-1 sequence added to the 1-7 kHz block-DCT coefficients at a level that follows each frame’s loudness, detected by correlation. |
BiasBenchmark<T> |
Benchmark for evaluating bias and fairness detection accuracy across demographic groups. |
BiasReport |
Detailed report from bias and fairness evaluation. |
ClaimVerdict |
Verdict for a single claim in a hallucination check. |
ClassifierToxicityDetector<T> |
Detects toxic text using a trained linear classifier over character n-gram features. |
ComplianceReport |
Detailed report from regulatory compliance evaluation. |
ComplianceViolation |
A specific compliance violation found during evaluation. |
CompositeGuardrail<T> |
Chains multiple guardrails into a single composite guardrail that runs all child guardrails in sequence and aggregates their findings. |
CompositePIIDetector<T> |
Combines multiple PII detection strategies into a unified detector with deduplication. |
ComprehensiveSafetyBenchmark<T> |
Comprehensive safety benchmark that aggregates all individual benchmarks into a single suite. |
ConsistencyDeepfakeDetector<T> |
Detects deepfake/AI-generated images by checking spatial consistency and natural image statistics violations. |
ContextAwarePIIDetector<T> |
Context-aware PII detector that reduces false positives by analyzing surrounding text. |
CopyrightMatch |
A match between generated text and potentially copyrighted content. |
CopyrightResult |
Detailed result from copyright and memorization detection. |
CrossModalConsistencyChecker<T> |
Checks consistency between different modalities (text, image, audio) to detect misaligned or manipulated multimodal content. |
CustomRule |
A custom safety rule that evaluates text and optionally returns a finding. |
CustomRuleGuardrail<T> |
User-defined guardrail that applies custom validation rules to text content. |
DeepfakeResult |
Detailed result from deepfake and AI-generated image detection. |
DemographicParityChecker<T> |
Checks for demographic parity violations by detecting differential treatment of demographic groups in model outputs. |
EUAIActComplianceChecker<T> |
Checks compliance with the EU AI Act requirements for AI systems. |
EmbeddingCopyrightDetector<T> |
Detects potential copyright violations using embedding-based semantic similarity to known copyrighted works. |
EmbeddingToxicityDetector<T> |
Detects toxic text using embedding-based cosine similarity to known toxic concept vectors. |
EnsembleImageSafetyClassifier<T> |
Combines multiple image safety classifiers into a weighted ensemble for robust detection. |
EnsembleJailbreakDetector<T> |
Combines multiple jailbreak detection strategies into a robust ensemble. |
EnsembleToxicityDetector<T> |
Combines multiple toxicity detectors into a weighted ensemble for improved accuracy. |
EntailmentHallucinationDetector<T> |
Detects hallucinations using textual entailment (NLI) principles: checking whether reference documents entail (support) each claim in the model output. |
EqualizedOddsChecker<T> |
Checks for equalized odds violations by analyzing whether model quality or effort varies across demographic groups mentioned in the text. |
FrameSamplingVideoModerator<T> |
Video content moderator built on Temporal Segment Networks: sparse segment-wise sampling with a segmental consensus over snippet scores, producing one video-level verdict per category. |
FrequencyDeepfakeDetector<T> |
Detects AI-generated/deepfake images by analyzing frequency domain artifacts. |
FrequencyImageWatermarker<T> |
Keyed Fourier-ring image watermarker: adds a key-derived pattern to a ring-shaped (annular) band of the image’s Fourier spectrum and detects it by correlation. |
GDPRComplianceChecker<T> |
Checks compliance with GDPR requirements related to AI and personal data processing. |
GradientJailbreakDetector<T> |
Detects gradient-based adversarial jailbreak attacks by analyzing token-level anomalies in the input text. |
GroupBiasResult |
Bias analysis result for a specific demographic group. |
GuardrailResult |
Result from guardrail evaluation. |
GuardrailRule |
Defines a declarative guardrail rule with a condition expression and corresponding action. |
HallucinationBenchmark<T> |
Benchmark for evaluating hallucination and factual grounding detection accuracy. |
HallucinationResult |
Detailed result from hallucination detection with per-claim verdicts. |
ImageSafetyResult |
Detailed result from image safety classification. |
ImageWatermarker<T> |
The safety pipeline’s image watermarker: the keyed spread-spectrum DCT watermark of InvisibleImageWatermarker with a configurable reporting threshold. |
InputGuardrail<T> |
Input guardrail that validates user input before it reaches the model. |
IntersectionalBiasDetector<T> |
Detects intersectional bias — bias that uniquely affects individuals at the intersection of multiple demographic identities (e.g., Black women, elderly Asian men). |
InvisibleImageWatermarker<T> |
Keyed spread-spectrum image watermarker that hides a pseudo-random +/-1 sequence in the image’s mid- and high-frequency block DCT coefficients and detects it by correlation. |
JailbreakBenchmark<T> |
Benchmark for evaluating jailbreak and prompt injection detection accuracy. |
KnowledgeTripletHallucinationDetector<T> |
Detects hallucinations by extracting (subject, predicate, object) knowledge triplets and verifying them against reference documents. |
LexicalWatermarker<T> |
Keyed synonym-substitution text watermark: at every word from a synonym group, the key and the preceding word choose which synonym the text uses. |
MaskingVoiceProtector<T> |
Protects voice recordings against cloning using psychoacoustic masking — adding noise that is hidden beneath audible content but disrupts speaker embedding extraction. |
MultimodalGuardrail<T> |
Unified guardrail for vision-language models (VLMs) and multimodal AI systems that validates both text and image content together. |
MultimodalSafetyResult |
Detailed result from multimodal safety evaluation. |
MultimodalVideoModerator<T> |
Comprehensive video moderator that combines frame-level content classification, temporal deepfake detection, and optional audio track analysis. |
NERPIIDetector<T> |
Detects PII using Named Entity Recognition (NER) heuristics based on contextual patterns. |
NgramCopyrightDetector<T> |
Detects potential copyright violations by measuring n-gram overlap with known copyrighted works. |
OutputGuardrail<T> |
Output guardrail that validates model output before it reaches the user. |
PIIBenchmark<T> |
Benchmark for evaluating PII (Personally Identifiable Information) detection accuracy. |
PIIEntity |
Represents a detected PII entity in text. |
PIIResult |
Detailed result from PII detection with detected entities and redacted text. |
PatternJailbreakDetector<T> |
Pattern-based jailbreak and prompt injection detector. |
PerplexityMemorizationDetector<T> |
Detects potential training data memorization by estimating text perplexity. |
PerturbationVoiceProtector<T> |
Protects voice recordings against cloning by adding imperceptible adversarial perturbations. |
ProvenanceDeepfakeDetector<T> |
Detects deepfake/AI-generated images by analyzing provenance signals: compression artifacts, statistical fingerprints, and embedded watermark traces. |
ReferenceBasedHallucinationDetector<T> |
Detects hallucinations by comparing model output against provided reference documents. |
RegexPIIDetector<T> |
Regex-based PII (Personally Identifiable Information) detector for common PII patterns. |
RepresentationalBiasDetector<T> |
Detects representational bias by analyzing whether demographic groups are underrepresented, overrepresented, or systematically associated with specific roles/contexts in text. |
RuleBasedToxicityDetector<T> |
Rule-based toxicity detector using pattern matching for harmful content detection. |
SOC2ComplianceChecker<T> |
Checks compliance with SOC 2 requirements for AI system security and availability. |
SafetyBenchmarkCase |
A single test case for the safety benchmark. |
SafetyBenchmarkCategoryResult |
Per-category benchmark results. |
SafetyBenchmarkReport |
Comprehensive report from running all safety benchmarks. |
SafetyBenchmarkResult |
Results from running a safety benchmark. |
SafetyBenchmarkRunner<T> |
Runs safety benchmarks against a configured safety pipeline to measure detection performance. |
SafetyFinding |
Represents a single safety finding from a safety module evaluation. |
SafetyPipeline<T> |
Composable safety pipeline that runs multiple safety modules and aggregates their findings. |
SafetyReport |
Unified safety report aggregating findings from all safety modules in the pipeline. |
SamplingWatermarker<T> |
The green-list language-model watermark of Kirchenbauer et al. |
SceneGraphSafetyClassifier<T> |
Scene graph-based image safety classifier that analyzes spatial relationships between detected entities to identify unsafe content configurations. |
SelfConsistencyHallucinationDetector<T> |
Detects hallucinations by checking internal consistency of claims within the text. |
SemanticJailbreakDetector<T> |
Detects jailbreak attempts using semantic embedding similarity to known attack patterns. |
SpectralAudioWatermarker<T> |
Keyed patchwork audio watermark: the key splits each frame’s 0.5-6 kHz block-DCT coefficients into two halves, raises the magnitudes of one and lowers those of the other, and detection tests the log-magnitude difference. |
StegaStampWatermarker<T> |
StegaStamp: a learned image watermark. |
StereotypeDetector<T> |
Detects stereotypical associations between demographic groups and attributes in text. |
SyntacticWatermarker<T> |
Keyed form-transformation text watermark: at every negation or pronoun-auxiliary pair that can be written either in full or contracted (“do not” / “don’t”, “they are” / “they’re”), the key and the preceding word choose the form. |
SynthIdImageWatermarker<T> |
A SynthID-Image-style post-hoc watermark. |
TemporalConsistencyDetector<T> |
Detects deepfake videos by analyzing temporal consistency between consecutive frames. |
TextImageAlignmentChecker<T> |
Checks whether an image matches its caption, to catch unsafe images passed off under a safe description. |
TextWatermarker<T> |
The safety pipeline’s text watermarker: the green-list watermark of SamplingWatermarker (Kirchenbauer et al. |
TopicRestrictionGuardrail<T> |
Guardrail that restricts conversation to approved topics using keyword and pattern matching. |
ToxicSpan |
A span of text identified as toxic. |
ToxicityBenchmark<T> |
Benchmark for evaluating toxicity detection accuracy across hate speech, threats, and harassment. |
ToxicityResult |
Detailed result from toxicity detection with per-category scores and spans. |
TranscriptionToxicityDetector<T> |
Detects toxic content in audio by analyzing acoustic features indicative of aggressive speech. |
TreeRingWatermarker<T> |
Tree-Ring watermarking for diffusion models: a keyed ring pattern written into the Fourier transform of the initial noise, which the sampler then turns into an image, detected by inverting the sampler back to noise. |
ViTImageSafetyClassifier<T> |
Patch-statistics image safety classifier: hand-set colour and edge rules evaluated per image patch and pooled with fixed similarity weights. |
VideoSafetyResult |
Detailed result from video safety evaluation with per-frame annotations. |
VoiceprintDeepfakeDetector<T> |
Detects deepfake audio by analyzing speaker voiceprint consistency throughout the recording. |
WatermarkBenchmark<T> |
Benchmark for evaluating watermark detection accuracy across text watermarking techniques. |
WatermarkDecision |
A calibrated three-state decision on one image, with the evidence behind it. |
WatermarkDeepfakeDetector<T> |
Detects AI-generated audio by looking for the presence or absence of known watermark patterns (e.g., AudioSeal-style localized watermarks). |
WatermarkDetector<T> |
Composite text watermark detector: runs the green-list, synonym and contraction detectors of one key and reports the strongest evidence, corrected for having run three tests. |
WatermarkKey |
The secret key of a keyed watermark, and the pseudo-random values every keyed watermarker derives from it. |
WatermarkResult |
Detailed result from watermark detection across any modality. |
WatermarkVoiceProtector<T> |
Protects voice recordings by embedding imperceptible watermarks that survive voice cloning and can be detected in cloned output. |
WatermarkedCausalLanguageModel<T> |
A language model whose next-token logits carry a generation-time watermark: the inner model’s logits plus the watermarker’s green-list bias for the current context. |
WatermarkedIncrementalCausalLanguageModel<T> |
The incremental (KV-cached) form of WatermarkedCausalLanguageModel: it tracks the context the inner model has seen, so each appended token’s logits are biased for the right green list. |