3.21.0
New Features
- [Alpha] System compliance test for evaluating AI system compliance with a custom policy
Improvements & Enhancements
- [Alpha] Improved custom output guardrail model training process, resulting in more performant guardrails
- [Alpha] Improved process for improving custom guardrails based on uploaded data and feedback
- Updated deep dive tables UI in DynamoEval for improved navigation, filtering, and searches
- Updated how domain field is used in data generation for custom policy creation
- Improved behavior generation reliability by making the feature async
Bug and Vulnerability Fixes
- DynamoEval UI fixes to ensure correct value rendering
Maintenance
- 4 DynamoEval tests (PII Inference, PII Reconstruction, ROUGE, BERTScore) are in maintenance mode and will be deprecated in June
Deprecations
- Deprecated sequence length hyperparameter for DynamoEval tests