AICertify is a comprehensive open-source framework for evaluating AI systems against regulatory requirements and ethical standards. It provides a powerful set of tools for assessing AI applications, generating compliance reports, and identifying areas for improvement.
Note: AICertify is currently in beta stage (v0.7.0). The API may change between versions as we work toward a stable 1.0.0 release.
AICertify provides tools to:
- Create and manage AI application contracts
- Evaluate AI interactions against regulatory frameworks
- Generate compliance reports
- Identify potential risks and issues in AI systems
# Install from source
pip install -e .
The simplest way to get started with AICertify is to run the quickstart example:
python examples/quickstart.py
This example demonstrates:
- Creating a regulations set
- Selecting target regulations
- Creating AI applications
- Adding interactions to applications
- Evaluating applications against regulations
- Generating and viewing reports
- Application Management: Create and configure AI applications
- Regulation Sets: Select and manage regulatory frameworks
- Evaluation: Evaluate applications against regulations
- Reporting: Generate detailed compliance reports
AICertify uses Open Policy Agent (OPA) for policy definition and evaluation. Policies are organized in the following structure:
global/
: Globally applicable policiesindustry_specific/
: Industry-specific policiesinternational/
: Policies for international regulationscustom/
: Directory for user-defined policies
This project is licensed under the Apache License 2.0 - see the LICENSE file for details.