SimpleAudit

Owner of the digital solution

Simula Research Laboratory

Type

NGO/ Non Profit

Open alternatives

SimpleAudit supports commercial LLM APIs (Anthropic Claude, OpenAI GPT, xAI Grok) for generating audit probes and judging responses. These can be fully replaced with open alternatives requiring zero configuration changes: CLOSED COMPONENT → OPEN ALTERNATIVE: - Anthropic Claude API → Ollama (local) or HuggingFace Transformers - OpenAI GPT API → Ollama (local) or HuggingFace Transformers - xAI Grok API → Ollama (local) or HuggingFace Transformers REPLACEMENT EXAMPLE (single parameter change): # Using closed API: auditor = Auditor(target="...", provider="anthropic") # Using open alternative: auditor = Auditor(target="...", provider="ollama", model="llama3.2") # or auditor = Auditor(target="...", provider="huggingface", model="meta-llama/Llama-3.2-1B-Instruct") The provider abstraction layer allows switching between closed and open providers with a single parameter change. No code modifications, configuration overhauls, or architectural changes are required. All 32 built-in test scenarios work identically regardless of provider choice. Users can run the entire solution locally with Ollama or HuggingFace without any API keys or external service dependencies.

Collects or uses non-PII data and/or content

Yes

Mechanism for extracting or importing non-PII data

Privacy and Law Compliance

Best practices

PEP8, Principles for Digital Development, Test Driven Development, OWASP, AI RMF 1.0, MITRE ATLAS

Open standards

Content

Content is collected but NOT stored and NOT distributed.

Types of content

Mechanisms to handle inappropriate and illegal content

SimpleAudit is an AI safety auditing library, not a content platform. It generates synthetic adversarial prompts to test AI systems for safety vulnerabilities. The tool does not host, distribute, or enable sharing of user-generated content. SAFEGUARDS IMPLEMENTED: 1. PURPOSE-BUILT FOR SAFETY TESTING The tool's explicit purpose is to identify and prevent harmful AI behaviors, not to generate or distribute harmful content. 2. RESPONSIBLE USE POLICY The Code of Conduct explicitly prohibits: - Using SimpleAudit to develop attacks against unauthorized systems - Creating scenarios designed to cause real-world harm - Sharing attack techniques without responsible disclosure Link: https://github.com/kelkalot/simpleaudit/blob/main/CODE_OF_CONDUCT.md 3. NO WEAPONIZED PROMPTS Built-in scenarios test for safety boundaries without providing actual attack payloads or illegal content. All 32 scenarios are publicly auditable in the source code. Link: https://github.com/kelkalot/simpleaudit/tree/main/simpleaudit/scenarios 4. LOCAL-ONLY OPERATION No content is uploaded to or distributed through the SimpleAudit infrastructure (none exists). All processing occurs on the user's local systems. 5. USER GUIDANCE Security policy advises users to: - Review audit results for sensitive content before sharing - Redact unexpected content from reports - Follow organizational data classification policies Link: https://github.com/kelkalot/simpleaudit/blob/main/SECURITY.md

Allows user interaction

Yes

Mechanisms to protect users and contributors

POLICIES FOR PROTECTION: 1. CODE OF CONDUCT (Contributor Covenant v2.0) The project maintains a comprehensive Code of Conduct that: - Prohibits harassment, discrimination, trolling, and personal attacks - Prohibits publishing others' private information without permission - Defines clear standards for acceptable community behavior - Applies to all community spaces (GitHub issues, PRs, discussions) Link: https://github.com/kelkalot/simpleaudit/blob/main/CODE_OF_CONDUCT.md 2. ENFORCEMENT GUIDELINES The Code of Conduct includes graduated enforcement: - Correction: Private written warning for minor issues - Warning: Formal warning with consequences for continued behavior - Temporary Ban: Suspension from community interaction - Permanent Ban: Permanent removal for severe/repeated violations 3. REPORTING MECHANISM Harassment incidents can be reported to project maintainers via: - GitHub Issues (for public concerns) - Direct contact through maintainers' affiliated organizations (Simula Research Laboratory, Norwegian Directorate of Health) for private reporting 4. MAINTAINER RESPONSIBILITY Community leaders are obligated to: - Respect privacy and security of reporters - Take appropriate corrective action - Remove inappropriate content (comments, commits, issues) UNDERAGE USER SAFETY: SimpleAudit is a developer tool/library intended for professional AI safety testing, not a consumer application. The primary audience is software developers and AI/ML engineers. Safeguards in place: - No user accounts or profiles are created - No social features or direct messaging between users - No content sharing platform that could expose minors to harmful content - GitHub's own Terms of Service (age 13+) govern contributor interactions - The tool itself processes only synthetic test data, not user-generated content The Code of Conduct's anti-harassment provisions apply equally to protect any community member regardless of age.