Skip to content
Back to skills

Audit Validator Independence

ASecurity

Audit whether a validator, benchmark, sandbox, or test can pass by construction because it embeds the same assumptions as the theory it claims to validate. Build a claim×validator-assumption matrix and demand at least one non-circular failure channel.

  • 499 stars
  • 0 votes
  • 0 copies
  • 0 views
  • Added September 24, 2026
researchnode

Security analysis

A100/100

Scanned September 24, 2026

npx -y skills add yogsoth-ai/de-anthropocentric-research-engine --skill audit-validator-independence --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Audit Validator Independence?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Audit Validator Independence
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/yogsoth-ai-audit-validator-independence/badge)](https://www.skillsdirectory.com/skills/yogsoth-ai-audit-validator-independence)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

Download with Pro
SKILL.md
---
name: audit-validator-independence
description: "Audit whether a validator, benchmark, sandbox, or test can pass by construction because it embeds the same assumptions as the theory it claims to validate. Build a claim×validator-assumption matrix and demand at least one non-circular failure channel."
---

# audit-validator-independence
## Purpose
Detect validators that pass by construction because they copy the target theory's assumptions.
## Input contract
```yaml
mode_contracts:
  validator: &validator_audit_input
    required: [target_claim, validator, validator_artifacts]
    optional: [data_generation, metric, oracle, acceptance_rule]
    constraints: [validator_assumptions_and_target_assumptions_must_be_separately_listed]
  benchmark: *validator_audit_input
  sandbox: *validator_audit_input
  simulation: *validator_audit_input
```
## Execution protocol
Do not perform called SOP operations inline; each loaded SOP owns its contract and thresholds.

1. You MUST load skill `enumerate-validator-assumptions` to enumerate embedded validator assumptions.
2. You MUST load skill `build-noncircularity-matrix` to cross-tabulate target and validator assumptions.
3. You MUST load skill `detect-pass-by-construction` to detect copied assumptions. You MUST load skill `design-falsification-test` to design an independent failure channel.
Deviation: if no non-circular channel is feasible, return blocked validation rather than a pass.
## Output contract
```yaml
mode_contracts:
  validator: &validator_audit_output
    produces: [noncircularity_matrix, red_cell_actions, validator_verdict, adversarial_ground_truth_set]
    delta_fields: [findings, evidence_updates, uncertainties, decisions, open_questions]
  benchmark: *validator_audit_output
  sandbox: *validator_audit_output
  simulation: *validator_audit_output
```
## Thresholds and quality gates
- At least one validator path must be independent of the target's defining assumptions.
- Shared or derived-from-target dependencies must be explicit in the matrix.
## Failure and counterexamples
Pass-by-construction is a finding, not evidence of corroboration. Unknown dependencies remain unresolved.
## Provenance map
- resolved: circular-validation-audit
## Preserved source criteria ledger
| source | source line | kind | source criterion |
|---|---:|---|---|
| v4 architecture | node desc | textual | Build claim-validator assumption matrix and require a non-circular failure channel. |
## Context checkpoint / Delta notes
Append assumptions, matrix cells, circularity findings, and proposed independent test.

## Mode branches
- `validator`: inspect validator implementation assumptions.
- `benchmark`: inspect benchmark construction and metric assumptions.
- `sandbox`: inspect environment/oracle assumptions.
- `simulation`: inspect simulator and initialization assumptions.

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

Comments

Loading comments…