Installs into .claude/skills of the current project.
Are you the author of Mmlu Recovery Harness?
Add the live security badge to your README. It updates with every re-scan.
[](https://www.skillsdirectory.com/skills/vectorspacelab-mmlu-recovery-harness)
---
name: mmlu_recovery_harness
description: Run a bounded MMLU proxy recovery using generated item, prompting, and scoring skills.
---
# mmlu_recovery_harness
Use this skill when a recovery or evaluation task needs the MMLU mechanism represented by this module. Do not use it as a substitute for a full model evaluation unless the run explicitly declares a reduced proxy target.
## Inputs
Inputs are JSON-compatible dictionaries following the module document contract. Required fields are validated by the script in `scripts/`.
## Outputs
Outputs are JSON-compatible dictionaries with normalized labels, prompts, scores, or recovery artifacts. Downstream modules should consume these outputs instead of parsing free-form text.
## Workflow
1. Read the paper profile and module plan to confirm the selected target.
2. Call the script or import the helper functions from `scripts/`.
3. Preserve the boundary between item construction, prompt construction, scoring, and recovery logging.
4. Run the validation command after changes: `python <distiller>/module-to-skill/scripts/validate_skill_tree.py <skill_dir> --run-tests`.
## Limitations
This skill captures the evaluation mechanism, not the full hosted GPT-3 runtime or the full private benchmark distribution. Soft-mode recovery must label reduced results as proxy evidence.
