Skip to content
Back to skills

Agreement Line Fit

ASecurity

Fit the probit-space ID-to-OOD agreement line and report agreement-on-the-line diagnostics without OOD labels.

  • 247 stars
  • 0 votes
  • 0 copies
  • 0 views
  • Added September 9, 2026
testingpython

Security analysis

A100/100

Scanned September 9, 2026

npx -y skills add VectorSpaceLab/AREX-Skill --skill agreement_line_fit --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Agreement Line Fit?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Agreement Line Fit
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/vectorspacelab-agreement-line-fit/badge)](https://www.skillsdirectory.com/skills/vectorspacelab-agreement-line-fit)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

SKILL.md
---
name: agreement_line_fit
description: Fit the probit-space ID-to-OOD agreement line and report agreement-on-the-line diagnostics without OOD labels.
---

# Agreement Line Fit

Use this skill when pairwise agreement statistics are available and you need to check whether agreement-on-the-line plausibly holds.

## Inputs

- JSON statistics from `agreement_statistics`.
- Optional R² threshold.

## Outputs

- Slope, intercept, R², residual summaries, and `on_line` decision.

## Workflow

1. Align pairwise ID/OOD agreement probit values.
2. Fit ordinary least squares in probit space.
3. Compute R² and residual summaries.
4. Treat low R² as a reliability warning for downstream OOD accuracy estimates.

## Validation

Run `python tests/test_agreement_line_fit.py` from this skill directory.

## Limitations

The line diagnostic is unlabeled; it cannot prove true OOD accuracy without a separate evaluation harness.

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

Comments

Loading comments…