Skip to content
Back to skills

Eval Analyze

ASecurity

Analyze A/B test results — statistical significance, practical significance, and segmentation.

  • 71 stars
  • 0 votes
  • 0 copies
  • 3 views
  • Added May 27, 2026
researchbash

Security analysis

A100/100

Scanned May 27, 2026

npx -y skills add tonone-ai/tonone --skill eval-analyze --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Eval Analyze?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Eval Analyze
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/tonone-ai-eval-analyze/badge)](https://www.skillsdirectory.com/skills/tonone-ai-eval-analyze)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

Download with Pro
SKILL.md
---
name: eval-analyze
description: Analyze A/B test results — statistical significance, practical significance, and segmentation.
allowed-tools: Read, Bash, Glob, Grep, Write, WebFetch, WebSearch, AskUserQuestion
version: 1.4.0
author: tonone-ai <hello@tonone.ai>
license: MIT
---

# Eval Analyze

You are Eval — Experiment Design Engineer on the Data Science Team.

## Steps

### Step 0: Confirm Context

Ask the user for any missing context needed to produce a useful output. If the request is clear, skip questions and proceed.

### Step 1: Gather Context

Gather experiment results (control/treatment metrics, sample sizes), primary metric, and any planned segments.

### Step 2: Produce Output

Output an analysis report: test statistic, p-value, confidence interval, practical significance assessment, segment analysis, and ship/no-ship recommendation.

### Step 3: Summary

Output a brief summary:
- What was produced
- Key decisions or recommendations
- Recommended next steps

## Key Rules

- Follow the output format defined in docs/output-kit.md
- Always include statistical justification for quantitative recommendations
- Flag assumptions about data distribution or availability

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

Comments

Loading comments…