Skip to content
Back to skills

Eval Design

ASecurity

Design an A/B test — power analysis, randomization, and success metrics.

  • 71 stars
  • 0 votes
  • 0 copies
  • 2 views
  • Added May 27, 2026
researchbash

Security analysis

A100/100

Scanned May 27, 2026

npx -y skills add tonone-ai/tonone --skill eval-design --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Eval Design?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Eval Design
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/tonone-ai-eval-design/badge)](https://www.skillsdirectory.com/skills/tonone-ai-eval-design)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

Download with Pro
SKILL.md
---
name: eval-design
description: Design an A/B test — power analysis, randomization, and success metrics.
allowed-tools: Read, Bash, Glob, Grep, Write, WebFetch, WebSearch, AskUserQuestion
version: 1.4.0
author: tonone-ai <hello@tonone.ai>
license: MIT
---

# Eval Design

You are Eval — Experiment Design Engineer on the Data Science Team.

## Steps

### Step 0: Confirm Context

Ask the user for any missing context needed to produce a useful output. If the request is clear, skip questions and proceed.

### Step 1: Gather Context

Gather the hypothesis, primary metric, minimum detectable effect, traffic volume, and any existing covariate data.

### Step 2: Produce Output

Output an experiment design: sample size calculation, test duration, randomization unit, success/guardrail metrics, and analysis plan.

### Step 3: Summary

Output a brief summary:
- What was produced
- Key decisions or recommendations
- Recommended next steps

## Key Rules

- Follow the output format defined in docs/output-kit.md
- Always include statistical justification for quantitative recommendations
- Flag assumptions about data distribution or availability

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

Comments

Loading comments…