Use Prompt Flow For Llm Workflow Testing And Evaluation

---
name: "Use Prompt Flow for LLM workflow testing and evaluation"
slug: "use-prompt-flow-for-llm-workflow-testing-and-evaluation"
description: "Build a Prompt Flow graph, run interactive and batch tests, inspect traces and evaluation metrics, and promote only reviewed LLM workflow versions."
github_stars: 11142
verification: "security_reviewed"
source: "https://github.com/microsoft/promptflow"
author: "Microsoft"
publisher_type: "organization"
category: "Monitoring & Alerts"
framework: "Multi-Framework"
tool_ecosystem:
  github_repo: "microsoft/promptflow"
  github_stars: 11142
---

# Use Prompt Flow for LLM workflow testing and evaluation

Build a Prompt Flow graph, run interactive and batch tests, inspect traces and evaluation metrics, and promote only reviewed LLM workflow versions.

## Prerequisites

Prompt Flow CLI, Python 3.9 through 3.11, promptflow and promptflow-tools packages, configured OpenAI or Azure OpenAI connection, optional VS Code extension.

## Installation

Use the upstream install or setup path that matches your environment:
- pip install promptflow promptflow-tools

Requirements and caveats from upstream:
- [![Python package](https://img.shields.io/pypi/v/promptflow)](https://pypi.org/project/promptflow/)
- [![Python](https://img.shields.io/pypi/pyversions/promptflow.svg?maxAge=2592000)](https://pypi.python.org/pypi/promptflow/)
- Create executable [flows](https://microsoft.github.io/promptflow/concepts/concept-flows.html) that link LLMs, prompts, Python code and other [tools](https://microsoft.github.io/promptflow/concepts/concept-tools.html)...

Basic usage or getting-started notes:
- To get started quickly, you can use a pre-built development environment. **Click the button below** to open the repo in GitHub Codespaces, and then continue the readme!
- [![Open in GitHub Codespaces](https://github.com/codespaces/badge.svg)](https://codespaces.new/microsoft/promptflow?quickstart=1)
- If you want to get started in your local environment, first install the packages:

- Source: https://github.com/microsoft/promptflow
- Extracted from upstream docs: https://raw.githubusercontent.com/microsoft/promptflow/HEAD/README.md

## Documentation

- https://microsoft.github.io/promptflow/index.html

## Source

- [Agent Skill Exchange](https://agentskillexchange.com/skills/use-prompt-flow-for-llm-workflow-testing-and-evaluation/)