Skip to content
Back to skills

Web Fetch

ASecurity

Fetch and extract clean content from URLs using Jina Reader API. Use when users need to read webpage content, extract article text, or fetch URL content for analysis. Triggers on "fetch this page", "read this URL", "extract content from", "get the content of", "what does this page say".

  • 1,689 stars
  • 0 votes
  • 0 copies
  • 4 views
  • Added June 3, 2026
developmentpythonbashapidocumentation

Works with

  • api

Security analysis

A100/100

Pro scans all 2 files and shows the line behind each finding

Scanned June 3, 2026

npx -y skills add Dicklesworthstone/pi_agent_rust --skill web-fetch --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Web Fetch?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Web Fetch
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/dicklesworthstone-web-fetch/badge)](https://www.skillsdirectory.com/skills/dicklesworthstone-web-fetch)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

Download with Pro
SKILL.md
---
name: web-fetch
description: Fetch and extract clean content from URLs using Jina Reader API. Use when users need to read webpage content, extract article text, or fetch URL content for analysis. Triggers on "fetch this page", "read this URL", "extract content from", "get the content of", "what does this page say".
---

# Web Fetch

## Overview

Extract clean, readable content from any URL using Jina Reader API. Returns raw JSON with title, content, and metadata optimized for LLM consumption.

## When to Use

- User wants to read or analyze webpage content
- Need to extract article text from a URL
- Fetching documentation or reference pages
- Converting web pages to clean text for processing

## Workflow

1. Identify the URL from user request
2. Validate URL format
3. Run the fetch script
4. Present extracted content to user

## Usage

```bash
# Basic fetch
uv run --script scripts/web_fetch.py --url "https://example.com"

# With custom timeout
uv run --script scripts/web_fetch.py \
  --url "https://example.com/article" \
  --timeout 60
```

## Parameters

| Parameter   | Default    | Description                           |
| ----------- | ---------- | ------------------------------------- |
| `--url`     | (required) | URL to fetch and extract content from |
| `--timeout` | 30         | Request timeout in seconds            |

## Output Contract

| Scenario    | stdout             | stderr             | exit code |
| ----------- | ------------------ | ------------------ | --------- |
| Success     | Raw JSON from Jina | (empty)            | 0         |
| Invalid URL | (empty)            | Error message      | 1         |
| Timeout     | (empty)            | Timeout error      | 1         |
| HTTP Error  | (empty)            | HTTP error details | 1         |

Success output contains:

- Page title and description
- Clean extracted content (markdown-formatted)
- URL and metadata
- Token usage information

## Prerequisites

- Uses Jina Reader API (no API key required)
- Requires `uv` for running PEP 723 scripts

## Examples

### Fetch a webpage

```bash
uv run --script scripts/web_fetch.py \
  --url "https://docs.python.org/3/whatsnew/3.12.html"
```

### Fetch with longer timeout for slow pages

```bash
uv run --script scripts/web_fetch.py \
  --url "https://example.com/large-article" \
  --timeout 60
```

Files in this skill

  • SKILL.md2.3 KB
  • scripts/web_fetch.py2.3 KB

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

Comments

Loading comments…