Minifetch is a pay-per-URL SEO toolkit of composable extraction primitives for AI agents and automation pipelines. Run them as a full audit or call one at a time for a fraction of the price — and a fraction of the tokens. No subscription. This documentation covers the main endpoints available for developers. It also covers details about accessing the Minifetch API as well as example data. All API endpoints return responses in JSON format.
The Minifetch API Client has a Quick Start for Javascript or TypeScript if you're looking to add it to your project quickly.
Full API docs are also available for AI agents at llms.txt →
Minifetch is pay-per-fetch. No setup fee, no monthly fee, no charges for blocked or errored pages. Price per fetch are listed on each API endpoint below. First, pick your payment method:
Sign up on the dashboard to get free starter credits worth 25 audits, then top up with your credit card later for as little as $2.
Pay directly from your crypto wallet. Just load your wallet with USDC on Base or Solana and you're ready. No "gas token" (ETH or SOL) required. No Minifetch account setup required.
Then click whichever access method fits your setup:
Visit the Minifetch homepage or hit any API endpoint URL directly using your browser's address bar. The default on the homepage is the full technical SEO audit. Great for trying out the service. If you want full API access, try the other options below.
Sign up, create an API key from the dashboard, and query endpoints from your CLI:
curl "https://minifetch.com/api/v1/run/seo-page-audit?url=https://anthropic.com" \
-H "Authorization: Bearer [your_api_key]"The minifetch-api client is an NPM package purpose-built for Javascript or TypeScript. The simplest way to integrate Minifetch into a Node.js app. Works with both API keys and USDC stablecoin. Recommended for agents and agent builders.
For agents that need to pay at runtime without human sign-up. If you're building an agent yourself, the Minifetch API client above is usually the better starting point.
Coinbase Payments MCP gives AI assistants like Claude Desktop a built-in wallet to discover and pay for x402 services with no code. One command, email sign-in, no private key.
npx @coinbase/payments-mcpThe installer configures your MCP client (Claude Desktop, Claude Code, Gemini CLI, etc). Once it's funded, ask your assistant to search the x402 Bazaar for "Minifetch" — every Minifetch endpoint shares that name and comes back together in one search. For more details point your AI assistant at the SEO Page Audit skill file.
Agentic Wallets
(awal) is Coinbase's wallet infrastructure for autonomous agents: non-custodial, keys isolated,
with programmable spending limits and gasless USDC trades on Base.
Recommended for programmatic and agent-to-agent usage.
npx awal
Once funded, your agent can call Minifetch with any x402-compatible client
(e.g. @x402/fetch) or skip the client entirely by adding awal's
pay-for-service skill.
npx skills add coinbase/agentic-wallet-skillsThe Minifetch API client will handle this for you. All API requests will be made to:
https://minifetch.com
Free
Call this endpoint before the paid endpoints.
Free endpoint that checks if a URL is allowed to be fetched by Minifetch according to the website's robots.txt file. Returns whether the URL is fetchable and the crawl delay Minifetch will observe (defaults to 1 second so Minifetch never hammers your server or slows it down for your real users). Call this before making requests to the paid endpoints. If the target URL is blocked and the site is yours or to set a custom crawl delay, read the tutorial: How To Allow Minifetch to Fetch Your Pages.
| Parameter | Type | Required | Description |
|---|---|---|---|
| url | string | Yes | The target URL to check against robots.txt |
GET https://minifetch.com/api/v1/free/preflight/url-check?url=https://example.com{
"success": true,
"results": [
{
"data": {
"url": "https://example.com",
"allowed": true,
"message": "robots.txt not found, defaulting to allowed",
"crawlDelay": 1
}
}
]
}$0.01
Technical SEO Page Audits, SEO Research, Pre-publish Page Checks, Post-Migration Site Verification, Agent-Orchestrated Site Monitoring
Runs a full technical SEO page audit on your URL. Verify redirects, headers, missing or conflicting canonicals, JSON-LD, indexability and more. Composes our /preflight + /url-metadata + /url-links endpoint data into a structured pass/ warn/ fail report. No black-box scoring; just deterministic, composable signal you can act on or pipe into an agent. Audit rules are documented in the audit results UI and in the audit skill file.
| Parameter | Type | Required | Description |
|---|---|---|---|
| url | string | Yes | The target URL to run the audit on |
GET https://minifetch.com/api/v1/run/seo-page-audit?url=https://example.com$0.002
SEO Research & Competitive Analysis, Content Indexing & Link Analysis, AI Agents & Automation Pipelines
Extracts rich structured metadata from your URL: favicons, title, description, canonical, SEO-related meta tags, Open Graph and Twitter Card tags, JSON-LD and more. Every field maps directly to a ranking signal or competitive intelligence data point. Set verbosity option to full for more fields: redirect chain, relevant response headers, performance metrics, headings, images and every meta tag found on the page.
| Parameter | Type | Required | Description |
|---|---|---|---|
| url | string | Yes | The target URL from which to extract metadata |
| verbosity | string | No | Defaults to "standard". Set to "full" for detailed larger response. |
| includeResponseBody | boolean | No | If set to true, includes the full HTML response body as string in result. |
GET https://minifetch.com/api/v1/extract/url-metadata?url=https://example.com$0.002
SEO Research & Competitive Analysis, Content Indexing & Link Analysis, Sitemap Building & Crawl Planning
Fetches and extracts all links from your URL categorized by type (internal/external/anchor).
Each link includes anchor text, rel attributes (nofollow, sponsored, ugc, etc.),
title, and target, plus image detection.
Summary stats include the most-linked-to internal pages (with anchor text variants used for each)
and top external domains by link count.
| Parameter | Type | Required | Description |
|---|---|---|---|
| url | string | Yes | The target URL from which to extract links |
GET https://minifetch.com/api/v1/extract/url-links?url=https://anthropic.com$0.002
Branding & Identity, Generative Engine Optimization (GEO), Content Indexing & Link Analysis, AI Agents & Automation Pipelines
For checking how your web page unfurls when shared: Extracts all fields for the lightweight cards that represent your page on social platforms, chat apps, and AI.
| Parameter | Type | Required | Description |
|---|---|---|---|
| url | string | Yes | The target URL from which to extract the preview |
GET https://minifetch.com/api/v1/extract/url-preview?url=https://github.com$0.002
Answer Engine Optimization (AEO), Generative Engine Optimization (GEO), Content Indexing & Link Analysis
For site owners auditing AI readability: returns the clean markdown an LLM extracts from your page after nav, ads, and scripts are stripped. See what survives for AEO and AI answer engines.
| Parameter | Type | Required | Description |
|---|---|---|---|
| url | string | Yes | The target URL from which to extract content |
| includeMediaUrls | boolean | No | If set to "true", includes image and video URLs in the result |
GET https://minifetch.com/api/v1/extract/url-content?url=https://apnews.com/article/time-person-of-year-2025-77ec65c6792bc99ec2ce1919c5f421ea&includeMediaUrls=trueMinifetch.com is the hosted version of a free and open-source npm package called url-metadata that has been serving the NPM community for 10+ years. During that time some users expressed a preference for a hosted service for various reasons, mostly technical hurdles with coding or accidentally triggering blocks from websites when using the open-source package.
For direct integration with your codebase, consider:
minifetch-apiNEW — the official Minifetch API client for Javascript/ Typescript
npm install minifetch-api --save
url-metadata — the open-source npm package that powers Minifetch
npm install url-metadata --save
Both from the same creator with 4 Million+ downloads over 10 years.
Add them to your project with confidence.
Task-specific step-by-step guides for AI agents using the Minifetch API:
Minifetch implements several measures to ensure responsible and efficient operation:
These measures help us maintain an ethical scraping approach while providing reliable service.
Minifetch only extracts publicly available metadata and content from pages accessible without authentication and Javascript execution.
What Minifetch does NOT do:
What Minifetch does NOT do currently but may offer in the future as an add-on:
If you have questions or need assistance:
join our Discord server.
To leave feedback or join the bulk credits waitlist:
use our feedback form.
While you're at it, give us a follow on X.com (Twitter):
@minifetch