Minifetch is a hosted toolkit of web page extraction primitives. Run them as a full technical SEO audit or call one at a time for a fraction of the price — and a fraction of the tokens. No subscription. This documentation covers the main endpoints available for developers, details about accessing the Minifetch API as well as example data. All API endpoints return responses in JSON format.
Working in a regulated space? By default, every response's proxy block records the user agent and whether robots.txt was obeyed, so how the data was gathered is on the record, per request.
The Minifetch API Client has a Quick Start for Javascript or TypeScript if you're looking to add it to your project quickly.
Full API docs are also available for AI agents at llms.txt →
Minifetch is pay-per-fetch. No setup fee, no monthly fee, no charges for blocked or errored pages. Price per fetch are listed on each API endpoint below. First, pick your payment method:
Sign up on the dashboard to get free starter credits worth 25 audits, then top up with your credit card later for as little as $2.
Pay directly from your crypto wallet. Just load your wallet with USDC on Base or Solana and you're ready. No "gas token" (ETH or SOL) required. No Minifetch account setup required.
Then click whichever access method fits your setup:
Visit the Minifetch homepage or hit any API endpoint URL directly using your browser's address bar. The default on the homepage is the full technical SEO audit. Great for trying out the service. If you want full API access, try the other options below.
Sign up, create an API key from the dashboard, and query endpoints from your CLI:
curl "https://minifetch.com/api/v1/run/seo-page-audit?url=https://anthropic.com" \
-H "Authorization: Bearer [your_api_key]"The minifetch-api client is an NPM package purpose-built for Javascript or TypeScript. The simplest way to integrate Minifetch into a Node.js app. Works with both API keys and USDC stablecoin. Recommended for agents and agent builders.
For agents that need to pay at runtime without human sign-up. If you're building an agent yourself, the Minifetch API client above is usually the better starting point.
Coinbase Payments MCP gives AI assistants like Claude Desktop a built-in wallet to discover and pay for x402 services with no code. One command, email sign-in, no private key.
npx @coinbase/payments-mcpThe installer configures your MCP client (Claude Desktop, Claude Code, Gemini CLI, etc). Once it's funded, ask your assistant to search the x402 Bazaar for "Minifetch" — every Minifetch endpoint shares that name and comes back together in one search. For more details point your AI assistant at the SEO Page Audit skill file.
Agentic Wallets
(awal) is Coinbase's wallet infrastructure for autonomous agents: non-custodial, keys isolated,
with programmable spending limits and gasless USDC trades on Base.
Recommended for programmatic and agent-to-agent usage.
npx awal
Once funded, your agent can call Minifetch with any x402-compatible client
(e.g. @x402/fetch) or skip the client entirely by adding awal's
pay-for-service skill.
npx skills add coinbase/agentic-wallet-skillsThe Minifetch API client will handle this for you. All API requests will be made to:
https://minifetch.com
Free
Call this endpoint before the paid endpoints.
Free endpoint that checks if a URL is allowed to be fetched by Minifetch according
to the website's robots.txt file. Returns whether the URL is fetchable and the crawl
delay Minifetch will observe (defaults to 1 second so Minifetch never hammers your
server or slows it down for your real users).
Call this before making requests to the paid endpoints.
If the target URL is blocked and the site is yours or to set a custom crawl delay, read the tutorial:
How To Allow Minifetch to Fetch Your Pages.
Just edited your robots.txt or crawl-delay? Add &fresh=true to skip Minifetch's
24-hour robots.txt cache and confirm your change registered — the minifetchCache
object in the response shows whether the result was served from cache or freshly fetched.
| Parameter | Type | Required | Description |
|---|---|---|---|
| url | string | Yes | The target URL to check against robots.txt |
| fresh | boolean | No |
If true, bypasses Minifetch's 24-hour robots.txt cache and re-fetches
robots.txt for this check. Use it right after editing your robots.txt or crawl-delay
(or adding/removing a Minifetch block) to confirm the change took effect. The
minifetchCache object shows whether the result was served from cache
("hit": true) or freshly fetched ("hit": false).
|
GET https://minifetch.com/api/v1/free/preflight/url-check?url=https://example.comGET https://minifetch.com/api/v1/free/preflight/url-check?url=https://example.com&fresh=true{
"success": true,
"results": [
{
"data": {
"url": "https://example.com",
"allowed": true,
"message": "robots.txt not found, defaulting to allowed",
"crawlDelay": 1,
"proxy": {
"proxyType": "minifetch",
"userAgent": "minifetch/1.0 (+https://minifetch.com/site-owner-faq)"
},
"minifetchCache": {
"hit": false,
"cachedAt": "2026-08-16T18:22:10.000Z",
"expiresAt": "2026-08-17T18:22:10.000Z"
}
}
}
]
}$0.01
Technical SEO Page Audits, SEO Research, Pre-publish Page Checks, Site Migrations & Verification, Agent-Orchestrated Site Monitoring
Runs a full technical SEO page audit on your URL. Verify redirects, headers, missing or conflicting canonicals, JSON-LD, indexability and more. Composes our /preflight + /url-metadata + /url-links endpoint data into a structured pass/ warn/ fail report. No black-box scoring; just deterministic, composable signal you can act on or pipe into an agent. Audit rules are documented in the audit results UI and in the audit skill file.
| Parameter | Type | Required | Description |
|---|---|---|---|
| url | string | Yes | The target URL to run the audit on |
GET https://minifetch.com/api/v1/run/seo-page-audit?url=https://example.com$0.002
Metadata Extraction, SEO Research & Competitive Analysis, AI Agents & Automation Pipelines
Extracts rich structured metadata from your URL: favicons, title, description, canonical, meta tags, Open Graph and Twitter Card tags, JSON-LD, redirect chain, response headers, performance metrics, headings, images. Every field maps directly to a ranking signal or competitive intelligence data point. Returns everything by default; narrow response with the fields query param (pass atomic field names, ex: ?fields=title,description or the named groups: network,meta,og,twitter). Use omitEmpty=true query param to trim tokens for AI agents.
| Parameter | Type | Required | Description |
|---|---|---|---|
| url | string | Yes | The target URL from which to extract metadata |
| fields | string | No |
Comma-separated selection to narrow the response to only the fields you need:
atomic field names (e.g. title), named groups
(network, meta, og, twitter),
and/or meta:<name> for a specific page meta tag.
Returns all fields when omitted, blank, or null; an unknown field returns a 400.
|
| omitEmpty | boolean | No |
If true, drops empty fields (empty string, [], {})
from the response for token efficiency.
|
| includeResponseBody | boolean | No | If set to true, includes the full HTML response body as string in result. |
GET https://minifetch.com/api/v1/extract/url-metadata?url=https://example.comGET https://minifetch.com/api/v1/extract/url-metadata?url=https://example.com&fields=title,description,og&omitEmpty=true$0.002
Link Analysis, SEO Research & Competitive Analysis, Sitemap Building & Crawl Planning, Content Extraction
Fetches and extracts all links from your URL categorized by type (internal/external/anchor).
Each link includes anchor text, rel attributes (nofollow, sponsored, ugc, etc.),
title, and target, plus image detection.
Summary stats include the most-linked-to internal pages (with anchor text variants used for each)
and top external domains by link count.
| Parameter | Type | Required | Description |
|---|---|---|---|
| url | string | Yes | The target URL from which to extract links |
GET https://minifetch.com/api/v1/extract/url-links?url=https://anthropic.com$0.002
Branding & Identity, Generative Engine Optimization (GEO), Content Extraction, Link Analysis, AI Agents & Automation Pipelines
Extracts all fields used for a page's share previews: the lightweight cards that represent the page on social platforms, chat apps, and AI.
| Parameter | Type | Required | Description |
|---|---|---|---|
| url | string | Yes | The target URL from which to extract the preview |
GET https://minifetch.com/api/v1/extract/url-preview?url=https://github.com$0.002
Content Extraction, Answer Engine Optimization (AEO), Generative Engine Optimization (GEO), Link Analysis
For site owners auditing AI readability: returns the clean markdown an LLM extracts from your page after nav, ads, and scripts are stripped. See what survives for AEO and AI answer engines.
| Parameter | Type | Required | Description |
|---|---|---|---|
| url | string | Yes | The target URL from which to extract content |
| includeMediaUrls | boolean | No | If set to "true", includes image and video URLs in the result |
GET https://minifetch.com/api/v1/extract/url-content?url=https://apnews.com/article/time-person-of-year-2025-77ec65c6792bc99ec2ce1919c5f421ea&includeMediaUrls=trueMinifetch.com is the hosted version of a free and open-source npm package called url-metadata that has been serving the NPM community for 10+ years. During that time some users expressed a preference for a hosted service for various reasons, mostly technical hurdles with coding or accidentally triggering blocks from websites when using the open-source package.
For direct integration with your codebase, consider:
minifetch-apiNEW — the official Minifetch API client for Javascript/ Typescript
npm install minifetch-api --save
url-metadata — the open-source npm package that powers Minifetch
npm install url-metadata --save
Both from the same creator with 4 Million+ downloads over 10 years.
Add them to your project with confidence.
Task-specific step-by-step guides for AI agents using the Minifetch API:
Minifetch extracts publicly available metadata and content from pages reachable without authentication or JavaScript execution. By default it fetches as an identified user agent/ bot from a fixed IP and obeys robots.txt, including crawl-delay.
Every response carries a proxy block: the minifetch user agent we sent and whether robots.txt was obeyed on the fetch. Proof of how the fetch happened, not just a promise, for regulated use-cases where provenance matters.
Future add-ons:
Minifetch implements several measures to ensure responsible and efficient operation:
If you have questions or need assistance:
join our Discord server.
To leave feedback or join the bulk credits waitlist:
use our feedback form.
While you're at it, give us a follow on X.com (Twitter):
@minifetch