When you use this website you are agreeing to the following Terms of Service, where you are the "user" and we are the "website". If you do not agree to these terms, you may not use the website or API endpoints. The following list contains the terms of this agreement:
Website Access, Robots.txt Compliance, and Proxy Routing. Minifetch can reach a target URL in two ways:
Our URL check feature reports robots.txt permissions for a URL. It does not guarantee that data can be retrieved. Websites may limit or block access through robots.txt, rate limiting, IP blocking, bot detection, or other access controls.
We do not charge for requests that robots.txt blocks on the Minifetch route. We also do not charge for requests that fail with an upstream error, such as a 403 or another error status from the target URL. A request that receives a successful response from the target is charged, even if the returned content is incomplete. Examples include truncated pages, partially rendered pages, and interstitial or challenge pages served in place of the real content.
By using this service, you acknowledge these limitations and agree that no refunds will be issued for incomplete or truncated data, or interstitial or challenge pages retrieved.
User Responsibilities. You agree to use this service only for lawful purposes and in accordance with these Terms. You shall not use our service to: (1) attempt to access password-protected, authentication-required, or otherwise non-public websites; (2) retrieve data for purposes that violate applicable laws or regulations; (3) conduct activities that could reasonably be expected to adversely impact the availability of our service to other users; or (4) bypass or attempt to bypass our robots.txt compliance mechanisms. You acknowledge that our service is designed for accessing publicly available data.
Service Limitations. Our service is designed exclusively for extracting publicly available data. To protect both users and website owners, we maintain strict operational boundaries:
Minifetch offers two ways to fetch a page: the native Minifetch proxy or a rotating external proxy. The native Minifetch proxy is identified, respects robots.txt and is cheapest. The external proxy reaches pages the native one can't. You choose per fetch, by choosing the API route for your use-case. Built to be orchestrated by agents and humans who want maximal control.
| Native Minifetch proxy | External proxy | |
|---|---|---|
| Routes | /extract |
/proxy/extract, /proxy/render/extract |
| Fetches as | Identified minifetch user agent from a fixed IP |
External rotating proxy (webscrapingapi.com), optional country |
| robots.txt | Respected, including crawl-delay | Not checked |
| JavaScript | Not executed | Executed on /proxy/render |
| Cached | Yes | No, every call is a fresh fetch |
| Price | Cheapest | Native price plus a surcharge, see Proxy Routes |
proxy block: which proxy fetched the page, the user agent sent and
whether robots.txt was obeyed. For regulated use-cases where provenance matters,
stay on the native Minifetch proxy.
Not currently available on either proxy: authenticated or logged-in content.
Copyright Infringement and DMCA Policies. This website and its API services repsect your intellectual property rights as well as the intellectual property rights of others. If you believe that your intellectual property rights have been violated by the website, please fill out the feedback form. Additionally, you must provide your contact information including address, email, phone number as well as a statement that the information you have supplied is true and correct and that you are either the copyright owner or are authorized to act on on behalf of the copyright owner.
Data Collection and Privacy. Our service collects and processes certain personal information to operate and secure the platform. Account creation and authentication are handled by Clerk.com, which may collect your email address, name, and OAuth profile data depending on your sign-in method. Please refer to Clerk's Privacy Policy for details on how that data is handled. Payment processing is handled by Stripe, Inc., which collects billing information necessary to complete purchases. Please refer to Stripe's Privacy Policy for details. We use Google Analytics to understand how visitors find and use our site; where you have consented (see Cookies below), this involves sharing limited usage and device data with Google, LLC. Please refer to Google's Privacy Policy for details on how that data is handled. We store your email address and account balance internally solely to associate credits with your account and to communicate with you about your account. We maintain logs of URLs processed for operational, debugging, and security purposes; IP addresses in these logs are anonymized. We do not sell your personal data, and we do not share our internal service logs with third parties. Payment transactions processed via the Coinbase x402 protocol occur on a public blockchain and transaction details may be visible on public block explorers — this is inherent to blockchain technology and not specific to our service. For information on the privacy implications of x402 payments, please refer to Coinbase's documentation at x402.org.
Cookies.
Minifetch.com uses cookies for three purposes: authentication, payment processing, and analytics.
Authentication cookies are set by Clerk.com to maintain your login session after you
sign in. These persist across browser sessions so you remain logged in between visits.
Clerk may also set cookies to support cross-origin session syncing between our site and
Clerk's hosted Account Portal. For full details on Clerk's cookie usage, please refer to
Clerk's Privacy Policy.
Payment cookies are used by the x402 protocol to verify payments and prevent duplicate
charges. These are session cookies that are automatically deleted when you close your
browser. You may clear them at any time; you will need to re-authenticate your payment
session when you return.
Analytics cookies are set by Google Analytics to measure how visitors find and use our
site — for example, which pages are viewed and how visitors arrived. These cookies are not
strictly necessary and are set only after you opt in; you may decline at any time without
affecting authentication or
payments. For details, refer to
Google's Privacy Policy.
We do not use cookies for advertising. Stripe does not set cookies on our domain — payment
forms are handled via Stripe's hosted checkout flow.
Limitation of Liability. In absolutely no event will the website be liable for any direct or indirect damages, nor loss of revenues resulting from use of this website or any third-party content contained therein, nor loss due to interruption of service or corruption of data.
Indemnification. You agree to indemnify and hold harmless the website and any of its contractors, licensors, officers, employees, owners, and agents from any and all claims, including attorney's fees, arising out of your use of the website.
Service Availability. The website is provided on an "as is" and "as available" basis. We make no warranties or representations about the availability, reliability, or accuracy of the service. We reserve the right to modify, suspend, or discontinue the service at any time without notice or liability.
Termination Rights. We reserve the right, at our sole discretion, to suspend or terminate your access to the service without prior notice if you violate these Terms, abuse the service, or engage in behavior that imposes an unreasonable load on our infrastructure or negatively affects other users' ability to use the service.
Governing Law. These Terms shall be governed by and construed in accordance with the laws of California, USA, without regard to its conflict of law provisions. Any disputes arising under or in connection with these Terms shall be subject to the exclusive jurisdiction of the courts located within California, USA.
Changes to Terms. We reserve the right to modify these Terms at any time at our sole discretion. Changes will be effective immediately upon posting to the website. Your continued use of the service following the posting of revised Terms means that you accept and agree to the changes.
Please use our feedback form and we'll get back to you.