Web Scraping API

Extract JavaScript-rendered HTML from any URL with a real headless browser. Sync and async endpoints with flexible render options, resource blocking, and SSRF protection.

Start for free View documentation

API endpoint

GET https://scrape.cleariflow.com/v1/scrape/?api_key=YOUR_API_KEY

Try it now

Test the API with live data

API benefits

JavaScript Rendering

Real headless browser sessions execute JavaScript and return fully rendered HTML.

Flexible Render Options

Configure wait_until, timeouts, post-load delays, and HTTPS error handling per request.

Sync & Async Endpoints

Synchronous scrape for low latency or async jobs for high-volume and slow pages.

Resource Blocking

Block images, fonts, and media to speed up scrapes and reduce bandwidth.

SSRF Protection

Built-in safeguards block private networks and other unsafe target URLs.

Bank-level Security

All API traffic is secured with TLS encryption (HTTPS).

Key features

Real headless browser rendering
Full JavaScript execution before capture
Synchronous POST /v1/scrape endpoint
Async job queue with polling
Configurable wait_until (domcontentloaded, networkidle)
Block images, fonts, and media
SSRF-safe URL validation
Optional post-load wait delay
JSON response with HTML and metadata
Configurable timeout up to 60s
TLS-encrypted API access
Render and resource options per request

Quick start guide

1. Get your API key

2. Make your first request

cURL

curl -X POST "https://scrape.cleariflow.com/v1/scrape" \
  -H 'Content-Type: application/json' \
  -d '{
    "api_key": "YOUR_API_KEY",
    "url": "https://quotes.toscrape.com/"
  }'

3. Handle the response

JSON

{
  "html": "\u003c!DOCTYPE html\u003e\u003chtml\u003e\u003chead\u003e\u003ctitle\u003eQuotes to Scrape\u003c/title\u003e\u003c/head\u003e\u003cbody\u003e...\u003c/body\u003e\u003c/html\u003e",
  "meta": {
    "elapsed_ms": 4521
  },
  "ok": true
}