Web scraping API. Return it your way.

Turn websites and PDFs into Markdown, HTML, structured fields, images, and screenshots. Choose the formats your product needs in one request.

Get API key

Powering agents and products with the world's data.

Tuomo Riekki

Co-founder @ Zero

“Migrating to Context.dev was extremely easy. The APIs are clean and easy for agents to understand and implement. The Dashboard is also handy for testing out how various scraping types behave. Switching to Context.dev from our existing scraping and web search providers took probably less than 5min with Codex.”

Read the case study

Abdullah Enes Güleş

Software Engineer @ Upstash

“Incredible AX! Claude handled all the setup for me. It wasn't longer than a few minutes until we started a few benchmarks with our previous crawling service and already saw the benefits and improvements.”

Read the case study

Nick Khami

Former Engineering Manager @ Mintlify

“Onboarding couldn't be simpler. Self-serve sign-up gives you an API key immediately, the documentation is thorough, and we were integrating within 10 minutes.”

Read the case study

Pranav

Founder @ Chatwoot

“Happy to be a paid customer of @getcontextdev. It's great, gives us the best results with ms response times. We have tested a couple of products, and Context wins without a doubt.”

Raz

AI @ Similarweb

“My agent understood it perfectly. Setup was very easy. I was looking for a nice datapoint for my agents, and Context.dev was the best one in the marketplace.”

Read the case study

Wilson Wilson

Founder @ Ferndesk

“Now that context.dev has been integrated into Ferndesk, we've been able to ship this really beautiful onboarding that integrates the customer's company throughout the entire flow.”

Read the case study

Aaron Edwards

Founder @ DocsBot

“We're seeing much higher activation rates for our free trials and sign-ups because of it. It's made it a lot simpler for customers to get started with DocsBot and to get to that 'aha' value moment very quickly.”

Read the case study

Ido Shamun

Co-founder @ daily.dev

“We use Context.dev for our internal enrichment system to verify companies. The integration was straightforward. We set it up once and never had to touch it again. It just works.”

Read the case study

Christopher Price

COO @ Sixtyfour

“The API integration was seamless and expedient. My team was able to get it set up and testing with production workloads within an hour of hearing what Context.dev was!”

Read the case study

Lewis Carhart

Founder @ Comp AI

“Just used Context.dev to help Codex build an on-brand sales deck generator for us. Came out really well!”

Read the case study

Bhanu

Co-founder @ Squad.so

“It was great. Took 5 mins to integrate. We use Context.dev to give AI agents ability to scrape webpages, take screenshots, and also extract specific content from webpages.”

Read the case study

The Context.dev web scraping API turns any public URL or PDF into clean Markdown, HTML, screenshots, images, CSS-parsed fields, or JSON that matches your JSON Schema, in one request. Every request renders JavaScript in a real browser with anti-bot handling and proxies included, so there is no rendering or premium-proxy surcharge.

A page costs 1 credit across every requested format, 2 with browser actions, and 5 with AI JSON extraction. Blocked and failed requests are not billed; only a missing page (404) costs the base price. The free plan includes 1,000 credits a month, official SDKs cover TypeScript, Python, Ruby, Go, and PHP, and the same API is available as a hosted MCP server and a CLI.

POST/v1/web/scrape

Read the API reference

per page, across every format: 1 credit
JavaScript rendering, anti-bot, proxies: Included
per page with AI JSON extraction: 5 credits
free credits every month: 1,000

Any page, any format. One request.

Choose the outputs your product needs and get them back together, from clean Markdown to a full-page screenshot.

Choose your output
Request multiple formats together. Read clean content, keep the HTML, or capture the page visually.
Extract JSON with AI
Send a JSON Schema and get typed fields back from any page, without writing selectors.
Read dynamic pages
Every request renders JavaScript. Add browser actions and wait controls when content depends on clicks or scrolling.

Start with a URL. Get usable data.

Request the outputs you need through the SDK. Use the same API key when you are ready to map domains, run batches, or create monitors.

$ npm install context.dev

Read the API reference

scrape.ts

import ContextDev from 'context.dev';

const client = new ContextDev({ apiKey: 'YOUR_API_KEY' });

const page = await client.web.scrape({
  url: 'https://linear.app',
  formats: {
    markdown: true,
    html: true,
    screenshot: true,
  },
  sharedParams: { mainContentOnly: true },
});

if (page.markdown.success) console.log(page.markdown.data);
if (page.screenshot.success) console.log(page.screenshot.data);

from context.dev import ContextDev

client = ContextDev(api_key="YOUR_API_KEY")

response = client.web.scrape(
    url="https://linear.app",
    formats={
        "html": True,
        "markdown": True,
        "screenshot": True
    },
    shared_params={
        "main_content_only": True
    },
)
print(response)

require "cgi/core"
require "context_dev"

client = ContextDev::Client.new(api_key: "YOUR_API_KEY")

response = client.web.scrape(
  url: "https://linear.app",
  formats: {
    html: true,
    markdown: true,
    screenshot: true
  },
  shared_params: {
    main_content_only: true
  }
)
puts response

<?php

require_once 'vendor/autoload.php';

use ContextDev\Client;

$client = new Client(apiKey: 'YOUR_API_KEY');

$response = $client->web->scrape(
    url: 'https://linear.app',
    formats: [
        'html' => true,
        'markdown' => true,
        'screenshot' => true
    ],
    sharedParams: [
        'mainContentOnly' => true
    ]
);

var_dump($response);

package main

import (
	"context"
	"fmt"

	contextdev "github.com/context-dot-dev/context-go-sdk/v2"
	"github.com/context-dot-dev/context-go-sdk/v2/option"
)

func main() {
	client := contextdev.NewClient(
		option.WithAPIKey("YOUR_API_KEY"),
	)

	response, err := client.Web.Scrape(context.TODO(), contextdev.WebScrapeParams{
		URL: "https://linear.app",
		Formats: contextdev.WebScrapeParamsFormats{
			HTML:       contextdev.Bool(true),
			Markdown:   contextdev.Bool(true),
			Screenshot: contextdev.Bool(true),
		},
		SharedParams: contextdev.WebScrapeParamsSharedParams{
			MainContentOnly: contextdev.Bool(true),
		},
	})
	if err != nil {
		panic(err)
	}

	fmt.Printf("%+v\n", response)
}

curl --request POST 'https://api.context.dev/v1/web/scrape' \
  --header 'Authorization: Bearer YOUR_API_KEY' \
  --header 'Content-Type: application/json' \
  --data '{
  "url": "https://linear.app",
  "formats": {
    "html": true,
    "markdown": true,
    "screenshot": true
  },
  "sharedParams": {
    "mainContentOnly": true
  }
}'

From a single page to your next feature.

Feed your knowledge pipeline, or collect pages across a much larger job with the same API key.

Ground RAG in fresh content
Crawl a sitemap, convert every page to clean Markdown, and send it straight into your embeddings, with no brittle parsers in between.
Run batches at scale
Scrape thousands of URLs in one job, or crawl an entire site, then collect the results when the batch completes.

A few things to know.

More details in the API documentation.

Is there a free web scraping API?

Yes. The free plan includes 1,000 credits every month with no credit card. A standard scrape costs 1 credit, so that covers 1,000 pages, with JavaScript rendering and proxies included. Paid plans start at $20 a month for 10,000 credits.

Does the API render JavaScript?

Yes. Every request loads in a real browser, so single-page apps and lazy-loaded content come back complete. Add browser actions when a page needs clicks or scrolling first.

Can I request several formats at once?

Yes. Enable the formats you need in the same scrape request. Markdown, HTML, images, screenshots, parsed fields, and the original response body have their own output controls.

Can I scrape PDFs as well as websites?

Yes. Pass the public document URL to Scrape and request Markdown or HTML. PDF parsing options let you choose pages and enable OCR for scanned content. Use Parse File when you already have the file bytes.

How do I request fresh content?

Set maxAgeMs to 0 to request a fresh capture. A higher value lets the API reuse content captured within that time window.

How do I scrape a large list of URLs?

Use Batches to submit up to 100,000 URLs or crawl a website asynchronously. Keep the job ID to track progress, collect paginated results, or receive a completion webhook.

How does the API handle JavaScript-heavy websites and anti-bot protection?

Every scrape loads the page in a real browser and routes through managed proxies with anti-bot handling on the standard request path, so client-rendered content and common bot challenges are handled without a premium-proxy flag or an extra credit multiplier. Pages that need interaction accept up to 5 browser actions and wait controls for 2 credits. No provider gets through every protection on every site, so each output reports its own success flag and error code, and blocked requests are not billed.

Am I billed for failed requests?

Most failed requests are not billed. Not-found responses (404) are billed at the request’s base price. Scrape can return a 200 with failed outputs: it charges when at least one output succeeds or the target page is missing. Check key_metadata.credits_consumed for the amount charged. Crawls and batches charge per successful page.

Which languages and SDKs can I use?

Official SDKs cover TypeScript (npm install context.dev), Python (pip install context.dev), Ruby, Go, and PHP, and any language can call the REST API with one bearer token. A CLI covers terminal and agent shells, and the hosted MCP server at https://mcp.context.dev/mcp gives Claude, Cursor, Codex, and ChatGPT the same scrape, crawl, and search tools.

What are the rate limits?

Limits cap concurrent requests per organization: Free allows 2, Developer 10, Pro 100, Growth 250, and Scale 500, with no per-minute cap by default. The dashboard shows your effective limits, and Enterprise plans can have custom limits.

Scrape your first page in minutes.

Turn any URL into the format your product needs. The same API key works for crawling, batches, and monitors.

1,000free credits

Every month. No credit card required.

Start for free Read the docs

Web scraping API. Return it your way.

Powering agents and products with the world's data.

Scrape anything at a glance

Any page, any format. One request.

Choose your output

Extract JSON with AI

Read dynamic pages

Start with a URL. Get usable data.

From a single page to your next feature.

Ground RAG in fresh content

Run batches at scale

A few things to know.

Scrape your first page in minutes.