ScrapeThis API

Manage your spiders, jobs, and schedules programmatically.

🔑 Authentication

Bearer token auth. Generate keys in your dashboard.

📡 REST API

JSON request/response. Standard HTTP methods.

⚡ Rate Limits

1000 requests/hour per API key.

🧪 Playground

Try the API interactively in your browser.

Quick Start

1. Get your API key

Go to Settings → API Keys to generate a key.

2. Make your first request

List your spiders

"text">-green-400">curl "text-cyan-400">-X GET https://scrapethis.app/api/v1/spiders \
  "text-cyan-400">-H "Authorization: Bearer YOUR_API_KEY" \
  "text-cyan-400">-H "Content">-Type: application/json"

3. Start a job

Start a spider job

"text">-green-400">curl "text-cyan-400">-X POST https://scrapethis.app/api/v1/jobs \
  "text-cyan-400">-H "Authorization: Bearer YOUR_API_KEY" \
  "text-cyan-400">-H "Content">-Type: application/json" \
  "text-cyan-400">-d '{"spider_name": "my">-spider"}'

Base URL

https://scrapethis.app/api/v1

Response Format

All responses return JSON. Errors include a message field:

Error Response

{
  "message": "Spider not found"
}