Bulk Operations

Start multiple spider jobs in a single request.

POST /api/v1/jobs/bulk

Start jobs for multiple spiders at once. Provide either an array of spider IDs or spider names. Each spider will start one job. Results include per-spider success/failure.

Request Body

TypeScript

{
  spider_ids?: "text-purple-400">string[];     // array of spider UUIDs
  spider_names?: "text-purple-400">string[];   // or array of spider names
  arguments?: object;        // optional arguments applied to all jobs
}

Example Request

cURL

"text">-green-400">curl "text-cyan-400">-X POST https://scrapethis.app/api/v1/jobs/bulk \
  "text-cyan-400">-H "Authorization: Bearer YOUR_API_KEY" \
  "text-cyan-400">-H "Content">-Type: application/json" \
  "text-cyan-400">-d '{
    "spider_names": ["product">-spider", "price">-spider"],
    "arguments": {"mode": "full"}
  }'

Response

200 OK

{
  "total": 2,
  "succeeded": 2,
  "failed": 0,
  "results": [
    {
      "spider_id": "uuid-1",
      "success": true,
      "job_id": "job-uuid-1"
    },
    {
      "spider_id": "uuid-2",
      "success": true,
      "job_id": "job-uuid-2"
    }
  ]
}

Error Responses

400 Missing spider_ids or spider_names

401 Invalid or missing API key