docs
API
Scrape Meta

GET /scrape/:id/meta

Get status information for a scraping without the structured data.

https://api.webcrawlerapi.com/v1/scrape/:id/meta

Method: GET

Response

{
    "id": "f8e220a4-a877-44f0-ac25-8e48ef057d44",
    "url": "",
    "status": "done",
    "crawler_id": "webcrawler/url-to-md",
    "page_status_code": 0,
    "created_at": "2025-01-01 21:20:57",
    "finished_at": "2025-01-01 21:21:02",
    "cost": 0.002
}

The status field can be:

  • new - Job is queued
  • in_progress - Currently scraping
  • done - Scraping completed successfully
  • error - Scraping failed

Error Responses

  • 401 Unauthorized - Invalid or missing API key
  • 404 Not Found - Job not found
  • 500 Internal Server Error - Server-side error