Webcrawler API LogoWebCrawlerAPI
APIFeed

GET /feed/:id

Get feed details and recent run history

Retrieves the details and recent runs of a specific feed including status, configuration, and execution history.

https://api.webcrawlerapi.com/v2/feed/:id

Format: JSON Method: GET

Request

URL Parameters:

  • id - (required) the feed ID returned when creating the feed

Response

Example:

{
	"id": "5a153807-5fb0-4e31-a404-d9447cbc3e63",
	"url": "https://webcrawlerapi.com/changelog",
	"scrape_type": "markdown",
	"items_limit": 1,
	"status": "active",
	"next_run_at": "2025-12-27T13:47:38.148Z",
	"last_run_at": "2025-12-26T13:47:38.148Z",
	"webhook_url": "https://webhook.site/20073d34-735d-41e3-b7cf-3e776b88ebe7",
	"webhook_status": 200,
	"created_at": "2025-12-26T13:46:48.773Z",
	"recent_runs": [
		{
			"id": "96585c01-9d2e-48b4-825a-bf9daee70570",
			"status": "done",
			"pages_crawled": 1,
			"pages_changed": 0,
			"pages_new": 1,
			"pages_unavailable": 0,
			"pages_errors": 0,
			"cost_usd": 0.002,
			"started_at": "2025-12-26T13:47:38.022Z",
			"finished_at": "2025-12-26T13:48:37.95Z"
		}
	]
}

Response Fields

Feed Configuration

  • id - unique feed identifier
  • url - the seed URL being monitored
  • name - friendly name (if provided)
  • scrape_type - content format (markdown, cleaned, html)
  • items_limit - max pages per crawl run
  • status - feed status: active, paused, or canceled
  • next_run_at - ISO 8601 timestamp when the next crawl will run
  • last_run_at - ISO 8601 timestamp when the last crawl ran
  • webhook_url - webhook endpoint for notifications (if configured)
  • webhook_status - HTTP status code from the last webhook delivery
  • created_at - ISO 8601 timestamp when the feed was created

Recent Runs Array

The recent_runs array contains recent feed execution history with these fields:

  • id - unique run identifier
  • status - run status (completed, failed, in_progress, done)
  • pages_crawled - total pages successfully crawled
  • pages_changed - pages with content changes since last run
  • pages_new - new pages discovered
  • pages_unavailable - pages that were previously available but are now unavailable
  • pages_errors - pages that failed to load
  • cost_usd - cost of the run in USD
  • started_at - ISO 8601 timestamp when the run started
  • finished_at - ISO 8601 timestamp when the run completed

Feed Statuses

  • active - Feed is running and will crawl at the scheduled interval
  • paused - Feed is temporarily stopped (can be resumed)
  • canceled - Feed is permanently deleted (cannot be resumed)

Error Responses

  • 400 Bad Request - Invalid request
  • 404 Not Found - Feed not found or does not belong to your organization