GET /feeds

Retrieves all feeds for the authenticated organization.

https://api.webcrawlerapi.com/v2/feeds

Format: JSON Method: GET

Request

No parameters required. The endpoint automatically returns all feeds for your authenticated organization.

Response

Example:

{
    "feeds": [
        {
            "id": "5a153807-5fb0-4e31-a404-d9447cbc3e63",
            "url": "https://webcrawlerapi.com/changelog",
            "scrape_type": "markdown",
            "items_limit": 1,
            "status": "active",
            "next_run_at": "2025-12-27T13:47:38.148Z",
            "last_run_at": "2025-12-26T13:47:38.148Z",
            "webhook_url": "https://webhook.site/20073d34-735d-41e3-b7cf-3e776b88ebe7",
            "created_at": "2025-12-26T13:46:48.773Z"
        },
        {
            "id": "e3b74cdf-75bb-4c3e-8713-d9ac999012c7",
            "url": "https://webcrawlerapi.com/blog",
            "scrape_type": "markdown",
            "items_limit": 10,
            "status": "active",
            "next_run_at": "2025-12-27T13:47:37.331Z",
            "last_run_at": "2025-12-26T13:47:37.331Z",
            "webhook_url": "https://webhook.site/20073d34-735d-41e3-b7cf-3e776b88ebe7",
            "created_at": "2025-12-26T13:46:40.119Z"
        }
    ]
}

Response Fields

Feed Fields

id - unique feed identifier
url - the seed URL being monitored
name - friendly name (if provided)
scrape_type - content format (markdown, cleaned, html)
items_limit - max pages per crawl run
status - feed status: active, paused, or canceled
next_run_at - ISO 8601 timestamp when the next crawl will run
last_run_at - ISO 8601 timestamp when the last crawl ran
webhook_url - webhook endpoint for notifications (if configured)
webhook_status - HTTP status code from the last webhook delivery
created_at - ISO 8601 timestamp when the feed was created

Feed Statuses

The status field can have one of three values:

active - Feed is running and will crawl at the scheduled interval
paused - Feed is temporarily stopped (can be resumed)
canceled - Feed is permanently deleted (cannot be resumed)

Usage Notes

The response includes all feeds regardless of status (active, paused, or canceled)
Feeds are sorted by creation date (newest first)
Use the individual feed endpoints to get detailed run history for a specific feed

Error Responses

500 Internal Server Error - Internal server error