# Web crawling and data extraction | Webcrawlerapi

> This is a collection of pages from webcrawlerapi.com, formatted for language models.

## Available Pages

- [Web crawling and data extraction | Webcrawlerapi](https://webcrawlerapi.com)
- [Scrape API | WebcrawlerAPI](https://webcrawlerapi.com/docs/api/scrape)
- [WebCrawling | WebcrawlerAPI docs](https://webcrawlerapi.com/docs/getting-started)
- [Blog | Webcrawlerapi](https://webcrawlerapi.com/blog)
- [Website to Markdown Free Tool | WebcrawlerAPI](https://webcrawlerapi.com/tools/website-to-md)
- [Changelog | WebCrawlerAPI](https://webcrawlerapi.com/changelog)
- [Privacy Policy | Webcrawler API](https://webcrawlerapi.com/privacy)
- [Terms of Service | Webcrawler API](https://webcrawlerapi.com/tos)
- [Refund policy | Webcrawler API](https://webcrawlerapi.com/refund)
- [API access key | WebcrawlerAPI docs](https://webcrawlerapi.com/docs/access-key)
- [What is Crawling Job? | WebcrawlerAPI docs](https://webcrawlerapi.com/docs/job)
- [Crawling output format types | WebcrawlerAPI docs](https://webcrawlerapi.com/docs/crawling-types)
- [Async and Webhooks | WebcrawlerAPI docs](https://webcrawlerapi.com/docs/async-requests)
- [Errors | WebcrawlerAPI docs](https://webcrawlerapi.com/docs/errors)
- [WebcrawlerAPI Rate Limits | WebcrawlerAPI docs](https://webcrawlerapi.com/docs/rate-limits)
- [.NET | WebcrawlerAPI docs](https://webcrawlerapi.com/docs/sdk/dotnet)
- [JavaScript and TypeScript (Node.js) | WebcrawlerAPI docs](https://webcrawlerapi.com/docs/sdk/js)
- [PHP | WebcrawlerAPI docs](https://webcrawlerapi.com/docs/sdk/php)
- [Python | WebcrawlerAPI docs](https://webcrawlerapi.com/docs/sdk/python)
- [POST /crawl | WebcrawlerAPI docs](https://webcrawlerapi.com/docs/API/crawl)
- [GET /job/:id | WebcrawlerAPI docs](https://webcrawlerapi.com/docs/API/job)
- [PUT /job/:id/cancel | WebcrawlerAPI docs](https://webcrawlerapi.com/docs/API/cancel)
- [POST /scrape | WebcrawlerAPI docs](https://webcrawlerapi.com/docs/API/scrape)
- [GET /scrape/:id | WebcrawlerAPI docs](https://webcrawlerapi.com/docs/API/scrape-get)
- [GET /scrape/:id/meta | WebcrawlerAPI docs](https://webcrawlerapi.com/docs/API/scrape-meta)
- [GET /scrape/:id/result | WebcrawlerAPI docs](https://webcrawlerapi.com/docs/API/scrape-result)
- [What is webcrawling?](https://webcrawlerapi.com/blog/what-is-a-web-crawling)
- [JavaScript Rendering in Web Crawling](https://webcrawlerapi.com/blog/javascript-rendering-in-web-crawling-complete-guide)
- [Cleaned text vs Markdown: Choosing the Right Output Format for AI](https://webcrawlerapi.com/blog/cleaned-text-vs-markdown-choosing-the-right-output-format)
- [Top 5 best Firecrawl alternatives](https://webcrawlerapi.com/blog/top-5-best-firecrawl-alternatives)
- [HTML vs Markdown: Choosing the Right Output Format for AI](https://webcrawlerapi.com/blog/html-vs-markdown-choosing-the-right-output-format)
- [How to crawl website with PHP](https://webcrawlerapi.com/blog/how-to-crawl-website-with-php)
- [How to Crawl Website with .NET and C#](https://webcrawlerapi.com/blog/how-to-crawl-website-with-net-and-c)
- [Best Web Crawler API in 2025](https://webcrawlerapi.com/blog/best-webcrawler-api-in-2025)
- [Python vs Node.js: Which is Better for Web Crawling?](https://webcrawlerapi.com/blog/python-vs-nodejs-which-is-better-for-web-crawling)
- [The Best Data Format for Your Prompt](https://webcrawlerapi.com/blog/best-prompt-data)
- [How to upload website content to ChatGPT](https://webcrawlerapi.com/blog/upload-website-content-to-chatgpt)
- [How to extract XPath in Golang](https://webcrawlerapi.com/blog/extract-xpath-golang)
- [What is Xpath?](https://webcrawlerapi.com/blog/what-is-xpath)
- [Clean crawled or scraped data with BeatuifulSoup in Python](https://webcrawlerapi.com/blog/clean-crawled-data-with-beautifulsoup-in-python)
- [How to build a web crawler with Scrapy in Python](https://webcrawlerapi.com/blog/how-to-build-a-web-crawler-with-scrapy-in-python)
- [What is the best crawling API in 2024?](https://webcrawlerapi.com/blog/best-web-crawler-api-2024)
- [What is webcrawling API?](https://webcrawlerapi.com/blog/what-is-a-web-crawling-api)
- [What is the difference between web crawling and scraping?](https://webcrawlerapi.com/blog/what-is-the-difference-between-web-crawling-and-scraping)
- [How to crawl the website with Python](https://webcrawlerapi.com/blog/how-to-crawl-the-website-with-python)
- [WebCrawling | WebcrawlerAPI docs](https://webcrawlerapi.com/docs)
- [Crawling output format types | WebcrawlerAPI docs](https://webcrawlerapi.com/docs/crawling/crawling-types)