Back to Changelog

Combined Markdown Export Endpoint

New GET /job/:id/markdown endpoint returns the full job content in one single concatenated markdown file.

Instead of downloading individual page results, you can now get all crawled markdown content combined into a single file. Each page's content is separated with URL headers for easy parsing.

Perfect for:

  • RAG Applications: Feed combined documentation into vector databases or AI models
  • Batch Processing: Process entire website content at once for analysis or indexing
  • Documentation Extraction: Extract and combine docs from multiple pages
  • Backup: Archive complete crawl results in a single file

See the API documentation for usage examples and complete reference.