webcrawler/webcrawlerai
Execute OpenAI prompt over the webpage content and return a JSON with the results
URL of the website to crawl
What data format to return (html, cleaned, markdown)
Maximum number of items to scrape from the website
Try this crawler after registration. You'll receive $10 credit for free to test it out!
Sign Up