Scraper
Scrape
Scrape a URL. Output is returned in the response.
POST
/
scraper
/
scrape
Scrape any webpage URL and get text, html or markdown. A Chrome browser with Javascript enabled is used to ensure every webpage can be scraped. Set advanced_proxy to true to enable our advanced scraping proxy which will cicumvent most bot detection and blocking systems (using advanced proxy does not currently cost any extra).
Authorizations
Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Body
application/json
URL to scrape
Format to save all crawled page content to
Available options:
text, html, markdown Use advanced proxy -- default is false