POST
/
scraper
/
scrape

Scrape any webpage URL and get text, html or markdown. A Chrome browser with Javascript enabled is used to ensure every webpage can be scraped. Set advanced_proxy to true to enable our advanced scraping proxy which will cicumvent most bot detection and blocking systems (using advanced proxy does not currently cost any extra).

Authorizations

Authorization
string
header
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Body

application/json
url
string
required

URL to scrape

advanced_proxy
boolean
default:
false

Use advanced proxy -- default is false

extract_object
object
format
enum<string>
default:
text

Format to save all crawled page content to

Available options:
text,
html,
markdown

Response

200 - application/json
meta
object
required

Page metadata

status
enum<string>
required

Scraping status

Available options:
scraped,
failed
text
string

Scraped content