Scraper
Scrape
Scrape a URL. Output is returned in the response.
POST
/
scraper
/
scrape
Scrape any webpage URL and get text, html or markdown. A Chrome browser with Javascript enabled is used to ensure every webpage can be scraped.
Authorizations
Authorization
string
headerrequiredBearer authentication header of the form Bearer <token>
, where <token>
is your auth token.
Body
application/json
url
string
requiredURL to scrape
format
enum<string>
default: textFormat to save all crawled page content to
Available options:
text
, html
, markdown
Response
200 - application/json
status
enum<string>
requiredScraping status
Available options:
scraped
, failed
text
string
Scraped content
meta
object
requiredPage metadata