POST
/
scraper
/
scrape
curl --request POST \
  --url https://api.usescraper.com/scraper/scrape \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '{
  "url": "<string>",
  "format": "text"
}'
{
  "text": "Webpage content will be here...",
  "meta": {
    "url": "https://usescraper.com",
    "fetchedUrl": "https://usescraper.com",
    "fetchedUrlStatusCode": 200,
    "meta": {
      "title": "UseScraper - Web Crawler & Scraper API",
      "description": {}
    }
  },
  "status": "scraped"
}

Scrape any webpage URL and get text, html or markdown. A Chrome browser with Javascript enabled is used to ensure every webpage can be scraped.

Authorizations

Authorization
string
headerrequired

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Body

application/json
url
string
required

URL to scrape

format
enum<string>
default: text

Format to save all crawled page content to

Available options:
text,
html,
markdown

Response

200 - application/json
status
enum<string>
required

Scraping status

Available options:
scraped,
failed
text
string

Scraped content

meta
object
required

Page metadata