GET
/
crawler
/
jobs
/
{id}
curl --request GET \
  --url https://api.usescraper.com/crawler/jobs/{id} \
  --header 'Authorization: Bearer <token>'
{
    "id": "7YEGS3M8Q2JD6TNMEJB8B6EKVS",
    "urls": [
        "https://example.com"
    ],
    "createdAt": 1699964378397,
    "status": "running",
    "sitemapPageCount": 12,
    "progress": {
        "scraped": 6,
        "discarded": 0,
        "failed": 0
    },
    "costCents": 0,
    "webhookFails": []
}

Crawler jobs may take several minutes to complete. Use this endpoint to check the status of a job, and fetch the results from the Get job data endpoint when the job is complete.

Authorizations

Authorization
string
headerrequired

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Path Parameters

id
string
required

Job ID

Response

200 - application/json
costCents
number
createdAt
number
required

UNIX timestamp

exclude_elements
string
exclude_globs
string[]
finishedAt
number

UNIX timestamp

id
string
required
min_length
number
required
org
string
required
output_expiry
integer
required
output_format
enum<string>
required
Available options:
text,
html,
markdown
page_limit
number
progress
object
sitemapPageCount
number
required
status
enum<string>
required
Available options:
starting,
running,
succeeded,
failed
urls
string[]
required
use_browser
boolean
required
webhookFails
any
webhook_url
string