GET
/
crawler
/
jobs
/
{id}

Crawler jobs may take several minutes to complete. Use this endpoint to check the status of a job, and fetch the results from the Get job data endpoint when the job is complete.

Authorizations

Authorization
string
headerrequired

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Path Parameters

id
string
required

Job ID

Response

200 - application/json
id
string
required
org
string
required
urls
string[]
required
exclude_globs
string[]
exclude_elements
string
output_format
enum<string>
required
Available options:
text,
html,
markdown
output_expiry
integer
required
min_length
number
required
webhook_url
string
use_browser
boolean
required
link_crawling
boolean
required
page_limit
number
force_crawling_mode
enum<string>
Available options:
link,
sitemap
block_resources
boolean
default: true
include_linked_files
boolean
default: false
createdAt
number
required

UNIX timestamp

finishedAt
number

UNIX timestamp

costMillicents
number
costCents
number
status
enum<string>
required
Available options:
starting,
running,
succeeded,
failed,
cancelled
notices
object[]
required
sitemapPageCount
number
required
progress
object
webhookFails
any
Create jobGet job data