GET
/
crawler
/
jobs
/
{id}

Crawler jobs may take several minutes to complete. Use this endpoint to check the status of a job, and fetch the results from the Get job data endpoint when the job is complete.

Authorizations

​
Authorization
string
headerrequired

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Path Parameters

​
id
string
required

Job ID

Response

200 - application/json
​
id
string
required
​
org
string
required
​
urls
string[]
required
​
output_format
enum<string>
required
Available options:
text,
html,
markdown
​
output_expiry
integer
required
Required range: x > 0
​
min_length
number
required
​
use_browser
boolean
required
​
createdAt
number
required

UNIX timestamp

​
status
enum<string>
required
Available options:
starting,
running,
succeeded,
failed,
cancelled
​
notices
object[]
required
​
sitemapPageCount
number
required
​
exclude_globs
string[]
​
exclude_elements
string
​
webhook_url
string
​
link_crawling
boolean
​
page_limit
number
Required range: x > 0
​
force_crawling_mode
enum<string>
Available options:
link,
sitemap
​
block_resources
boolean
default: true
​
include_linked_files
boolean
default: false
​
finishedAt
number

UNIX timestamp

​
costMillicents
number
​
costCents
number
​
progress
object
​
webhookFails
any
Create jobGet job data