Crawler
Get job data
Get results for a job’s crawled pages.
GET
/
crawler
/
jobs
/
{id}
/
data
Use this endpoint to fetch the results of a successful crawler job. The results are returned as an array of objects, each containing meta
(info about the crawled page) and text
(page content in the format requested).
The maximum results per request in 1,000. If there are more results to fetch, a cursor
will be returned in the response. Include this cursor
as a URL query param in the next request to fetch more results.
Authorizations
Bearer authentication header of the form Bearer <token>
, where <token>
is your auth token.
Path Parameters
Job ID
Query Parameters
Number of results to return per request (max 500 which is also the default)
Required range:
x < 400
Cursor for pagination, returned in response