GET
/
crawler
/
jobs
/
{id}
/
meta
curl --request GET \
  --url https://api.usescraper.com/crawler/jobs/{id}/meta \
  --header 'Authorization: Bearer <token>'
{
    "data": [
        {
            "meta": {
                "page": 1,
                "url": "https://usescraper.com/blog",
                "fetchedUrl": "https://usescraper.com/blog",
                "meta": {
                    "title": "Blog - UseScraper",
                    "description": "UseScraper Blog - Hyper fast web crawling and scraping API. Browser rendering, Markdown output and more."
                }
            }
        },
        // ...more results
  ]
}

This endpoint is useful if you want to quickly fetch info (url, page title etc) about the results of a successful crawler job, but without the page output content included. The results are returned as an array of objects, each containing meta (info about the crawled page), but excluding the text (page content in the format requested) content.

The maximum results per request in 1,000. If there are more results to fetch, a cursor will be returned in the response. Include this cursor as a URL query param in the next request to fetch more results.

Authorizations

Authorization
string
headerrequired

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Path Parameters

id
string
required

Job ID

Query Parameters

limit
number | null
default: 1000

Number of results to return per request (max 1000 which is also the default)

cursor
string

Cursor for pagination, returned in response

Response

200 - application/json
meta
object
required
text
string