Skip to main content
GET
Get crawl errors and skipped URLs

Overview

Explains a crawl that came back smaller than you expected. It returns two things:
  • failed — pages that were fetched and failed, oldest first, each with an error_code. Paged with skip and limit; follow next until it is null.
  • skipped — every URL the crawl found but did not fetch, counted by reason, with a few example URLs for each.
Works while the crawl is running and until it expires. Free.

Example request

cURL

POST /crawl

Start a crawl.

Error handling

What each error code means, and which are worth retrying.

Authorizations

X-API-Key
string
header
required

Your Prefetch API key. Obtain one from the dashboard.

Path Parameters

id
string
required

The crawl id returned by POST /crawl.

Example:

"crw_9f2c1a7b4e0d4c3a8b1e5f7d2c9a0b3e"

Query Parameters

skip
integer
default:0

Number of result pages to skip. Use the next link rather than building this by hand.

Required range: x >= 0
limit
integer
default:25

Number of crawled pages to return per request.

Required range: 1 <= x <= 100

Response

Failed pages and skip reasons.

success
enum<boolean>
required
Available options:
true
data
object
required
meta
object
required