Skip to main content
A monitor has up to 50 targets, of three kinds. You can mix them in one monitor. One check fetches at most 500 pages across all targets: every scrape URL, every crawl’s limit, and every search’s result limit.

Scrape targets

Use a scrape target when you know exactly which pages matter, such as a pricing page or a terms of service.

Crawl targets

Use a crawl target to watch a section that grows, such as a blog, a changelog or a jobs page. New pages are reported as new, and pages that disappear as removed.
A crawl can report a page as removed only when it runs out of pages to visit. A crawl that stops at its limit can’t tell a page that was taken down from one it never reached, so it reports no removals. Give a crawl target a limit comfortably above the section’s size if removals matter to you.

Search targets

A search target watches the web rather than one site, for example news about a company or new posts on a topic:
With a goal, each new result’s page is read and judged, so only results that match it are announced. Pass scrape_results: false to judge on the search snippet alone. Without a goal, every new result is announced. Results are recognized by URL, ignoring tracking parameters. They’re never reported removed: a page that drops out of the results hasn’t gone anywhere.

Changing targets later

PATCH /monitor/{id} replaces the whole target list. A target you send with its existing id, or one that watches the same URLs as before, keeps its history. Any other target starts with a silent baseline.