Radar Bulk Crawl: Multi-Site Jobs

Crawl many brand websites in one job with a shared page limit, ideal for working through a list of URLs pulled from a SERP Lookup.

Crawl many brand websites in a single job instead of starting one crawl per site — useful when you already have a list of URLs to work through (for example, from a SERP Lookup).

Steps

1. Go to Outreach → Bulk Crawl.

2. Paste one site URL per line into the Site URLs box. The number of sites detected updates live as you type.

3. Set the Page limit — the total number of pages allowed across all sites in this job combined (up to 5,000, default 500).

4. Set the Depth limit — how many links deep the crawler follows on each individual site (up to 5, default 2).

5. Click Start bulk crawl.

6. Track progress in the Bulk jobs table: Sites, Pages, Duration, Status, Created.

7. Click a job to open the same detail view used by regular Crawler jobs — every page visited, plus a CSV export once results come in.

Bulk Crawl jobs also show up in the regular Crawler page's own Jobs list — Bulk Crawl is simply the same crawl engine, filtered to jobs that were started with more than one URL at once.