Site Crawler Overview

Note: The Site Crawler is a premium feature. Contact support@page-vault.com to learn more or add it to your account.

What Is the Site Crawler?

The Site Crawler is a premium Page Vault feature that automatically finds and captures multiple pages from a website. Instead of manually clicking and capturing each page, you can let the Site Crawler do the work for you.

Why Use the Site Crawler?

Saves Time: Automatically captures up to 5,000 pages from a website.
Easy to Use: Just enter the website URL and click start.
Legal-Grade Captures: Every page is saved with full metadata and a clear chain of custody.
Stays on Target: Only captures pages from the original website domain—not external links.

Capture URLs Straight from Your Crawl Results

Your crawl results are now actionable. You no longer need to export a crawl to CSV, trim the list, and re-upload it as a Batch job. Instead, you can pick the URLs you want right in the results table and capture them on the spot.

Here's how it works:

Capture one or many. Use Capture now on a single row, or tick the checkboxes for several rows and click Capture selected.
Select everything, not just this page. Select-all extends beyond the URLs currently on screen, so you can grab every matching URL in a crawl without paging through the whole list.
See where each URL stands. A capture status column shows whether a URL is Captured, Capturing, Failed, or Not captured. You can also filter by status, with counts for each state.
Choose a destination when you need to. On crawl-only jobs, the dialog will ask where you want the captures to land. On crawl and capture jobs, they go straight into the job's existing folder.
Watch progress as it happens. Captures report in one at a time while a run is in flight, and Cancel Capture stays available for the entire run.

Best For:

Capturing entire websites
Preserving content for legal, regulatory, or research needs
Investigations that require many pages quickly