Skip to content

Datasource: website grabber

Rello edited this page Aug 25, 2026 · 5 revisions

Website grabber

The HTML grabber retrieves a public web page and extracts rows with a PHP regular expression. Use an API or CSV/JSON source when one is available: page markup, consent screens, rate limits, and bot protection make scraping fragile.

Requirements

  • The Nextcloud server must be able to reach the URL.
  • The page must not require login or browser-specific challenges.
  • The regular expression must be valid for PHP preg_match_all and define named dimension and value groups.

Options

  • URL
  • Data series description (optional)
  • Regex
  • Limit to cap returned rows
  • Timestamp of data load for stored snapshots

Build and test the expression outside Analytics first, then use Test run before scheduling it. A minimal pattern shape is:

/(?<dimension>label)\s*:\s*(?<value>[0-9.]+)/

Do not rely on the old Amazon examples: they are intentionally not maintained because Amazon markup and anti-bot behavior change frequently.

Clone this wiki locally