Website Discovery API

Find websites with the same combined filters and pagination used by website discovery.

Manage API keys

Endpoint and authentication

POST https://api.stackcrawler.com/v1/website-discovery

Send your account’s API key in Authorization: Bearer YOUR_API_KEY and use Content-Type: application/json. Standard API request allowances and rate limits apply.

To copy a request for an existing search, open website discovery, apply your filters, and select API.

Pagination

Query parameters: page is a positive integer (default 1). limit is 1–100 (default 20). Use 20 to match the discovery page. Increase the page number to continue through results.

JSON body filters

All filters are optional and all values must be strings. Send an empty object to browse all websites. Different filter types are combined with AND.

FieldBehavior
technologiesComma-separated technology names, such as Shopify,Cloudflare. Every selected technology must match. Use names from website discovery, rather than slugs.
toolCategoriesComma-separated technology category names. Matches any selected category.
toolVersionsA JSON-encoded string mapping technology names to exact version arrays, for example {"React":["19"]}. Multiple versions of one technology are alternatives. An empty array matches no versions.
themesComma-separated theme names, such as Dawn. Matches any selected theme.
languagesComma-separated language values from discovery. Matches language prefixes.
tldsComma-separated domain suffixes without a leading dot, such as com,no.
categoriesComma-separated website category names.
keywordsText matched against URL, title, or description. Must contain more than two characters.
minPerformanceScore / maxPerformanceScorePerformance score bounds, expressed as strings from 0 to 100.
minAccessibilityScore / maxAccessibilityScoreAccessibility score bounds, expressed as strings from 0 to 100.
minBestPracticesScore / maxBestPracticesScoreBest practices score bounds, expressed as strings from 0 to 100.
minSeoScore / maxSeoScoreSEO score bounds, expressed as strings from 0 to 100.

For version-below filters, the discovery API button resolves the threshold into exact versions in toolVersions. The endpoint does not accept toolVersionsBelow directly.

Example request

curl 'https://api.stackcrawler.com/v1/website-discovery?page=2&limit=20' \
  --header 'Content-Type: application/json' \
  --header 'Authorization: Bearer YOUR_API_KEY' \
  --data '{
    "technologies": "Shopify,Cloudflare",
    "themes": "Dawn",
    "languages": "English",
    "tlds": "com,no",
    "maxPerformanceScore": "80"
  }'

Example response

Returns websites and pagination. The shortened example below shows the last page of 21 matches. Technology changes compare the latest two scans; a first scan has no changes.

{
  "websites": [
    {
      "id": 123,
      "url": "https://example.com",
      "metaDescription": "An example store",
      "language": "English",
      "websiteCategory": "Shopping",
      "WebsiteTool": [
        {
          "tool": {
            "name": "Shopify",
            "logo_url": null
          },
          "version": null
        },
        {
          "tool": {
            "name": "Cloudflare",
            "logo_url": null
          },
          "version": null
        }
      ],
      "toolChanges": {
        "added": 1,
        "removed": 0,
        "versionChanged": 0
      },
      "hasToolChanges": true
    }
  ],
  "pagination": {
    "currentPage": 2,
    "limit": 20,
    "totalCount": 21,
    "totalPages": 2
  }
}

This queries the current website database. To query a saved lead-list snapshot, use GET /v1/lead-report/:id with an API key belonging to that list’s owner.

Errors

  • 400: invalid pagination, unsupported filter, or a value that is not a string.
  • 401: missing or invalid API key.
  • 429: API request allowance or rate limit reached.
  • 503: website discovery is temporarily unavailable.
  • 500: an unexpected server error.