AI traffic analysis

Understand how AI platforms interact with your website—and how that activity translates into real visitors and conversions. Scrunch gives you two complementary views of AI traffic: - Agent Traffic shows AI bots crawling your site in real time. - AI Referrals shows human visits that arrive from AI platforms via Google Analytics 4 (GA4).

Use this page to quickly see what Scrunch tracks, how it works, and where to start.

How Scrunch detects AI bot traffic (and how it differs from GA4 or server logs)

Scrunch connects directly to your CDN or hosting provider to capture real-time bot visits that most analytics miss. These direct integrations record: - Which AI platforms and agents are requesting your content - What they’re asking for (training, indexing, or retrieval) - How frequently they visit and which pages they hit - Whether requests succeed or fail

Why this matters: - GA4 doesn’t capture most bot activity because bots typically don’t trigger pageviews or client-side scripts. - Raw server logs can be noisy and hard to classify. Scrunch adds AI-specific detection and labeling so you can see meaningful bot types and trends. - CDN/hosting visibility surfaces the “invisible” crawl and retrieval traffic that powers AI answers but never appears in standard web analytics.

Learn more in the FAQ: How Scrunch detects AI bot traffic visiting my site.

What Scrunch tracks

Supported AI platforms and models - ChatGPT - Claude - Gemini - Perplexity - Google AI Mode - Google AI Overviews - Microsoft Copilot - Meta AI - Support for Grok is coming soon

Bot request types Scrunch classifies - Training bots: collect content to train models - Indexer bots: crawl and index content for faster retrieval later - Retrieval bots: fetch content in real time to answer live user queries

Crawler traffic vs. referral traffic—what you’ll see

Agent Traffic (CDN/hosting integration required) - Bot visits over time, broken down by model/agent - Request types (training, indexing, retrieval) - Human vs. AI traffic comparison - Top bot agents and most-accessed pages - Live feed of recent bot requests with timestamps and status

AI Referrals (GA4 connection required) - AI-referred sessions and views - AI-referred conversion rate and revenue (if configured in GA4) - Non-AI conversion benchmarks - AI sources and landing pages

Scrunch treats these as distinct but connected views—crawler activity indicates consideration in AI answers, while referrals show downstream impact on human traffic and conversions. See the FAQ: How Scrunch tracks AI search visits to your website.

How Scrunch’s technology works

Data collection - Direct CDN/hosting integrations capture AI bot traffic in real time. Native options include Akamai, AWS CloudFront, Cloudflare, Fastly, Vercel, and WordPress. If your CMS doesn’t expose raw logs (e.g., HubSpot, Shopify, Webflow, Wix), you can integrate via a Cloudflare proxy. - GA4 integration powers AI Referrals via an embedded Looker Studio dashboard. Connect the GA4 property that tracks your site to analyze AI-referred sessions, conversions, and revenue. Follow the steps to connect GA4 to Scrunch. - For broader AI visibility beyond traffic, Scrunch’s Monitoring & Insights uses a mix of browser automation and official platform APIs to collect prompt and citation data from platforms like ChatGPT, Perplexity, and Google AI Overviews.

Product layers that work together - Monitoring & Insights: Understand brand presence, citations, competitive benchmarks, and where you appear in AI answers. - Agent Traffic: See which AI agents crawl or retrieve your content, how often, and which pages they use. - AI Referrals: Quantify traffic and conversions arriving from AI platforms in GA4. - AXP (Agent Experience Platform): Deliver an AI-optimized version of your content to improve how agents read, cite, and attribute your site.

Measuring AI’s impact on brand visibility

Scrunch connects the full AI journey—from exposure to outcomes—so you can move from “Are bots visiting?” to “Is AI driving results?” - Exposure: Track where and how you appear across AI platforms (Monitoring & Insights). - Consideration: See which bots retrieve your pages and which content they favor (Agent Traffic). - Outcomes: Attribute sessions, conversions, and revenue to AI sources (AI Referrals).

This unified, AI-first analytics view goes beyond traditional web analytics, which generally misses bot activity and lacks multi-LLM visibility. With Scrunch, you can: - Prioritize pages that retrieval bots already use in live answers - Spot gaps where certain models under-crawl or under-cite your content - Tie AI-driven discovery to measurable business impact in GA4

Get started