# Common Crawl crawlers (CCBot) — IP ranges # Source: https://index.commoncrawl.org/ccbot.json # Checked: 2026-11-13T03:17:01Z (every day) # From https://blackoutmap.net/resources/crawler-ips — free to use, a link back is appreciated # Apache 2.4 (.htaccess or ): wrap in to allow only these crawlers. # Common Crawl Require ip 3.41.188.32/29 18.97.9.168/29 18.97.14.80/29 18.97.14.88/30 2600:1f28:365:8000::/56