User-agent: * Crawl-delay: 10 # Paths (no clean URLs) Disallow: /*?id= Disallow: /*?gclid=