# Allow all robots to spider everything by disallowing nothing User-agent: * Disallow: /search/ Disallow: /s.nl