# Disallow all crawlers access to certain pages. User-agent: * Disallow: /References Disallow: /Cert Disallow: /Components Disallow: /Controls Disallow: /Customer Disallow: /Email Disallow: /Features Disallow: /Images Disallow: /Maintenance Disallow: /NPT Disallow: /Patterns/Controls Disallow: /POLMaint Disallow: /Popups Disallow: /Purchase Disallow: /Scripts Disallow: /SW