# Tells Scanning Robots Where They Are And Are Not Welcome # User-agent: can also specify by name; "*" is for everyone # Disallow: if this matches first part of requested path, forget it. User-agent: * # applies to all robots Disallow: /images Disallow: /php Disallow: /logs Disallow: /flash Disallow: /javascript Disallow: /site_db Disallow: /topmenu Disallow: /user_db Disallow: /test Disallow: /admin