User-agent: * Crawl-Delay: 20 Allow: mw/modules Disallow: mw/modules/initialize Disallow: mw/cache Disallow: mw/config Disallow: mw/controllers Disallow: mw/core Disallow: mw/errors Disallow: mw/helpers Disallow: mw/hooks Disallow: mw/language Disallow: mw/libraries Disallow: mw/logs Disallow: mw/models Disallow: mw/scripts Disallow: mw/themes Disallow: mw/third_party Disallow: mw/views Disallow: system