# Allows all robots to visit all files. User-agent: * Crawl-delay: 2 Disallow: *buyer Disallow: *target Disallow: *all