User-agent: * Disallow: /_files/ Disallow: /_library/ Disallow: /dev/ Disallow: /downloads/ Disallow: /api/ Disallow: /grab/