# All robots will spider the domain User-agent: * User-agent: Mediapartners-Google* User-agent: Googlebot* Disallow: