User-agent: Mediapartners-Google Disallow: User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ # BEGIN W3TC ROBOTS User-agent: * Disallow: /wp-content/cache/ # END W3TC ROBOTS