User-agent: Slurp
Disallow: /
 
 
User-agent: baiduspider
Disallow: /

 
User-agent: sogou spider
Disallow: /