User-agent: *
Disallow: /directory
Disallow: /stats
Crawl-Delay:30

User-agent: Mediapartners-Google* 
Disallow