User-agent: * Disallow: /contests/ User-agent: Twitterbot Disallow: