# /robots.txt file for http://www.sidereel.com # Updated 03/02/2017 # mail webmaster@sidereel.com for help # User-agent lists the agent, Disallow lists what agents can't touch # Updated list of robots: http://www.robotstxt.org/wc/active/html/index.html SITEMAP: https://www.sidereel.com/sitemap.xml User-agent: * Disallow: /users Disallow: /tracker Disallow: /admin Disallow: /living_room Disallow: /api Disallow: /fragments Disallow: /facebook Disallow: /newrelic Disallow: /users/calendar Disallow: /22732481 Disallow: /_television/search Disallow: /search? Disallow: /posts/web-news Disallow: /posts/users Disallow: /profile/you/ Disallow: /topic/cookies Disallow: /topic/cookie-policy Disallow: /*=$ Allow: /users/leaderboards Allow: /users/leaderboards/power-raters Allow: /users/leaderboards/power-reviewers Allow: /users/leaderboards/power-watchers Allow: /users/leaderboards/power-trackers Allow: /users/sign-up Allow: /users/staff-activity Allow: /tracker-