Download as
Browse Code »

Commit 975356ed04970f16abc0b0db6d083e7f749214c3

Authored by Rodrigo Souto
2 parents 8bdb20a5 73524559
Exists in master and in 22 other branches angular_poc, api-article-archived, article-readonly, backup-7-jan-2016, captcha_serpro_plugin, content-manager-hostspot, export-comment-paragraph, fix_event_date_issue, login-captcha, master_rails3, new_video_plugin, pg_search_rank, production, refactor_with_role, refactor_with_role_scope, remove_profile_cat_icons, resend_confirmation_email, staging, staging_rails3, tasks_keep_filter_params, theme-brasil-digital-from-staging, travis

Merge branch 'stable' of gitlab.com:noosfero/noosfero into stable

Showing 1 changed file with 7 additions and 1 deletions   Show diff stats
public/robots.txt
  Diff comments   View file @975356e
1   -# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
2 1 \ No newline at end of file
  2 +# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  3 +# See also http://en.wikipedia.org/wiki/Robots_exclusion_standard for extensions
  4 +
  5 +User-agent: *
  6 +# block searches' queries
  7 +Disallow: /search*query=*
  8 +Disallow: /cat/*
... ...