Block crawlers

git-svn-id: file:///srv/svn/repo/marisa/trunk@17 d6811dac-2434-b64a-9ddc-f563ab233461
2021-10-18 14:59:35 +00:00
parent aa2e69f744
commit bcd3bb0b13
2 changed files with 3 additions and 0 deletions
--- a/static/robots.txt
+++ b/static/robots.txt
@@ -0,0 +1,2 @@
+User-Agent: *
+Disallow: /