]> git.immae.eu Git - github/wallabag/wallabag.git/commitdiff
Updated robots.txt to prevent crawling 3510/head
authorNicolas Lœuillet <nicolas@loeuillet.org>
Fri, 15 Dec 2017 20:51:12 +0000 (21:51 +0100)
committerNicolas Lœuillet <nicolas@loeuillet.org>
Fri, 15 Dec 2017 20:51:12 +0000 (21:51 +0100)
web/robots.txt

index 214e4119653f9c6a4c48cd0ebb06a6754f00f62b..1f53798bb4fe33c86020be7f10c44f29486fd190 100644 (file)
@@ -1,4 +1,2 @@
-# www.robotstxt.org/
-# www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
-
 User-agent: *
+Disallow: /