From: Nicolas Lœuillet <nicolas@loeuillet.org>
Date: Fri, 15 Dec 2017 20:51:12 +0000 (+0100)
Subject: Updated robots.txt to prevent crawling
X-Git-Tag: 2.3.1~12^2
X-Git-Url: https://git.immae.eu/?a=commitdiff_plain;h=e4ae6b976fbccb5fff7f03e97b6cf33704328e16;hp=a68a80f654be86ae25d49420b86099302ce55bb6;p=github%2Fwallabag%2Fwallabag.git

Updated robots.txt to prevent crawling
---

diff --git a/web/robots.txt b/web/robots.txt
index 214e4119..1f53798b 100644
--- a/web/robots.txt
+++ b/web/robots.txt
@@ -1,4 +1,2 @@
-# www.robotstxt.org/
-# www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
-
 User-agent: *
+Disallow: /