diff options
author | ArthurHoaro <arthur@hoa.ro> | 2016-10-12 12:36:59 +0200 |
---|---|---|
committer | ArthurHoaro <arthur@hoa.ro> | 2016-11-05 14:29:52 +0100 |
commit | 4fd053d6b29a1b6724eda17a3daddb29b1bf1ca3 (patch) | |
tree | 0c4eb7f990e6bc20e711c12e203a7b734bfbf7b0 /doc/Server-configuration.md | |
parent | 055deb9cbc4cb32c4e9a5edcd77be23844a3f917 (diff) | |
download | Shaarli-4fd053d6b29a1b6724eda17a3daddb29b1bf1ca3.tar.gz Shaarli-4fd053d6b29a1b6724eda17a3daddb29b1bf1ca3.tar.zst Shaarli-4fd053d6b29a1b6724eda17a3daddb29b1bf1ca3.zip |
Bump version to v0.8.0
Signed-off-by: ArthurHoaro <arthur@hoa.ro>
Diffstat (limited to 'doc/Server-configuration.md')
-rw-r--r-- | doc/Server-configuration.md | 12 |
1 files changed, 0 insertions, 12 deletions
diff --git a/doc/Server-configuration.md b/doc/Server-configuration.md index fd98a608..1ab57a0a 100644 --- a/doc/Server-configuration.md +++ b/doc/Server-configuration.md | |||
@@ -334,15 +334,3 @@ http { | |||
334 | } | 334 | } |
335 | } | 335 | } |
336 | ``` | 336 | ``` |
337 | |||
338 | ## Restricting search engines and web crawler traffic | ||
339 | |||
340 | Creating a `robots.txt` witht he following contents at the root of your Shaarli installation will prevent "honest" web crawlers from indexing each and every link and Daily page from a Shaarli instance, thus getting rid of a certain amount of unsollicited network traffic. | ||
341 | |||
342 | ``` | ||
343 | User-agent: * | ||
344 | Disallow: / | ||
345 | ``` | ||
346 | |||
347 | See: http://www.robotstxt.org/, http://www.robotstxt.org/robotstxt.html, http://www.robotstxt.org/meta.html | ||
348 | |||