diff options
| author | Arthur <arthur@hoa.ro> | 2016-10-12 12:39:52 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2016-10-12 12:39:52 +0200 |
| commit | 24cfb960cfdd88255333bfb2a08d586916b460ae (patch) | |
| tree | f204fb8ba9e589d4e063c57da01716c487b6e891 /doc/Server-configuration.md | |
| parent | dc8e03bfc415d3771a45ccd324078a48b7466cbe (diff) | |
| parent | fdf88d194874a533cf3a8de3d317d70018aa8a62 (diff) | |
| download | Shaarli-24cfb960cfdd88255333bfb2a08d586916b460ae.tar.gz Shaarli-24cfb960cfdd88255333bfb2a08d586916b460ae.tar.zst Shaarli-24cfb960cfdd88255333bfb2a08d586916b460ae.zip | |
Merge pull request #656 from ArthurHoaro/v0.8.0v0.8.0
Bump version to v0.8.0
Diffstat (limited to 'doc/Server-configuration.md')
| -rw-r--r-- | doc/Server-configuration.md | 12 |
1 files changed, 0 insertions, 12 deletions
diff --git a/doc/Server-configuration.md b/doc/Server-configuration.md index fd98a608..1ab57a0a 100644 --- a/doc/Server-configuration.md +++ b/doc/Server-configuration.md | |||
| @@ -334,15 +334,3 @@ http { | |||
| 334 | } | 334 | } |
| 335 | } | 335 | } |
| 336 | ``` | 336 | ``` |
| 337 | |||
| 338 | ## Restricting search engines and web crawler traffic | ||
| 339 | |||
| 340 | Creating a `robots.txt` witht he following contents at the root of your Shaarli installation will prevent "honest" web crawlers from indexing each and every link and Daily page from a Shaarli instance, thus getting rid of a certain amount of unsollicited network traffic. | ||
| 341 | |||
| 342 | ``` | ||
| 343 | User-agent: * | ||
| 344 | Disallow: / | ||
| 345 | ``` | ||
| 346 | |||
| 347 | See: http://www.robotstxt.org/, http://www.robotstxt.org/robotstxt.html, http://www.robotstxt.org/meta.html | ||
| 348 | |||