diff options
| author | Ismaël Bouya <ismael.bouya@normalesup.org> | 2024-04-26 10:51:33 +0200 |
|---|---|---|
| committer | Ismaël Bouya <ismael.bouya@normalesup.org> | 2024-04-26 10:51:33 +0200 |
| commit | f2f414a2e9b02d645acb49f62fdfcceb8eca7d19 (patch) | |
| tree | 8ac0077b31ffd8f3c752baded25931c56df75dec /public/robots.txt | |
| parent | af6db21ee92824ddd9c4b9574018789619326ffc (diff) | |
| download | homer-f2f414a2e9b02d645acb49f62fdfcceb8eca7d19.tar.gz homer-f2f414a2e9b02d645acb49f62fdfcceb8eca7d19.tar.zst homer-f2f414a2e9b02d645acb49f62fdfcceb8eca7d19.zip | |
Craw delay for robotsgitolite_local/local_changes
Diffstat (limited to 'public/robots.txt')
| -rw-r--r-- | public/robots.txt | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/public/robots.txt b/public/robots.txt index eb05362..c3f8b9c 100644 --- a/public/robots.txt +++ b/public/robots.txt | |||
| @@ -1,2 +1,3 @@ | |||
| 1 | User-agent: * | 1 | User-agent: * |
| 2 | Disallow: | 2 | Disallow: |
| 3 | Crawl-Delay: 10 | ||