diff options
| author | Daniel Micay <danielmicay@gmail.com> | 2020-02-28 23:15:05 -0500 |
|---|---|---|
| committer | Daniel Micay <danielmicay@gmail.com> | 2020-02-28 23:15:05 -0500 |
| commit | 42eb826200449e3e0afb2dea743918e11e8b2286 (patch) | |
| tree | c1a6c556263f7ffb2515394e2f832043054a4e41 /static/robots.txt | |
| parent | 7a6b36d26061b6f8e3ee64f59bf7ce91def10ba7 (diff) | |
disallow bots from crawling generate_204 service
Diffstat (limited to 'static/robots.txt')
| -rw-r--r-- | static/robots.txt | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/static/robots.txt b/static/robots.txt index 7cc35dc7..ada7b7cc 100644 --- a/static/robots.txt +++ b/static/robots.txt @@ -1,2 +1,4 @@ User-agent: * Sitemap: https://grapheneos.org/sitemap.xml + +Disallow: /generate_204 |