Skip to content

Commit 48f5c61

Browse files
committed
Add robots.txt file for better search engine indexing
1 parent 6548a0c commit 48f5c61

File tree

1 file changed

+5
-4
lines changed

1 file changed

+5
-4
lines changed

www/robots.txt

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,8 @@
11
User-agent: *
22
Allow: /
3-
Sitemap: https://jedisct1.github.io/draft-denis-ipcrypt/sitemap.xml
43

5-
# Disallow any potential development or test pages
6-
Disallow: /dev/
7-
Disallow: /test/
4+
# Allow all crawlers to access all content
5+
Disallow:
6+
7+
# Sitemap location
8+
Sitemap: https://ipcrypt-std.github.io/sitemap.xml

0 commit comments

Comments
 (0)