Prevent demos being indexed

csswizardry · csswizardry · commit 904a650faf46 · 2025-05-29T18:16:09.000+01:00
diff --git a/robots.txt b/robots.txt
@@ -1,5 +1,6 @@
 User-agent: *
 Allow: /
+Disallow: /demos/
 
 # Block AI bots from accessing articles for training purposes.
 #

Original file line number	Diff line number	Diff line change
`@@ -1,5 +1,6 @@`
`1`	`1`	`User-agent: *`
`2`	`2`	`Allow: /`
	`3`	`+Disallow: /demos/`
`3`	`4`
`4`	`5`	`# Block AI bots from accessing articles for training purposes.`
`5`	`6`	`#`