From 49445ffb734b0ae9143482d82c1548d0763716c3 Mon Sep 17 00:00:00 2001 From: Cadence Ember Date: Wed, 18 May 2022 00:13:21 +1200 Subject: [PATCH] Add /tv/ and /reel/ to robots.txt Prevent search engine crawling of instances, just like how /p/ is already in robots.txt. --- src/site/html/robots.txt | 2 ++ 1 file changed, 2 insertions(+) diff --git a/src/site/html/robots.txt b/src/site/html/robots.txt index 42d71c3..8cb405b 100644 --- a/src/site/html/robots.txt +++ b/src/site/html/robots.txt @@ -1,5 +1,7 @@ User-Agent: * Disallow: /u/ Disallow: /p/ +Disallow: /tv/ +Disallow: /reel/ Disallow: /fragment/ Disallow: /api/