Lomanic/bibliogram
1
0
Fork 0
mirror of https://git.sr.ht/~cadence/bibliogram synced 2024-11-16 05:07:29 +00:00
Code Issues Releases Wiki Activity

Add /tv/ and /reel/ to robots.txt

Browse Source 
Prevent search engine crawling of instances, just like how /p/ is
already in robots.txt.
This commit is contained in:
Cadence Ember 2022-05-18 00:13:21 +12:00
parent 50f509742e
commit 49445ffb73
No known key found for this signature in database
GPG Key ID: BC1C2C61CF521B17
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/site/html/robots.txt
View File

@ -1,5 +1,7 @@
User-Agent: *
Disallow: /u/
Disallow: /p/
Disallow: /tv/
Disallow: /reel/
Disallow: /fragment/
Disallow: /api/