bibliogram/src/site/html/robots.txt

8 lines
111 B
Plaintext

User-Agent: *
Disallow: /u/
Disallow: /p/
Disallow: /tv/
Disallow: /reel/
Disallow: /fragment/
Disallow: /api/