Commit Graph

6 Commits

Author SHA1 Message Date
syeopite
92b04a30f3
Prevent indexing of Invidious instances (#2420)
Closes #2418
2021-09-22 01:29:51 +02:00
Paul Braeuning
e38b602b7d Disallow /watch path for bots again 2021-06-14 10:40:59 +02:00
Omar Roth
6c19f0f242 Revert "Update robots.txt"
This reverts commit b26b6b9bdf.
2018-11-08 00:41:03 -06:00
Omar Roth
b26b6b9bdf Update robots.txt 2018-11-06 23:13:31 -06:00
Omar Roth
5df7c43e5d Ignore login in robots.txt 2018-03-24 23:15:03 -05:00
Omar Roth
d88b60979b Add robots.txt 2018-02-05 18:11:59 -06:00