iptv-org-mirror/iptv-org.github.io
1
0
Fork 0
mirror of https://github.com/iptv-org/iptv-org.github.io.git synced 2025-05-11 17:40:05 -04:00
Code Issues Projects Releases Packages Wiki Activity Actions

Block IP violation scanners.

Browse source
This commit is contained in:
cute 2025-02-07 04:51:36 +00:00 • committed by GitHub
parent e775b8aa9f
commit 17672e2c93
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 22 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

21
static/robots.txt
View file

@ -1,4 +1,25 @@
User-agent: *
Allow: /
User-Agent: TurnitinBot
Disallow: /
User-Agent: NPBot
Disallow: /
User-Agent: AcademicBotRTU
Disallow: /
User-Agent: SlySearch
Disallow: /
User-Agent: BLEXBot
Disallow: /
User-agent: CheckMarkNetwork/1.0 (+https://www.checkmarknetwork.com/spider.html)
Disallow: /
User-agent: BrandVerity/1.0
Disallow: /
Sitemap: https://iptv-org.github.io/sitemap.xml