SciPost Code Repository

Skip to content
Snippets Groups Projects
Commit 3a9cd28f authored by George Katsikas's avatar George Katsikas :goat:
Browse files

chore: :wrench: block Apple's LLM training bot

parent 6bb1748b
No related branches found
No related tags found
No related merge requests found
Hide whitespace changes
Inline Side-by-side
Showing
with 4 additions and 0 deletions
robots.txt
+ 4
− 0
View file @ 3a9cd28f
...@@ -4,5 +4,9 @@ Crawl-Delay: 10 ...@@ -4,5 +4,9 @@ Crawl-Delay: 10
User-agent: BLEXBot User-agent: BLEXBot
Disallow: / Disallow: /
# Block Apple from training LLM models on our content
User-agent: Applebot-Extended
Disallow: /
User-Agent: * User-Agent: *
Disallow: /search Disallow: /search
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment

SciPost Code Repository