Newer
Older
User-agent: AhrefsBot
Crawl-Delay: 10
# Block Apple from training LLM models on our content
User-agent: Applebot-Extended
Disallow: /
SciPost Code Repository
User-agent: AhrefsBot
Crawl-Delay: 10
# Block Apple from training LLM models on our content
User-agent: Applebot-Extended
Disallow: /
SciPost Code Repository