SciPost Code Repository
Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
SciPost
Manage
Activity
Members
Labels
Plan
Issues
119
Issue boards
Milestones
Iterations
Wiki
Requirements
Code
Merge requests
0
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Locked files
Build
Pipelines
Jobs
Pipeline schedules
Test cases
Artifacts
Deploy
Releases
Package Registry
Container Registry
Model registry
Operate
Environments
Terraform modules
Monitor
Incidents
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Code review analytics
Issue analytics
Insights
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
SciPost
SciPost
Commits
master
Select Git revision
Branches
20
master
default
protected
dev_GK_20250219_django5.2_python3.13
dev_GK_20250311_API_subsidypayments
dev_GK_20250305_topic_interests
dev_GK_20250108_object_merger
dev_GK_20250221_containerize_app
dev_GK_20250205_faster_referee_table_no_distinct
dev_GK_20250205_faster_referee_table
dev_GK_20250120_complete_graphs_v1
staging
dev_GK_20241211_tasks_app
dev_GK_20241125_group_and_research_subsidy
dev_GK_20241030_graphs
dev_GK_20240927_submission_autorejection
dev_GK_20241003_donation_banner
dev_TK_20240722_Publication-Tools_candidate
dev_TK_20240722_Publication-Tools
dev_GK_20240529_referee_indications
dev_GK_20231005_factories
dev_GK_20231204_ORCID
Tags
6
2024.12-01
2023.04-01
v2.2
v2.0
v1.1
v1.0
26 results
SciPost
robots.txt
Author
Search by author
Any Author
authors
Aran Dolan
aran_dolan
Francesca Ferrari
fferrari
George Katsikas
gkatsikas
Jean-Sébastien Caux
jscaux
Jorran de Wit
jorrandewit
Lyle Simpson
lsimps204
Matteo Gamboz
gamboz
Sergio Enrique Tapias Arze
s.e.tapiasarze
8 authors
Feb 17, 2025
chore:
block Apple's LLM training bot
· 3a9cd28f
George Katsikas
authored
3 weeks ago
3a9cd28f
Jun 15, 2021
Tweak robots.txt
· 13d62ac4
Jean-Sébastien Caux
authored
3 years ago
13d62ac4
Apr 18, 2021
Add crawl-delay to ahrefs bot
· db4a48bb
Jean-Sébastien Caux
authored
3 years ago
db4a48bb
May 08, 2019
Add robots.txt
· 18b21ca2
Jean-Sébastien Caux
authored
5 years ago
18b21ca2
Loading