urllib.robotparser misbehave in the case of Disallow crawling of the whole site except a subdirectory #50839
Triggered via issue
September 4, 2025 18:20
serhiy-storchaka
Status
Success
Total duration
8s
Artifacts
–