| Name | Last modified | Size | Description | |
|---|---|---|---|---|
| Parent Directory | - | |||
| Headers.txt | 2024-03-13 02:30 | 208 | ||
| Headers.json | 2024-03-13 02:30 | 230 | ||
| Exclusions.txt | 2024-03-13 02:30 | 620 | ||
| Exclusions.json | 2024-03-13 02:30 | 771 | ||
| Crawlers.txt | 2024-03-13 02:30 | 15K | ||
| Crawlers.json | 2025-09-30 17:08 | 18K | ||