List of Robots Ordered by Robot (Visits)
Click Here For: Agent Switchboard
Change Order:
Order by robot name
Show values as percent
| Browser | 2611 Nov |
2610 Oct |
2609 Sep |
2608 Aug |
2607 Jul |
2606 Jun |
2605 May |
2604 Apr |
2603 Mar |
2602 Feb |
2601 Jan |
2512 Dec |
| Custom scraper | 2438 | 1479 | 1039 | 842 | 60 | 86 | 27 | 9 | 16 | 1 | 3 | 0 |
| Baiduspider | 1107 | 5694 | 962 | 566 | 117 | 142 | 104 | 145 | 166 | 169 | 470 | 0 |
| SemrushBot | 981 | 2212 | 2458 | 2440 | 2317 | 1991 | 1851 | 1622 | 684 | 498 | 772 | 812 |
| bingbot | 759 | 1979 | 1197 | 438 | 454 | 413 | 396 | 237 | 369 | 477 | 459 | 598 |
| Suspicious Bot | 611 | 4637 | 2796 | 758 | 385 | 217 | 159 | 71 | 250 | 199 | 291 | 168 |
| unknown crawler | 527 | 1875 | 5448 | 2632 | 1687 | 548 | 613 | 580 | 792 | 487 | 665 | 715 |
| Amazonbot | 505 | 1560 | 1701 | 4980 | 775 | 1163 | 1779 | 3884 | 2331 | 1904 | 1977 | 2021 |
| ExaSearchBot | 449 | 650 | 23 | 4 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| MJ12bot | 214 | 262 | 234 | 317 | 308 | 320 | 264 | 300 | 308 | 182 | 240 | 230 |
| Googlebot | 139 | 322 | 296 | 343 | 309 | 324 | 354 | 391 | 284 | 264 | 235 | 246 |
| Infrawatch | 94 | 163 | 88 | 170 | 163 | 137 | 153 | 68 | 0 | 0 | 0 | 0 |
| Palo Alto Cortex Xpanse | 93 | 220 | 272 | 243 | 247 | 232 | 265 | 225 | 197 | 153 | 172 | 150 |
| ClueWeb-Crawler | 83 | 25 | 0 | 5 | 3 | 2 | 0 | 0 | 0 | 0 | 0 | 0 |
| Censys | 68 | 148 | 149 | 162 | 142 | 145 | 152 | 151 | 79 | 61 | 71 | 69 |
| unknown | 61 | 44 | 101 | 91 | 92 | 71 | 56 | 34 | 26 | 44 | 51 | 28 |
| Baiduspider | 47 | 152 | 117 | 75 | 35 | 38 | 6 | 20 | 48 | 42 | 93 | 0 |
| ClaudeBot | 46 | 59 | 66 | 103 | 91 | 88 | 82 | 61 | 93 | 87 | 90 | 98 |
| SperidLabsResearchCrawler | 46 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| python-requests | 44 | 100 | 104 | 160 | 121 | 97 | 99 | 107 | 86 | 77 | 81 | 107 |
| RiverBot | 41 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| AhrefsBot | 37 | 240 | 233 | 283 | 47 | 46 | 44 | 107 | 100 | 186 | 140 | 105 |
| curl | 33 | 138 | 124 | 135 | 163 | 161 | 200 | 102 | 20 | 14 | 20 | 22 |
| facebookexternalhit | 24 | 1 | 0 | 1 | 0 | 0 | 1 | 1 | 2 | 0 | 0 | 1 |
| VisionHeight | 24 | 43 | 49 | 68 | 75 | 67 | 76 | 78 | 47 | 25 | 0 | 0 |
| CyberConvoy | 16 | 18 | 35 | 36 | 33 | 14 | 0 | 0 | 0 | 0 | 0 | 0 |
| GenomeCrawler | 16 | 44 | 28 | 29 | 28 | 39 | 12 | 5 | 18 | 7 | 0 | 0 |
| tphotobot | 15 | 52 | 270 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| SERankingBacklinksBot | 14 | 3 | 28 | 60 | 3 | 29 | 72 | 62 | 51 | 14 | 36 | 20 |
| ApcosysBot | 14 | 35 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| T2Bot | 12 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| ElevenlabsCrawler | 11 | 587 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| SofyaBot | 11 | 22 | 2 | 12 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| GPTBot | 9 | 13 | 15 | 25 | 32 | 38 | 40 | 29 | 13 | 19 | 10 | 22 |
| NVBot | 9 | 6 | 4 | 1 | 2 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| PerplexityBot | 8 | 34 | 13 | 13 | 6 | 11 | 5 | 5 | 8 | 2 | 2 | 1 |
| AwarioBot | 8 | 15 | 0 | 3 | 15 | 10 | 0 | 0 | 7 | 22 | 14 | 3 |
| Orbbot | 8 | 9 | 7 | 7 | 1 | 8 | 0 | 2 | 1 | 0 | 0 | 3 |
| aiohttp | 8 | 7 | 6 | 82 | 5 | 5 | 1 | 11 | 4 | 14 | 32 | 316 |
| HaloBot | 8 | 6 | 0 | 5 | 0 | 3 | 0 | 0 | 2 | 3 | 3 | 0 |
| BizDirectBot | 8 | 4 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| ShapBot | 7 | 4 | 17 | 6 | 9 | 0 | 0 | 0 | 0 | 0 | 2 | 0 |
| wpbot | 6 | 12 | 10 | 10 | 9 | 10 | 12 | 11 | 9 | 5 | 5 | 4 |
| SEOJuice | 6 | 12 | 2 | 1 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| crawler | 4 | 58 | 26 | 80 | 25 | 18 | 14 | 17 | 6 | 5 | 16 | 4 |
| BitSightBot | 4 | 5 | 5 | 6 | 4 | 3 | 5 | 8 | 61 | 8 | 5 | 3 |
| FlowIQLabsBot | 3 | 5 | 1 | 100 | 134 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| OutlinkResearchBot | 3 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Apple Network | 3 | 6 | 2 | 3 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| SojournerBot | 3 | 6 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| SEMrushBot | 2 | 8 | 5 | 6 | 2 | 1 | 2 | 3 | 4 | 3 | 3 | 1 |
| DatasetCrawler | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Google-Display-Ads-Bot | 2 | 5 | 4 | 6 | 5 | 4 | 5 | 4 | 4 | 4 | 4 | 5 |
| CCBot | 2 | 5 | 9 | 6 | 9 | 8 | 11 | 6 | 5 | 5 | 4 | 6 |
| QueritBot | 2 | 10 | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| DataForSeoBot | 2 | 8 | 8 | 7 | 6 | 7 | 5 | 8 | 5 | 14 | 6 | 15 |
| 2ip Bot | 1 | 2 | 2 | 3 | 2 | 3 | 0 | 0 | 0 | 0 | 0 | 0 |
| MiIABot | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Scrapy | 1 | 3 | 2 | 50 | 140 | 59 | 3 | 2 | 0 | 0 | 0 | 0 |
| dns-crawler | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| DomainingBot | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| ZoominfoBot | 1 | 3 | 4 | 3 | 3 | 4 | 3 | 5 | 4 | 3 | 7 | 14 |
| NMMapper-ReconBot | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| DuckAssistBot | 1 | 19 | 40 | 3 | 0 | 0 | 0 | 0 | 2 | 0 | 0 | 0 |
| FacturDirectoryBot | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| TernCrawler | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| ChatGPT-User | 1 | 32 | 45 | 46 | 24 | 5 | 11 | 8 | 3 | 0 | 0 | 0 |
| webXtrendBot | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| rolltheweb-crawler | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| SQLSpider | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| MoonshotBot | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| MapTheNetBot | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| QlyzeBot | 1 | 2 | 4 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| PipericBot | 1 | 1 | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| LoadedBot | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| TLDWPBot | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Diffbot | 1 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| MonacoSearchBot | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| FirmableBot | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| HeadlessChrome | 1 | 6 | 241 | 104 | 138 | 10 | 10 | 18 | 3 | 7 | 11 | 0 |
| IsonSearchBot | 1 | 2 | 11 | 6 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| DomainStatsBot | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 1 | 0 |
| DotBot | 1 | 3 | 28 | 9 | 22 | 7 | 50 | 49 | 76 | 1 | 43 | 45 |
| SeznamBot | 1 | 0 | 11 | 13 | 12 | 5 | 9 | 11 | 5 | 1 | 5 | 5 |
| YandexBot | 0 | 80 | 203 | 200 | 56 | 239 | 592 | 353 | 410 | 643 | 385 | 427 |
| Ruhr Uni Research Bot | 0 | 68 | 6 | 5 | 0 | 0 | 0 | 0 | 7 | 12 | 0 | 0 |
| IbouBot | 0 | 14 | 1 | 66 | 0 | 0 | 0 | 0 | 3 | 114 | 178 | 181 |
| Java | 0 | 14 | 32 | 13 | 0 | 0 | 1 | 3 | 1 | 1 | 8 | 20 |
| VelenPublicWebCrawler | 0 | 11 | 1 | 1 | 10 | 0 | 0 | 1 | 0 | 0 | 0 | 0 |
| MochiImageCrawler | 0 | 8 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| MojeekBot | 0 | 6 | 4 | 2 | 4 | 1 | 2 | 4 | 5 | 12 | 17 | 16 |
| DuckDuckBot | 0 | 5 | 7 | 0 | 5 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| YouBot | 0 | 4 | 0 | 0 | 0 | 0 | 3 | 0 | 0 | 0 | 0 | 0 |
| ChakloonBot | 0 | 4 | 6 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| GrokBot | 0 | 3 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| KimiBot | 0 | 3 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| IntentBeamBot | 0 | 3 | 6 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Qwenbot | 0 | 3 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| ev-crawler | 0 | 3 | 4 | 3 | 5 | 4 | 5 | 6 | 5 | 5 | 4 | 5 |
| BeansLLM-CorpusBot | 0 | 3 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| StackDetectorBot | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| BarrigazBot | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| ReconBot | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| WebCrawler | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| CricketBot | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| TransfusionResearchBot | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| LanternBot | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| ImageMetaBot | 0 | 2 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 |
| EveryTabBot | 0 | 2 | 0 | 0 | 0 | 0 | 3 | 0 | 0 | 0 | 0 | 0 |
| AgentTrustBot | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| SurdotlyBot | 0 | 1 | 0 | 0 | 0 | 7 | 6 | 1 | 0 | 2 | 3 | 11 |
| UITResearchBot | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| LWP Script | 0 | 1 | 5 | 0 | 2 | 2 | 2 | 1 | 0 | 0 | 1 | 0 |
| BingPreview | 0 | 1 | 2 | 0 | 0 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
| SpamCipherBot | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Bytespider | 0 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| LuminaBot | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| SalesIntelBot | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Bravebot | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| InternetScan | 0 | 1 | 2 | 2 | 2 | 6 | 1 | 0 | 0 | 0 | 0 | 0 |
| VualetBot | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| OnlineShopsBot | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| EmployerRadarBot | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| opr-crawler | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| BrokenBacklinksBot | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| OI-Crawler | 0 | 1 | 0 | 1 | 1 | 0 | 1 | 1 | 0 | 0 | 0 | 0 |
| AbliterantBot | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| AstraBot | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| ChatGLM-Spider | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| LeadFinderBot | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| DeepSeekBot | 0 | 1 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 |
| webatlabot | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| IntercomDetectBot | 0 | 1 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 |
| TradieIntelBot | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| research-bot | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 | 0 | 0 |
| GoGuidesCrawler | 0 | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| DesearchBot | 0 | 1 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| LohiSoftBot | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Querit-SearchBot | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| TechLeadsBot | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| AonsightMetaBot | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Reflectionbot | 0 | 0 | 118 | 501 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| MathPicDatasetCrawler | 0 | 0 | 36 | 7 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| AffsignalCrawler | 0 | 0 | 15 | 42 | 17 | 9 | 1 | 0 | 0 | 0 | 0 | 0 |
| ImageBot | 0 | 0 | 10 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| GlobRadarBot | 0 | 0 | 8 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| ModatScanner | 0 | 0 | 3 | 38 | 34 | 26 | 33 | 26 | 19 | 11 | 11 | 15 |
| EtherdeckBot | 0 | 0 | 3 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| TerraCotta | 0 | 0 | 3 | 5 | 0 | 0 | 0 | 0 | 0 | 0 | 15 | 18 |
| LyonlBot | 0 | 0 | 3 | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| CFNetwork | 0 | 0 | 3 | 1 | 0 | 2 | 0 | 1 | 0 | 0 | 0 | 1 |
| W3C_Validator | 0 | 0 | 2 | 0 | 1 | 0 | 0 | 1 | 2 | 0 | 0 | 0 |
| MakeWebSalesBot | 0 | 0 | 2 | 4 | 3 | 3 | 5 | 2 | 0 | 0 | 0 | 0 |
| Python-urllib | 0 | 0 | 2 | 18 | 0 | 0 | 0 | 5 | 0 | 0 | 0 | 0 |
| AteveHostProfileBot | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| ASRbot | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| HurrbeeBot | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| serpstatbot | 0 | 0 | 1 | 0 | 0 | 0 | 1 | 0 | 1 | 0 | 0 | 1 |
| Discordbot | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| JobfinderBot | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| DomynResearchBot | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| ListSignalBot | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| SiteDiscoveryBot | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| SeargioBot | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| ABNWebsiteEnrichmentBot | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| t3versionsBot | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| TheduCrawler | 0 | 0 | 1 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 |
| FrogleBot | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| OKNextImporterBot | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| WanScannerBot | 0 | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1 |
| Knowknot | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| EMAIL-EU-Academic-Crawler | 0 | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| jscrawler | 0 | 0 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| FreePBX-Scanner | 0 | 0 | 1 | 6 | 5 | 13 | 5 | 4 | 7 | 3 | 8 | 38 |
| PublicWWWBot | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| NewsletterFormResearchBot | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| FirstSeenBot | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Wget | 0 | 0 | 1 | 3 | 0 | 0 | 2 | 1 | 0 | 11 | 6 | 12 |
| GeniusDataBot | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| yacybot | 0 | 0 | 0 | 26 | 2 | 0 | 1 | 0 | 0 | 1 | 1 | 0 |
| WordPress | 0 | 0 | 0 | 18 | 0 | 4 | 0 | 0 | 0 | 0 | 0 | 0 |
| CriteoBot | 0 | 0 | 0 | 16 | 56 | 28 | 33 | 49 | 30 | 11 | 8 | 1 |
| Shodan | 0 | 0 | 0 | 10 | 7 | 85 | 65 | 18 | 13 | 1 | 0 | 1 |
| txtbot | 0 | 0 | 0 | 9 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| GoogleBot | 0 | 0 | 0 | 8 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| OAI-SearchBot | 0 | 0 | 0 | 7 | 1 | 1 | 3 | 0 | 0 | 0 | 0 | 0 |
| archive.org_bot | 0 | 0 | 0 | 7 | 3 | 0 | 0 | 0 | 0 | 0 | 0 | 2 |
| Amzn-SearchBot | 0 | 0 | 0 | 6 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| SearchEngineBot | 0 | 0 | 0 | 3 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| FlowBot | 0 | 0 | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Timpibot | 0 | 0 | 0 | 2 | 0 | 6 | 10 | 10 | 8 | 0 | 0 | 0 |
| WarmerlyBot | 0 | 0 | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| HUNT-Bot | 0 | 0 | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| SBIntuitionsBot | 0 | 0 | 0 | 2 | 0 | 0 | 0 | 0 | 2 | 7 | 6 | 7 |
| VLM Fetcher | 0 | 0 | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| ConceptBurstBot | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Claude-SearchBot | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| NagetBot | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| TechSpyBot | 0 | 0 | 0 | 1 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| WebatlaBot | 0 | 0 | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Applebot | 0 | 0 | 0 | 1 | 1 | 1 | 2 | 0 | 0 | 0 | 0 | 0 |
| eManagerBot | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| osentix-crawler | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| SwokeiBot | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| BusinessVerify | 0 | 0 | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| ProxyWingPublicContactCrawler | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| WhoisSectorBot | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| SeedBot | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| PisarBot | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| TurnitinBot | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| BundlabsBot | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| ReflectionBot | 0 | 0 | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| TelegramBot | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| WebCorpusBot | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| AliyunSecBot | 0 | 0 | 0 | 0 | 2 | 2 | 2 | 0 | 2 | 4 | 45 | 31 |
| heritrix | 0 | 0 | 0 | 0 | 2 | 0 | 3 | 0 | 0 | 0 | 0 | 0 |
| DataDingoBot | 0 | 0 | 0 | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 |
| MetaCrawler | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| RankPulseBot | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| MeasureboardResearchBot | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| awi-research-crawler | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| RankzonBot | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| smdb-crawler | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| GeoGraphBot | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| SitemapResearchBot | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| tranco-crawler | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| ReyilBot | 0 | 0 | 0 | 0 | 0 | 27 | 0 | 0 | 0 | 0 | 0 | 0 |
| Spider | 0 | 0 | 0 | 0 | 0 | 14 | 0 | 9 | 2 | 0 | 0 | 0 |
| Exabot | 0 | 0 | 0 | 0 | 0 | 4 | 17 | 16 | 0 | 0 | 0 | 1 |
| FetchDonkeyBot | 0 | 0 | 0 | 0 | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 0 |
| gwf-carbon-txt-crawler | 0 | 0 | 0 | 0 | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 0 |
| SiteAnalyzerbot | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 |
| CCMetaBot | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 |
| SaaSBrowserBot | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 1 | 0 | 0 | 0 |
| ProductLookoutBot | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 1 | 0 | 0 | 0 |
| PricedroneShoppingBot | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 |
| TenMillionDomainsBot | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 |
| INETDEX-BOT | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 |
| BrokenLinksBot | 0 | 0 | 0 | 0 | 0 | 0 | 24 | 24 | 0 | 0 | 0 | 0 |
| WebTrackrCrawler | 0 | 0 | 0 | 0 | 0 | 0 | 19 | 1 | 0 | 0 | 0 | 0 |
| ContactGraphBot | 0 | 0 | 0 | 0 | 0 | 0 | 3 | 1 | 0 | 0 | 0 | 0 |
| xAI-SearchBot | 0 | 0 | 0 | 0 | 0 | 0 | 2 | 0 | 0 | 0 | 0 | 0 |
| ris-bot | 0 | 0 | 0 | 0 | 0 | 0 | 2 | 0 | 0 | 0 | 0 | 0 |
| TobavaBot | 0 | 0 | 0 | 0 | 0 | 0 | 2 | 1 | 0 | 0 | 0 | 0 |
| FeedFetcher-Google | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 |
| Thinkbot | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 1 | 2 | 1 |
| Brightbot | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 |
| cis5550-crawler | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 |
| CohereBot | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 |
| research-crawler | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 | 0 | 0 | 0 | 0 |
| ZeroBot | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 | 0 | 0 | 0 | 0 |
| MineBot | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 | 0 | 0 | 0 | 0 |
| EECS498-CELSearchEngineCrawler | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 | 0 | 0 | 0 | 0 |
| FacebookBot | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 |
| UMichSearchEngineCrawler | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 |
| MyWebCrawler | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 |
| Proximic Spider | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 1 | 0 | 0 | 0 |
| Xenu Link Sleuth | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 |
| vague-crawler | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 |
| BingIndexCrawler | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 5 | 2 | 0 | 0 |
| YandexRenderResourcesBot | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 | 0 | 0 | 3 |
| HenkBot | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 | 0 | 0 | 0 |
| research crawler | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 | 0 | 0 | 0 |
| YahooBot | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 1 |
| TechCrawler | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 |
| IABot | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 |
| DirectoryBot | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 |
| ResearchBot | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 |
| msnbot | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 |
| expo-research-bot | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 68 | 0 |
| Google Web Preview | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 |
| Ask Jeeves | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 |
| BLEXBot | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 |
| browse-crawler | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 |
| Facebot | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 |
| Total | 8725 | 23364 | 18866 | 16624 | 8503 | 7088 | 7813 | 9012 | 6727 | 5853 | 6808 | 6635 |

