PGTS PGTS Pty. Ltd.   ACN: 007 008 568

point Site Navigation



   Stop Spam! Stop Viruses!
   Secure And Reliable Ubuntu Desktop!

   Ubuntu

   If you own a netbook/laptop~
   Download Ubuntu Netbook!







Last Updated: 17-Oct-2010 14:21 UTC

List of Robots Ordered by Robot (Visits)


Click Here For:    Agent Switchboard

Change Order:   Order by robot name     Show values as percent


Browser Aug Jul Jun May Apr Mar Feb Jan Dec Nov Oct Sep
SemrushBot 685 2317 1991 1851 1622 684 498 772 812 655 366 650
unknown crawler 224 2039 923 855 906 1116 725 1038 1015 1027 641 918
MJ12bot 109 308 320 264 300 308 182 240 230 275 159 153
Googlebot 102 309 324 354 391 284 264 235 246 235 230 161
python-requests 97 121 97 99 107 86 77 81 107 51 140 120
Baiduspider 71 117 142 104 145 166 169 470 0 1 6 1
curl 54 163 161 200 102 20 14 20 22 25 36 19
SERankingBacklinksBot 27 3 29 72 62 51 14 36 20 0 0 0
AhrefsBot 19 47 46 44 107 100 186 140 105 35 31 41
Baiduspider 14 35 38 6 20 48 42 93 0 0 7 5
YandexBot 13 56 239 592 353 410 643 385 427 366 308 323
Python-urllib 11 0 0 0 5 0 0 0 0 0 6 2
txtbot 9 0 0 0 0 0 0 0 0 0 0 0
AffsignalCrawler 8 17 9 1 0 0 0 0 0 0 0 0
FlowIQLabsBot 8 134 0 0 0 0 0 0 0 0 0 0
CriteoBot 7 56 28 33 49 30 11 8 1 4 5 2
GenomeCrawler 6 28 39 12 5 18 7 0 0 0 0 0
Orbbot 6 1 8 0 2 1 0 0 3 0 12 3
SeznamBot 6 12 5 9 11 5 1 5 5 5 4 3
ClueWeb-Crawler 5 3 2 0 0 0 0 0 0 0 0 0
HaloBot 5 0 3 0 0 2 3 3 0 0 2 2
archive.org_bot 5 3 0 0 0 0 0 0 2 7 0 0
DotBot 4 22 7 50 49 76 1 43 45 17 27 22
CCBot 4 9 8 11 6 5 5 4 6 17 6 5
crawler 4 25 18 14 17 6 5 16 4 1 15 4
AwarioBot 3 15 10 0 0 7 22 14 3 22 6 18
SEMrushBot 2 2 1 2 3 4 3 3 1 2 1 1
Google-Display-Ads-Bot 2 5 4 5 4 4 4 4 5 5 5 4
MojeekBot 2 4 1 2 4 5 12 17 16 15 30 35
Amzn-SearchBot 1 0 0 0 0 0 0 0 0 0 0 0
facebookexternalhit 1 0 0 1 1 2 0 0 1 0 0 0
OAI-SearchBot 1 1 1 3 0 0 0 0 0 0 0 0
bingbot 1 1 1 4 0 0 0 0 0 1 0 0
ev-crawler 1 5 4 5 6 5 5 4 5 3 7 2
SearchEngineBot 1 0 0 0 0 0 0 0 0 0 0 0
ReflectionBot 1 1 0 0 0 0 0 0 0 0 0 0
DeepSeekBot 1 0 0 1 0 0 0 0 0 0 0 0
WebCorpusBot 1 0 0 0 0 0 0 0 0 0 0 0
jscrawler 1 1 0 0 0 0 0 0 0 0 0 0
CFNetwork 1 0 2 0 1 0 0 0 1 2 2 0
QueritBot 1 0 0 0 0 0 0 0 0 0 0 0
Amazonbot 1 0 1 0 1 0 0 0 0 0 0 0
NagetBot 1 0 0 0 0 0 0 0 0 0 0 0
ZoominfoBot 1 3 4 3 5 4 3 7 14 13 15 14
PerplexityBot 1 0 2 2 0 0 0 0 0 0 0 0
ClaudeBot 1 0 1 2 0 0 0 0 0 0 0 0
ConceptBurstBot 1 0 0 0 0 0 0 0 0 0 0 0
MakeWebSalesBot 1 3 3 5 2 0 0 0 0 0 0 0
unknown 1 6 6 9 4 5 3 3 3 3 97 717
ExaSearchBot 1 0 0 0 0 0 0 0 0 0 0 0
VelenPublicWebCrawler 0 10 0 0 1 0 0 0 0 1 1 0
wpbot 0 9 10 12 11 9 5 5 4 4 4 4
DataForSeoBot 0 6 7 5 8 5 14 6 15 7 9 8
DuckDuckBot 0 5 1 1 0 0 0 0 0 0 0 0
yacybot 0 2 0 1 0 0 1 1 0 0 2 0
LWP Script 0 2 2 2 1 0 0 1 0 1 2 1
NVBot 0 2 1 1 0 0 0 0 0 0 0 0
AliyunSecBot 0 2 2 2 0 2 4 45 31 0 18 31
TechSpyBot 0 2 0 0 0 0 0 0 0 0 0 0
LyonlBot 0 2 0 0 0 0 0 0 0 0 0 0
heritrix 0 2 0 3 0 0 0 0 0 0 0 0
tranco-crawler 0 1 0 0 0 0 0 0 0 0 0 0
smdb-crawler 0 1 0 0 0 0 0 0 0 0 0 0
RankPulseBot 0 1 0 0 0 0 0 0 0 0 0 0
GeoGraphBot 0 1 0 0 0 0 0 0 0 0 0 0
WebatlaBot 0 1 0 0 0 0 0 0 0 0 0 0
OI-Crawler 0 1 0 1 1 0 0 0 0 0 0 0
SitemapResearchBot 0 1 0 0 0 0 0 0 0 0 0 0
Applebot 0 1 1 2 0 0 0 0 0 0 0 0
awi-research-crawler 0 1 0 0 0 0 0 0 0 0 0 0
DataDingoBot 0 1 1 0 0 0 0 0 0 0 0 0
MetaCrawler 0 1 0 0 0 0 0 0 0 0 0 0
RankzonBot 0 1 0 0 0 0 0 0 0 0 0 0
MeasureboardResearchBot 0 1 0 0 0 0 0 0 0 0 0 0
WanScannerBot 0 1 0 0 0 0 0 0 1 0 4 2
GoGuidesCrawler 0 1 0 0 0 0 0 0 0 0 0 0
PipericBot 0 1 0 0 0 0 0 0 0 0 0 0
W3C_Validator 0 1 0 0 1 2 0 0 0 0 1 0
Spider 0 0 14 0 9 2 0 0 0 0 6 211
SurdotlyBot 0 0 7 6 1 0 2 3 11 2 1 1
Timpibot 0 0 6 10 10 8 0 0 0 0 0 0
WordPress 0 0 4 0 0 0 0 0 0 0 0 0
Exabot 0 0 4 17 16 0 0 0 1 0 0 0
gwf-carbon-txt-crawler 0 0 2 0 0 0 0 0 0 0 0 0
FetchDonkeyBot 0 0 2 0 0 0 0 0 0 0 0 0
SaaSBrowserBot 0 0 1 0 0 1 0 0 0 0 0 0
PricedroneShoppingBot 0 0 1 0 0 0 0 0 0 0 0 0
SiteAnalyzerbot 0 0 1 0 0 0 0 0 0 0 0 0
TenMillionDomainsBot 0 0 1 0 0 0 0 0 0 0 0 0
INETDEX-BOT 0 0 1 0 0 0 0 0 0 0 0 0
IntercomDetectBot 0 0 1 0 0 0 0 0 0 0 0 0
ProductLookoutBot 0 0 1 0 0 1 0 0 0 0 0 0
CCMetaBot 0 0 1 0 0 0 0 0 0 0 0 0
BrokenLinksBot 0 0 0 24 24 0 0 0 0 0 0 0
WebTrackrCrawler 0 0 0 19 1 0 0 0 0 0 0 0
YouBot 0 0 0 3 0 0 0 0 0 0 0 0
ContactGraphBot 0 0 0 3 1 0 0 0 0 0 0 0
EveryTabBot 0 0 0 3 0 0 0 0 0 0 0 0
xAI-SearchBot 0 0 0 2 0 0 0 0 0 0 0 0
ris-bot 0 0 0 2 0 0 0 0 0 0 0 0
Wget 0 0 0 2 1 0 11 6 12 1 0 3
TobavaBot 0 0 0 2 1 0 0 0 0 0 0 0
CohereBot 0 0 0 1 0 0 0 0 0 0 0 0
serpstatbot 0 0 0 1 0 1 0 0 1 0 0 1
cis5550-crawler 0 0 0 1 0 0 0 0 0 0 0 0
BingPreview 0 0 0 1 0 1 0 1 0 0 0 0
Thinkbot 0 0 0 1 0 0 1 2 1 3 2 7
TheduCrawler 0 0 0 1 0 0 0 0 0 0 0 0
FeedFetcher-Google 0 0 0 1 0 0 0 0 0 0 0 0
Brightbot 0 0 0 1 0 0 0 0 0 0 0 0
Java 0 0 0 1 3 1 1 8 20 3 4 0
ImageMetaBot 0 0 0 1 0 0 0 0 0 0 0 0
ZeroBot 0 0 0 0 3 0 0 0 0 0 0 0
research-crawler 0 0 0 0 3 0 0 0 0 0 0 0
EECS498-CELSearchEngineCrawler 0 0 0 0 2 0 0 0 0 0 0 0
MineBot 0 0 0 0 2 0 0 0 0 0 0 0
Proximic Spider 0 0 0 0 1 1 0 0 0 1 1 2
UMichSearchEngineCrawler 0 0 0 0 1 0 0 0 0 0 0 0
MyWebCrawler 0 0 0 0 1 0 0 0 0 0 0 0
Xenu Link Sleuth 0 0 0 0 1 0 0 0 0 0 0 1
vague-crawler 0 0 0 0 1 0 0 0 0 0 0 0
FacebookBot 0 0 0 0 1 0 0 0 0 0 0 0
BingIndexCrawler 0 0 0 0 0 5 2 0 0 0 0 0
YandexRenderResourcesBot 0 0 0 0 0 4 0 0 3 2 0 0
IbouBot 0 0 0 0 0 3 114 178 181 105 9 13
research crawler 0 0 0 0 0 2 0 0 0 0 0 0
HenkBot 0 0 0 0 0 2 0 0 0 0 0 0
DuckAssistBot 0 0 0 0 0 2 0 0 0 2 0 0
SBIntuitionsBot 0 0 0 0 0 2 7 6 7 3 13 0
TechCrawler 0 0 0 0 0 1 0 0 0 0 0 0
DirectoryBot 0 0 0 0 0 1 0 0 0 0 0 0
IABot 0 0 0 0 0 1 0 0 0 0 0 0
YahooBot 0 0 0 0 0 1 0 0 1 1 0 0
research-bot 0 0 0 0 0 0 2 0 0 0 0 0
msnbot 0 0 0 0 0 0 1 0 0 0 0 0
DomainStatsBot 0 0 0 0 0 0 1 1 0 0 3 1
ResearchBot 0 0 0 0 0 0 1 0 0 0 0 0
expo-research-bot 0 0 0 0 0 0 0 68 0 0 0 0
Ask Jeeves 0 0 0 0 0 0 0 1 0 0 0 0
Google Web Preview 0 0 0 0 0 0 0 1 0 0 1 0
BLEXBot 0 0 0 0 0 0 0 0 2 9 0 2
browse-crawler 0 0 0 0 0 0 0 0 1 0 0 0
Facebot 0 0 0 0 0 0 0 0 1 0 0 0
Buddybot 0 0 0 0 0 0 0 0 0 3 0 0
ZenixOpsBot 0 0 0 0 0 0 0 0 0 1 0 0
BitSightBot 0 0 0 0 0 0 0 0 0 0 1 6
LinkupBot 0 0 0 0 0 0 0 0 0 0 1 0
TurnitinBot 0 0 0 0 0 0 0 0 0 0 1 0
GoParserBot 0 0 0 0 0 0 0 0 0 0 1 1
KhazandeBot 0 0 0 0 0 0 0 0 0 0 1 0
NiueBot 0 0 0 0 0 0 0 0 0 0 1 0
t3versionsBot 0 0 0 0 0 0 0 0 0 0 0 1
AmazonAdBot 0 0 0 0 0 0 0 0 0 0 0 1
DomCopBot 0 0 0 0 0 0 0 0 0 0 0 1
Total 1533 5933 4550 4748 4396 3510 3066 3974 3392 2936 2251 3523