Was ist bubing?
indexiert und analysiert Inhalte von Webseiten.
Der Webrobot bubing indexiert und analysiert Inhalte von Webseiten. Er zeigt sich meistens mit der IP Adresse 107.21.15.243 und unter Verwendung des User Agent BUbiNG – Research at Brno University of Technology – KNOT group – http://knot.fit.vutbr.cz/crawling/ – Stop? http://law.di.unimi.it/BUbiNG.html. Mit 0.0126% Marktanteil ist bubing auf Platz 62 der aktivsten Webrobots im Internet.
robots.txt – bubing blockieren
Füge diese Zeilen in deine robots.txt ein, um bubing den Zugriff auf deine Website zu verwehren:
robots.txt
User-agent: bubing
Disallow: /Du kannst den Zugriff auch gezielt einschränken, statt ihn komplett zu blockieren:
robots.txt (selektiv)
User-agent: bubing
Disallow: /wp-admin/
Disallow: /wp-includes/
Allow: /IP-Adressen 141 bekannte IPs
Diese IP-Adressen wurden bisher von bubing verwendet:
107.21.15.243
107.21.38.212
107.22.142.90
107.23.228.232
147.229.8.39
34.201.161.49
34.201.174.98
34.202.158.23
34.202.159.103
34.202.233.55
34.203.38.173
34.204.61.60
34.204.76.125
34.204.91.151
34.207.121.50
34.207.156.97
34.207.189.209
34.207.190.84
34.207.221.102
34.207.221.153
34.207.253.180
34.224.63.17
34.224.83.176
34.224.94.208
34.227.90.167
34.227.93.235
34.229.136.176
34.229.136.216
34.229.137.197
34.229.137.210
34.229.161.91
34.229.184.164
34.229.189.176
34.229.49.45
34.229.71.160
34.229.72.159
34.232.66.199
34.232.70.121
34.232.77.120
34.237.91.187
34.239.207.166
34.239.250.243
35.153.18.6
35.153.19.73
35.153.226.29
35.153.50.226
35.153.50.232
35.153.50.52
35.153.83.13
35.153.83.159
35.153.93.3
35.168.3.56
35.168.7.208
52.204.106.221
52.204.74.164
52.205.14.105
52.206.204.61
52.207.40.33
52.23.179.77
52.23.212.97
52.3.243.11
52.86.119.1
52.86.4.184
52.86.90.151
52.87.212.59
52.87.219.81
52.87.220.159
52.87.222.95
52.87.234.242
52.87.235.144
52.87.28.143
52.91.101.199
52.91.102.55
52.91.117.146
52.91.117.197
52.91.133.30
52.91.133.68
52.91.145.148
52.91.147.221
52.91.148.235
52.91.151.148
52.91.202.116
54.144.86.234
54.145.240.189
54.152.134.43
54.152.54.18
54.152.54.22
54.152.85.14
54.158.214.184
54.162.74.182
54.162.98.49
54.164.185.201
54.166.166.218
54.167.147.28
54.172.176.217
54.172.211.5
54.172.58.245
54.173.112.159
54.173.96.139
54.174.108.206
54.174.133.225
54.174.226.240
54.175.135.62
54.175.174.126
54.175.18.56
54.175.221.118
54.196.187.121
54.197.128.26
54.197.132.112
54.210.194.218
54.210.195.189
54.210.89.89
54.226.40.86
54.226.46.110
54.227.196.141
54.234.3.109
54.234.86.62
54.234.91.184
54.236.26.190
54.236.28.171
54.236.30.50
54.236.33.98
54.236.44.32
54.236.49.202
54.236.56.164
54.236.83.114
54.237.207.224
54.237.224.129
54.242.168.59
54.82.27.144
54.83.162.248
54.85.138.220
54.85.74.248
54.85.92.155
54.86.61.43
54.87.204.205
54.87.207.55
54.87.242.22
64.62.252.162
64.62.252.163
64.62.252.164
User Agents
Mit diesen User-Agent-Strings identifiziert sich bubing:
BUbiNG – Research at Brno University of Technology – KNOT group – http://knot.fit.vutbr.cz/crawling/ – Stop? http://law.di.unimi.it/BUbiNG.htmlBUbiNG ( http://law.di.unimi.it/BUbiNG.html)BUbiNG ( http://law.di.unimi.it/BUbiNG.html#wc)