Distributed Search Engine
Use it:

Majestic-12 : DSearch : User Info

Nickname:
Majestic12
Country:
United Kingdom
ID:
3684
Team:
Not in a team yet. Join one now!
Joined:
01/10/2010 14:16:00
URLs crawled:
590,027,691,004
Data (MB)*:
14,341,403,412
Peers (nodes):
Version
Name
Last seen
Uptime
Downstream
(Kbits)**
Upstream
(Kbits)**
Current run successes
(failures****)
Today
URLs (MBs)***
Last 30
days
Total
v1.7.21 Linux
Leaseweb8_1
17/01/2021 22:30:12
1 hour 31 mins 1 sec
455
17
58.2%
(DNS: 4.4%, Conn: 5.4%
T-out: 3.1%, 404s: 7.9%
Robots: 5.6%, Other: 15.5%)
1,277,026
(43,210)
37,506,551
(1,340,527)
5,448,341,501
(154,449,246)
v1.7.21 Linux
CHDN004_9
17/01/2021 22:30:19
2 hours 1 min 2 secs
1,481
30
68.9%
(DNS: 3.5%, Conn: 1.8%
T-out: 3.1%, 404s: 8.1%
Robots: 4.3%, Other: 10.3%)
1,416,357
(51,360)
36,163,818
(1,311,339)
2,419,168,525
(78,424,658)
v1.7.21 Linux
MJ12-CHDN007_1
17/01/2021 22:30:26
1 hour 46 mins 2 secs
953
16
71.1%
(DNS: 1.3%, Conn: 1.2%
T-out: 0.8%, 404s: 9.2%
Robots: 5.7%, Other: 10.8%)
1,301,806
(46,219)
37,194,424
(1,340,663)
3,875,159,508
(113,715,206)
v1.7.21 Linux
MJ12-CHDN005_1
17/01/2021 22:30:29
1 hour 31 mins 1 sec
462
16
57.9%
(DNS: 7.3%, Conn: 0.1%
T-out: 6.6%, 404s: 16.4%
Robots: 6.8%, Other: 4.9%)
1,329,937
(45,590)
32,967,388
(1,174,714)
5,747,621,523
(160,616,253)
v1.7.21 Linux
MJ12-leaseweb7_1
17/01/2021 22:30:37
2 hours 31 mins 2 secs
645
12
68.5%
(DNS: 2.7%, Conn: 3.8%
T-out: 4.2%, 404s: 8.5%
Robots: 3.8%, Other: 8.5%)
1,298,348
(43,978)
36,321,128
(1,297,695)
5,287,407,720
(149,154,154)
v1.7.21 Linux
MJ12-leaseweb4_5
17/01/2021 22:31:21
1 hour 31 mins 1 sec
551
28
80.1%
(DNS: 2.8%, Conn: 2.4%
T-out: 1.1%, 404s: 2.8%
Robots: 3.8%, Other: 7.0%)
1,315,067
(43,551)
36,272,934
(1,316,449)
6,707,110,390
(175,641,663)
v1.7.21 Linux
MJ12-CHDN006_1
17/01/2021 22:32:14
1 hour 46 mins 1 sec
778
21
74.8%
(DNS: 3.2%, Conn: 0.5%
T-out: 2.5%, 404s: 7.4%
Robots: 3.5%, Other: 8.0%)
1,399,961
(46,497)
37,025,521
(1,339,076)
5,264,269,316
(153,291,804)
v1.7.21 Linux
MJ12-leaseweb5_5
17/01/2021 22:32:56
1 hour 1 min 1 sec
69
7
46.0%
(DNS: 17.7%, Conn: 0.0%
T-out: 0.5%, 404s: 4.4%
Robots: 10.6%, Other: 20.8%)
1,462,712
(50,020)
38,109,245
(1,369,520)
7,602,221,709
(202,374,232)
v1.7.21 Linux
MJ12-CHDN005_5
17/01/2021 22:35:06
1 min 0 sec
128
n/a
100.0%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.0%, 404s: 0.0%
Robots: 0.0%, Other: 0.0%)
1,384,925
(47,887)
33,211,423
(1,188,402)
5,797,374,331
(161,262,458)
v1.7.21 Linux
MJ12-leaseweb5_1
17/01/2021 22:35:59
16 mins 0 sec
80
n/a
59.2%
(DNS: 0.0%, Conn: 0.0%
T-out: 21.5%, 404s: 6.5%
Robots: 0.0%, Other: 12.8%)
1,324,762
(48,006)
37,535,548
(1,344,058)
5,901,541,904
(156,450,287)
v1.7.21 Linux
MJ12-CHDN008_5
17/01/2021 22:39:17
1 hour 1 min 0 sec
136
10
69.8%
(DNS: 0.4%, Conn: 1.2%
T-out: 10.4%, 404s: 11.9%
Robots: 1.1%, Other: 5.1%)
1,333,018
(47,372)
36,863,420
(1,330,399)
3,192,420,133
(96,336,821)
v1.7.21 Linux
MJ12-CHDN008_1
17/01/2021 22:39:21
31 mins 0 sec
50
8
68.7%
(DNS: 0.0%, Conn: 0.5%
T-out: 16.6%, 404s: 9.7%
Robots: 0.0%, Other: 4.3%)
1,355,072
(49,498)
36,223,495
(1,305,491)
5,152,928,476
(145,900,846)
v1.7.21 Linux
Leaseweb8_5
17/01/2021 22:39:55
1 min 0 sec
59
n/a
55.6%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.0%, 404s: 0.0%
Robots: 0.0%, Other: 44.4%)
1,411,128
(49,626)
36,672,661
(1,323,051)
6,119,901,990
(171,590,175)
v1.7.21 Linux
MJ12-CHDN006_5
17/01/2021 22:41:21
1 hour 1 min 0 sec
85
11
59.6%
(DNS: 0.1%, Conn: 14.8%
T-out: 8.1%, 404s: 1.7%
Robots: 8.5%, Other: 7.3%)
914,036
(32,401)
24,473,288
(875,563)
4,426,380,040
(121,675,774)
v1.7.21 Linux
MJ12-CHDN007_5
17/01/2021 22:42:13
1 min 0 sec
75
n/a
40.0%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.0%, 404s: 0.0%
Robots: 0.0%, Other: 60.0%)
1,343,968
(46,343)
37,852,470
(1,364,172)
5,339,889,006
(150,868,503)
v1.7.21 Linux
CHDN004_1
17/01/2021 22:42:30
1 min 0 sec
29
n/a
94.3%
(DNS: 0.0%, Conn: 0.0%
T-out: 2.9%, 404s: 2.9%
Robots: 0.0%, Other: 0.0%)
1,377,892
(49,363)
35,167,702
(1,271,421)
6,111,270,297
(169,710,187)
v1.7.21 Linux
MJ12-leaseweb4_1
17/01/2021 22:43:24
2 hours 1 min 2 secs
875
16
72.5%
(DNS: 1.2%, Conn: 1.5%
T-out: 1.9%, 404s: 11.5%
Robots: 2.1%, Other: 9.3%)
1,260,755
(42,713)
34,399,199
(1,234,130)
7,231,550,015
(191,453,660)
v1.7.21 Linux
CHDN003_1
17/01/2021 22:43:56
1 hour 46 mins 2 secs
275
10
75.5%
(DNS: 4.4%, Conn: 3.5%
T-out: 6.1%, 404s: 3.2%
Robots: 0.7%, Other: 6.7%)
1,429,495
(48,939)
36,861,396
(1,325,762)
5,800,691,092
(158,693,132)
v1.7.21 Linux
MJ12-leaseweb7_5
17/01/2021 22:44:21
16 mins 0 sec
128
15
96.5%
(DNS: 0.1%, Conn: 0.3%
T-out: 1.2%, 404s: 1.9%
Robots: 0.0%, Other: 0.0%)
1,363,474
(45,929)
37,074,665
(1,347,246)
5,096,029,553
(144,952,238)
Total (19 nodes)
7,314
217
-
25,299,739
(878,502)
677,896,276
(24,399,678)
102,521,277,029
(2,856,561,297)

The following chart shows Majestic12's contribution (blue) to overall crawling effort by day.

Last updated: 17 Jan 2021 22:46:09:267 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else