Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Majestic12

Country:

United Kingdom United Kingdom

ID:

3684

Team:

Not in a team yet. Join one now!

Joined:

01/10/2010 14:16:00

URLs crawled:

565,029,855,047

Data (MB)*:

13,505,075,283

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_5

23/02/2018 12:47:16

31 mins 1 sec

7,556

35

83.9%
(DNS: 1.8%, Conn: 1.0%
T-out: 1.8%, 404s: 6.4%
Robots: 2.1%, Other: 3.2%)

1,838,551
(60,038)

59,890,723
(1,951,249)

1,839,921,620
(50,398,123)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_5

23/02/2018 12:50:01

1 min 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

1,972,125
(63,792)

76,973,426
(2,525,127)

4,396,480,928
(113,735,722)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_5

23/02/2018 12:51:03

1 min 0 sec

41

n/a

100.0%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.0%, 404s: 0.0%
Robots: 0.0%, Other: 0.0%)

1,556,560
(47,670)

58,939,667
(1,909,628)

6,269,062,387
(157,273,680)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_1

23/02/2018 12:51:18

1 hour 46 mins 4 secs

7,600

75

82.6%
(DNS: 1.6%, Conn: 1.2%
T-out: 1.6%, 404s: 7.5%
Robots: 2.3%, Other: 3.3%)

2,106,886
(71,735)

83,107,306
(2,674,946)

3,827,267,994
(105,261,821)

v1.7.16 (.NET 4.5)   Linux

CHDN004_9

23/02/2018 12:52:53

46 mins 2 secs

5,635

44

79.3%
(DNS: 2.4%, Conn: 1.3%
T-out: 2.7%, 404s: 8.9%
Robots: 1.5%, Other: 3.8%)

1,927,152
(61,930)

76,829,957
(2,503,471)

1,005,266,755
(30,946,786)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_1

23/02/2018 12:52:59

1 hour 1 min 3 secs

4,499

67

78.8%
(DNS: 3.8%, Conn: 1.9%
T-out: 0.9%, 404s: 9.3%
Robots: 1.8%, Other: 3.4%)

1,834,273
(58,736)

74,934,119
(2,437,645)

4,366,648,843
(113,784,339)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_1

23/02/2018 12:54:02

31 mins 0 sec

4,326

52

49.1%
(DNS: 37.6%, Conn: 0.7%
T-out: 3.2%, 404s: 4.7%
Robots: 2.9%, Other: 1.6%)

1,936,868
(40,670)

70,238,452
(1,917,367)

5,990,434,716
(151,885,332)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_1

23/02/2018 12:56:19

31 mins 1 sec

6,908

53

81.5%
(DNS: 5.1%, Conn: 0.2%
T-out: 0.7%, 404s: 6.8%
Robots: 1.4%, Other: 4.4%)

1,602,510
(51,344)

73,828,054
(2,398,941)

4,112,548,539
(109,715,513)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_1

23/02/2018 12:56:52

1 hour 16 mins 8 secs

3,363

7

83.8%
(DNS: 0.6%, Conn: 0.6%
T-out: 2.1%, 404s: 8.7%
Robots: 1.8%, Other: 2.4%)

1,191,161
(38,118)

45,495,440
(1,470,824)

4,633,335,819
(113,479,490)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_1

23/02/2018 12:57:05

1 hour 1 min 2 secs

3,973

53

85.2%
(DNS: 0.7%, Conn: 0.9%
T-out: 1.4%, 404s: 6.9%
Robots: 1.6%, Other: 3.2%)

1,834,394
(56,572)

70,617,381
(2,300,966)

2,504,639,235
(68,163,415)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_5

23/02/2018 12:58:47

31 mins 1 sec

7,300

54

82.5%
(DNS: 1.1%, Conn: 0.8%
T-out: 1.3%, 404s: 8.1%
Robots: 1.9%, Other: 4.3%)

1,832,085
(58,519)

78,288,530
(2,547,853)

4,827,334,302
(128,562,039)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_5

23/02/2018 12:58:48

3 hours 46 mins 9 secs

2,983

34

35.4%
(DNS: 53.3%, Conn: 0.3%
T-out: 4.6%, 404s: 3.9%
Robots: 1.1%, Other: 1.4%)

2,055,345
(43,215)

70,987,993
(1,933,196)

5,422,063,232
(134,529,174)

v1.7.16 (.NET 4.5)   Linux

CHDN004_1

23/02/2018 12:59:01

1 hour 1 min 3 secs

5,122

51

81.7%
(DNS: 1.1%, Conn: 1.4%
T-out: 2.1%, 404s: 7.7%
Robots: 2.5%, Other: 3.4%)

1,754,556
(53,639)

73,926,530
(2,422,958)

4,741,334,392
(123,707,142)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_5

23/02/2018 12:59:06

1 hour 16 mins 2 secs

2,473

37

80.3%
(DNS: 1.8%, Conn: 0.6%
T-out: 2.1%, 404s: 9.7%
Robots: 1.7%, Other: 3.8%)

1,032,058
(33,379)

40,258,833
(1,307,622)

3,595,596,108
(93,750,489)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_5

23/02/2018 12:59:12

1 hour 16 mins 2 secs

6,566

80

80.1%
(DNS: 2.5%, Conn: 1.6%
T-out: 1.7%, 404s: 8.3%
Robots: 2.2%, Other: 3.7%)

1,852,060
(59,574)

72,295,744
(2,332,492)

3,759,827,772
(99,530,240)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_5

23/02/2018 12:59:20

16 mins 1 sec

6,391

35

84.1%
(DNS: 2.1%, Conn: 0.5%
T-out: 0.9%, 404s: 6.4%
Robots: 2.1%, Other: 3.9%)

1,803,844
(61,390)

75,758,756
(2,462,313)

3,939,049,690
(104,371,825)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_1

23/02/2018 12:59:24

1 hour 16 mins 3 secs

5,665

48

83.0%
(DNS: 1.4%, Conn: 1.2%
T-out: 1.6%, 404s: 7.4%
Robots: 1.5%, Other: 4.0%)

1,675,801
(54,903)

67,691,345
(2,196,133)

4,006,116,163
(105,582,541)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_1

23/02/2018 12:59:48

31 mins 1 sec

5,896

95

80.8%
(DNS: 0.8%, Conn: 1.6%
T-out: 1.3%, 404s: 9.8%
Robots: 1.8%, Other: 3.9%)

1,762,218
(56,258)

70,997,077
(2,293,915)

3,840,034,339
(101,203,549)

v1.7.16 (.NET 4.5)   Linux

CHDN003_1

23/02/2018 13:00:04

16 mins 0 sec

3,272

45

81.9%
(DNS: 1.3%, Conn: 3.1%
T-out: 0.8%, 404s: 8.6%
Robots: 1.5%, Other: 2.9%)

1,121,388
(34,719)

17,856,383
(564,008)

4,446,644,925
(114,357,145)

Total (19 nodes)

89,569

865

-

32,689,835
(1,006,201)

1,258,915,716
(40,150,654)

77,523,607,759
(2,020,238,365)

The following chart shows Majestic12's contribution (blue) to overall crawling effort by day.

Last updated: 23 Feb 2018 13:00:32:687 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12