Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Majestic12

Country:

United Kingdom United Kingdom

ID:

3684

Team:

Not in a team yet. Join one now!

Joined:

01/10/2010 14:16:00

URLs crawled:

558,985,929,556

Data (MB)*:

13,306,654,653

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MJ12-leaseweb4_1

18/08/2017 02:36:15

2 hours 31 mins 2 secs

256

17

69.1%
(DNS: 8.9%, Conn: 0.5%
T-out: 3.4%, 404s: 5.3%
Robots: 7.5%, Other: 5.3%)

0
(0)

47,071,057
(1,545,293)

5,645,239,413
(141,145,132)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb2_1

21/08/2017 09:45:00

1 hour 46 mins 8 secs

7,342

35

82.3%
(DNS: 1.2%, Conn: 0.8%
T-out: 2.6%, 404s: 7.3%
Robots: 1.9%, Other: 3.8%)

553,076
(17,155)

52,622,399
(1,726,612)

5,616,349,985
(139,850,121)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_1

21/08/2017 09:46:50

31 mins 2 secs

7,019

48

83.2%
(DNS: 3.1%, Conn: 1.2%
T-out: 0.7%, 404s: 6.2%
Robots: 2.2%, Other: 3.5%)

581,967
(18,031)

50,939,995
(1,662,805)

3,677,282,907
(94,699,073)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_1

21/08/2017 09:48:49

31 mins 1 sec

5,949

47

82.0%
(DNS: 4.2%, Conn: 0.9%
T-out: 1.0%, 404s: 6.3%
Robots: 1.5%, Other: 4.1%)

634,776
(19,820)

50,336,090
(1,645,613)

2,179,314,614
(57,359,161)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_1

21/08/2017 09:50:43

1 hour 46 mins 3 secs

6,582

37

83.0%
(DNS: 2.5%, Conn: 0.9%
T-out: 1.1%, 404s: 7.8%
Robots: 1.4%, Other: 3.4%)

548,641
(17,753)

53,355,504
(1,758,422)

4,002,607,607
(101,701,004)

v1.7.16 (.NET 4.5)   Linux

evo-h121-1_5

21/08/2017 09:50:58

1 hour 46 mins 4 secs

5,256

39

82.9%
(DNS: 1.3%, Conn: 0.8%
T-out: 2.3%, 404s: 8.4%
Robots: 1.3%, Other: 3.1%)

615,555
(19,988)

49,224,559
(1,609,658)

5,848,025,525
(142,014,460)

v1.7.16 (.NET 4.5)   Linux

CHDN004_9

21/08/2017 09:51:33

31 mins 1 sec

6,804

46

83.1%
(DNS: 1.3%, Conn: 1.0%
T-out: 3.3%, 404s: 7.3%
Robots: 1.8%, Other: 2.2%)

622,072
(20,115)

53,068,569
(1,757,776)

640,860,191
(18,859,538)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_5

21/08/2017 09:52:00

1 hour 31 mins 8 secs

4,989

37

84.9%
(DNS: 1.0%, Conn: 0.6%
T-out: 1.7%, 404s: 7.7%
Robots: 1.1%, Other: 3.0%)

557,145
(17,539)

44,137,306
(1,440,100)

5,981,402,580
(147,781,844)

v1.7.16 (.NET 4.5)   Linux

CHDN004_1

21/08/2017 09:52:28

1 min 0 sec

403

105

77.2%
(DNS: 0.0%, Conn: 0.0%
T-out: 1.6%, 404s: 12.5%
Robots: 4.9%, Other: 3.8%)

683,827
(20,890)

52,465,981
(1,731,566)

4,388,208,083
(111,973,714)

v1.7.16 (.NET 4.5)   Linux

CHDN003_1

21/08/2017 09:52:30

16 mins 0 sec

7,492

36

84.4%
(DNS: 0.8%, Conn: 2.8%
T-out: 1.5%, 404s: 6.3%
Robots: 0.2%, Other: 4.1%)

733,867
(23,499)

53,963,670
(1,734,287)

4,409,388,419
(113,176,133)

v1.7.16 (.NET 4.5)   Linux

evo-h121-1_1

21/08/2017 09:56:29

1 min 0 sec

38

n/a

70.0%
(DNS: 0.0%, Conn: 10.0%
T-out: 0.0%, 404s: 10.0%
Robots: 10.0%, Other: 0.0%)

564,202
(18,371)

49,623,397
(1,628,130)

5,642,555,887
(137,191,827)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb2_5

21/08/2017 09:56:35

1 min 0 sec

275

94

89.5%
(DNS: 0.0%, Conn: 1.1%
T-out: 0.0%, 404s: 7.4%
Robots: 0.0%, Other: 2.1%)

570,960
(17,517)

52,941,952
(1,748,348)

5,138,500,484
(126,317,769)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_1

21/08/2017 09:57:23

16 mins 0 sec

6,946

60

86.7%
(DNS: 1.4%, Conn: 0.3%
T-out: 1.7%, 404s: 6.0%
Robots: 2.2%, Other: 1.7%)

645,085
(21,128)

52,073,759
(1,716,275)

3,765,800,922
(98,237,770)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_1

21/08/2017 09:58:09

16 mins 0 sec

6,936

66

85.0%
(DNS: 2.9%, Conn: 0.7%
T-out: 1.5%, 404s: 4.8%
Robots: 2.3%, Other: 2.8%)

592,912
(19,727)

54,727,436
(1,795,294)

3,446,861,833
(92,768,249)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb6_5

21/08/2017 09:58:49

46 mins 5 secs

5,304

37

84.4%
(DNS: 1.2%, Conn: 1.4%
T-out: 2.0%, 404s: 6.8%
Robots: 1.4%, Other: 2.7%)

625,246
(19,508)

51,076,551
(1,674,349)

1,775,704,407
(50,099,368)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_5

21/08/2017 09:59:05

31 mins 1 sec

6,635

35

80.9%
(DNS: 2.2%, Conn: 0.7%
T-out: 1.4%, 404s: 8.8%
Robots: 3.1%, Other: 2.9%)

700,880
(20,920)

51,320,776
(1,680,130)

3,417,508,868
(88,258,128)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_1

21/08/2017 10:00:02

1 hour 46 mins 4 secs

2,947

23

83.2%
(DNS: 1.6%, Conn: 0.8%
T-out: 1.8%, 404s: 7.4%
Robots: 1.9%, Other: 3.4%)

390,870
(12,589)

41,015,172
(1,349,186)

4,389,753,021
(105,437,043)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_5

21/08/2017 10:00:17

46 mins 1 sec

2,824

19

84.8%
(DNS: 1.2%, Conn: 0.1%
T-out: 2.0%, 404s: 7.7%
Robots: 1.0%, Other: 3.2%)

321,824
(10,047)

31,257,540
(1,027,588)

3,394,272,242
(87,111,155)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb3_5

21/08/2017 10:00:32

31 mins 1 sec

4,965

37

82.5%
(DNS: 2.0%, Conn: 1.6%
T-out: 4.2%, 404s: 6.4%
Robots: 2.1%, Other: 1.3%)

377,702
(12,067)

52,021,809
(1,723,039)

6,430,343,735
(161,167,371)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_5

21/08/2017 10:00:37

16 mins 0 sec

6,247

18

82.9%
(DNS: 2.3%, Conn: 0.8%
T-out: 3.5%, 404s: 6.1%
Robots: 0.9%, Other: 3.4%)

535,669
(16,913)

50,426,133
(1,666,900)

1,541,674,896
(40,505,628)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_5

21/08/2017 10:00:37

2 hours 1 min 4 secs

5,825

29

83.6%
(DNS: 2.0%, Conn: 1.1%
T-out: 1.7%, 404s: 7.0%
Robots: 1.3%, Other: 3.3%)

546,158
(16,841)

51,889,370
(1,703,773)

3,600,561,426
(93,198,212)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb3_1

21/08/2017 10:00:59

16 mins 1 sec

6,169

50

81.2%
(DNS: 2.4%, Conn: 1.4%
T-out: 4.5%, 404s: 5.0%
Robots: 2.3%, Other: 3.1%)

421,660
(12,853)

52,434,199
(1,726,894)

6,109,023,334
(153,135,484)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MJ12-leaseweb4_5

21/08/2017 10:01:00

1 hour 1 min 13 secs

3,975

31

65.3%
(DNS: 21.6%, Conn: 1.1%
T-out: 2.3%, 404s: 6.1%
Robots: 1.0%, Other: 2.6%)

471,913
(14,979)

52,556,984
(1,717,486)

5,081,179,757
(123,923,365)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_1

21/08/2017 10:01:15

1 hour 16 mins 3 secs

4,520

23

82.8%
(DNS: 0.7%, Conn: 0.8%
T-out: 2.7%, 404s: 8.6%
Robots: 1.0%, Other: 3.4%)

514,959
(16,895)

50,154,797
(1,645,065)

3,564,476,785
(92,153,922)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb6_1

21/08/2017 10:01:17

1 hour 31 mins 3 secs

6,769

52

84.9%
(DNS: 1.4%, Conn: 1.3%
T-out: 2.6%, 404s: 5.9%
Robots: 0.9%, Other: 3.0%)

685,752
(21,023)

51,016,839
(1,662,386)

1,625,919,928
(45,730,784)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_5

21/08/2017 10:01:21

31 mins 1 sec

7,191

60

85.1%
(DNS: 1.2%, Conn: 0.6%
T-out: 2.0%, 404s: 6.2%
Robots: 2.4%, Other: 2.5%)

601,617
(18,633)

53,371,425
(1,750,184)

4,466,777,953
(116,654,868)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_5

21/08/2017 10:01:24

31 mins 0 sec

6,732

43

83.7%
(DNS: 0.6%, Conn: 1.6%
T-out: 1.4%, 404s: 8.2%
Robots: 2.1%, Other: 2.5%)

632,242
(21,012)

53,488,533
(1,759,463)

4,029,550,902
(101,567,089)

Total (27 nodes)

136,390

1,124

-

14,730,577
(465,813)

1,358,581,802
(44,586,622)

109,809,145,704
(2,782,018,212)

The following chart shows Majestic12's contribution (blue) to overall crawling effort by day.

Last updated: 21 Aug 2017 11:01:58:380 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12