Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Majestic12

Country:

United Kingdom United Kingdom

ID:

3684

Team:

Not in a team yet. Join one now!

Joined:

01/10/2010 14:16:00

URLs crawled:

556,159,984,971

Data (MB)*:

13,213,726,214

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_5

23/06/2017 13:49:28

1 hour 46 mins 8 secs

4,450

55

75.7%
(DNS: 2.5%, Conn: 0.8%
T-out: 3.2%, 404s: 10.0%
Robots: 3.0%, Other: 4.7%)

0
(0)

70,192,884
(2,289,989)

4,998,848,834
(121,266,992)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_1

23/06/2017 13:53:20

1 min 0 sec

n/a

73

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

65,904,677
(2,105,565)

5,569,123,734
(138,682,648)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb6_1

25/06/2017 00:49:43

16 mins 0 sec

511

32

87.9%
(DNS: 0.1%, Conn: 0.0%
T-out: 0.7%, 404s: 2.1%
Robots: 7.8%, Other: 1.4%)

29,949
(1,276)

76,679,296
(2,512,610)

1,518,541,697
(42,197,468)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb2_1

25/06/2017 00:52:52

16 mins 0 sec

354

29

79.1%
(DNS: 0.7%, Conn: 0.0%
T-out: 2.9%, 404s: 5.9%
Robots: 0.5%, Other: 11.0%)

64,758
(2,698)

79,624,110
(2,600,627)

5,502,748,440
(136,104,687)

v1.7.16 (.NET 4.5)   Linux

CHDN004_1

25/06/2017 00:52:54

1 hour 31 mins 1 sec

728

14

73.9%
(DNS: 0.4%, Conn: 1.2%
T-out: 2.4%, 404s: 4.7%
Robots: 4.2%, Other: 13.2%)

24,918
(730)

75,512,414
(2,492,485)

4,277,646,944
(108,301,852)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_1

25/06/2017 00:54:42

31 mins 0 sec

56

2

69.9%
(DNS: 3.0%, Conn: 0.1%
T-out: 3.8%, 404s: 16.5%
Robots: 4.8%, Other: 1.8%)

19,970
(536)

79,505,893
(2,586,432)

3,330,129,714
(88,925,607)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb3_1

25/06/2017 00:57:06

46 mins 0 sec

289

24

59.5%
(DNS: 0.2%, Conn: 1.7%
T-out: 26.9%, 404s: 8.3%
Robots: 0.2%, Other: 3.1%)

49,901
(1,597)

80,396,845
(2,629,105)

5,996,217,887
(149,421,297)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_5

25/06/2017 00:57:07

1 hour 1 min 1 sec

505

18

85.4%
(DNS: 0.1%, Conn: 1.7%
T-out: 1.5%, 404s: 3.9%
Robots: 3.6%, Other: 3.9%)

24,997
(757)

76,058,501
(2,493,606)

3,490,555,514
(89,579,800)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_1

25/06/2017 00:57:16

31 mins 0 sec

60

1

76.6%
(DNS: 0.0%, Conn: 0.0%
T-out: 23.4%, 404s: 0.0%
Robots: 0.0%, Other: 0.0%)

29,922
(872)

77,766,729
(2,538,685)

3,889,747,955
(97,973,019)

v1.7.16 (.NET 4.5)   Linux

evo-h121-1_5

25/06/2017 00:58:53

46 mins 2 secs

1,150

13

80.6%
(DNS: 1.7%, Conn: 0.8%
T-out: 2.0%, 404s: 9.1%
Robots: 0.8%, Other: 4.9%)

24,985
(838)

72,536,531
(2,376,144)

5,744,113,820
(138,588,724)

v1.7.16 (.NET 4.5)   Linux

CHDN004_9

25/06/2017 00:58:54

3 hours 1 min 2 secs

747

29

78.4%
(DNS: 1.2%, Conn: 0.0%
T-out: 1.0%, 404s: 9.3%
Robots: 6.1%, Other: 4.1%)

14,873
(733)

77,874,944
(2,554,781)

528,319,839
(15,126,615)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_5

25/06/2017 00:59:08

1 hour 46 mins 3 secs

641

20

80.3%
(DNS: 2.5%, Conn: 0.0%
T-out: 2.2%, 404s: 6.2%
Robots: 4.1%, Other: 4.7%)

19,957
(959)

74,770,706
(2,439,477)

3,309,245,567
(84,698,936)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_5

25/06/2017 00:59:15

1 hour 31 mins 2 secs

354

19

74.1%
(DNS: 0.8%, Conn: 0.1%
T-out: 3.2%, 404s: 8.3%
Robots: 9.2%, Other: 4.4%)

49,928
(1,675)

74,860,409
(2,435,923)

1,434,302,845
(36,968,406)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_5

25/06/2017 00:59:19

16 mins 0 sec

40

19

91.6%
(DNS: 0.0%, Conn: 0.5%
T-out: 7.4%, 404s: 0.5%
Robots: 0.0%, Other: 0.0%)

34,237
(1,192)

79,245,027
(2,596,500)

3,915,676,937
(97,804,536)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb6_5

25/06/2017 00:59:20

46 mins 0 sec

438

11

67.9%
(DNS: 0.1%, Conn: 0.6%
T-out: 3.7%, 404s: 10.9%
Robots: 9.7%, Other: 7.1%)

34,771
(1,216)

75,520,342
(2,475,886)

1,669,152,441
(46,584,088)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_1

25/06/2017 00:59:25

1 hour 46 mins 2 secs

206

11

80.6%
(DNS: 0.1%, Conn: 0.0%
T-out: 3.0%, 404s: 0.8%
Robots: 11.3%, Other: 4.2%)

19,634
(819)

73,591,584
(2,395,555)

3,570,641,788
(91,188,258)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_5

25/06/2017 00:59:30

1 hour 31 mins 1 sec

446

20

81.8%
(DNS: 2.0%, Conn: 0.1%
T-out: 3.2%, 404s: 3.0%
Robots: 2.2%, Other: 7.6%)

19,925
(604)

77,100,993
(2,507,566)

4,353,336,248
(112,931,764)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_1

25/06/2017 00:59:31

1 hour 31 mins 2 secs

308

19

73.5%
(DNS: 0.5%, Conn: 1.7%
T-out: 2.8%, 404s: 10.5%
Robots: 3.7%, Other: 7.4%)

39,812
(1,283)

72,369,507
(2,373,672)

2,072,323,631
(53,842,881)

v1.7.16 (.NET 4.5)   Linux

CHDN003_1

25/06/2017 00:59:31

46 mins 1 sec

14

45

67.7%
(DNS: 0.0%, Conn: 0.0%
T-out: 27.7%, 404s: 4.6%
Robots: 0.0%, Other: 0.0%)

123,811
(4,242)

72,562,456
(2,324,468)

4,295,941,617
(109,524,257)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_1

25/06/2017 00:59:33

1 hour 31 mins 2 secs

244

9

81.2%
(DNS: 2.7%, Conn: 0.2%
T-out: 0.1%, 404s: 8.1%
Robots: 6.0%, Other: 1.8%)

19,975
(675)

69,737,683
(2,280,195)

3,459,748,809
(88,720,071)

v1.7.16 (.NET 4.5)   Linux

evo-h121-1_1

25/06/2017 00:59:38

46 mins 0 sec

133

16

75.0%
(DNS: 0.0%, Conn: 0.0%
T-out: 3.1%, 404s: 9.4%
Robots: 0.0%, Other: 12.4%)

34,940
(1,032)

72,779,755
(2,381,733)

5,537,343,773
(133,722,327)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_1

25/06/2017 00:59:45

1 hour 31 mins 2 secs

803

19

82.2%
(DNS: 0.9%, Conn: 1.1%
T-out: 5.8%, 404s: 6.5%
Robots: 1.1%, Other: 2.5%)

44,808
(1,382)

74,622,648
(2,425,233)

3,655,506,375
(94,617,110)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_5

25/06/2017 00:59:49

1 min 0 sec

662

n/a

94.5%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.0%, 404s: 5.5%
Robots: 0.0%, Other: 0.0%)

24,988
(990)

43,324,303
(1,410,627)

3,327,912,233
(84,932,657)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_1

25/06/2017 00:59:52

1 hour 1 min 3 secs

474

9

72.9%
(DNS: 0.2%, Conn: 0.5%
T-out: 1.5%, 404s: 10.4%
Robots: 3.5%, Other: 11.0%)

24,934
(963)

50,494,232
(1,640,776)

4,308,881,912
(102,771,061)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb2_5

25/06/2017 00:59:56

1 hour 31 mins 0 sec

669

24

84.3%
(DNS: 1.4%, Conn: 0.4%
T-out: 2.8%, 404s: 6.4%
Robots: 2.4%, Other: 2.4%)

29,851
(942)

80,405,533
(2,635,219)

5,025,470,254
(122,579,466)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_5

25/06/2017 00:59:57

46 mins 1 sec

261

3

76.9%
(DNS: 0.2%, Conn: 0.0%
T-out: 5.8%, 404s: 10.2%
Robots: 0.7%, Other: 6.2%)

9,994
(308)

57,171,733
(1,877,238)

5,888,929,530
(144,753,205)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb3_5

25/06/2017 01:00:00

31 mins 0 sec

1,048

8

83.0%
(DNS: 0.2%, Conn: 0.7%
T-out: 2.3%, 404s: 6.4%
Robots: 4.6%, Other: 2.8%)

24,946
(838)

80,375,752
(2,616,613)

6,317,245,640
(157,419,819)

Total (27 nodes)

15,591

542

-

840,784
(29,157)

1,960,985,487
(63,996,710)

106,987,653,978
(2,689,227,551)

The following chart shows Majestic12's contribution (blue) to overall crawling effort by day.

Last updated: 25 Jun 2017 01:00:20:220 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12