Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Majestic12

Country:

United Kingdom United Kingdom

ID:

3684

Team:

Not in a team yet. Join one now!

Joined:

01/10/2010 14:16:00

URLs crawled:

578,936,417,221

Data (MB)*:

13,934,769,394

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_5

17/07/2019 12:41:38

1 hour 16 mins 2 secs

906

10

71.0%
(DNS: 2.1%, Conn: 0.2%
T-out: 3.7%, 404s: 7.9%
Robots: 4.3%, Other: 10.8%)

383,096
(11,531)

19,412,226
(608,368)

4,053,165,257
(107,958,413)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_1

17/07/2019 12:41:51

1 min 0 sec

117

84

97.2%
(DNS: 0.0%, Conn: 0.0%
T-out: 2.8%, 404s: 0.0%
Robots: 0.0%, Other: 0.0%)

654,361
(18,971)

31,588,591
(957,597)

5,302,855,337
(134,450,525)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_5

17/07/2019 12:42:19

1 min 0 sec

54

n/a

92.6%
(DNS: 0.0%, Conn: 0.0%
T-out: 7.4%, 404s: 0.0%
Robots: 0.0%, Other: 0.0%)

646,426
(19,667)

30,846,799
(936,944)

4,515,520,222
(123,647,480)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_5

17/07/2019 12:43:28

1 hour 1 min 1 sec

1,284

13

71.9%
(DNS: 0.8%, Conn: 0.3%
T-out: 3.8%, 404s: 11.4%
Robots: 1.5%, Other: 10.3%)

635,350
(19,009)

30,720,564
(939,476)

4,720,845,347
(128,156,174)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_5

17/07/2019 12:43:53

3 hours 31 mins 5 secs

1,135

10

71.3%
(DNS: 1.5%, Conn: 0.8%
T-out: 3.8%, 404s: 9.5%
Robots: 3.0%, Other: 10.1%)

661,665
(19,555)

30,907,147
(943,091)

6,111,283,917
(153,811,807)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_1

17/07/2019 12:44:43

1 hour 31 mins 2 secs

1,430

13

70.9%
(DNS: 1.6%, Conn: 0.9%
T-out: 3.2%, 404s: 10.4%
Robots: 2.6%, Other: 10.4%)

639,280
(18,388)

30,571,718
(927,115)

3,266,502,665
(91,354,230)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_5

17/07/2019 12:46:49

16 mins 0 sec

188

22

88.3%
(DNS: 0.4%, Conn: 0.2%
T-out: 9.3%, 404s: 1.7%
Robots: 0.0%, Other: 0.0%)

674,839
(19,376)

30,664,825
(938,098)

5,600,533,353
(152,593,641)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_5

17/07/2019 12:47:59

46 mins 1 sec

154

20

68.1%
(DNS: 0.0%, Conn: 0.1%
T-out: 5.1%, 404s: 10.5%
Robots: 0.2%, Other: 16.0%)

669,082
(21,063)

30,894,524
(930,531)

2,598,667,604
(74,487,261)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_1

17/07/2019 12:48:03

1 hour 46 mins 3 secs

1,333

29

64.7%
(DNS: 0.9%, Conn: 0.6%
T-out: 4.3%, 404s: 12.6%
Robots: 3.9%, Other: 13.0%)

640,075
(20,155)

30,356,526
(928,282)

4,726,290,395
(128,639,290)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_1

17/07/2019 12:48:20

16 mins 1 sec

161

62

86.1%
(DNS: 0.0%, Conn: 0.5%
T-out: 7.4%, 404s: 6.1%
Robots: 0.0%, Other: 0.0%)

646,824
(19,552)

30,535,973
(930,005)

4,863,145,705
(133,037,820)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_1

17/07/2019 12:48:37

1 hour 1 min 2 secs

592

16

73.0%
(DNS: 0.5%, Conn: 1.1%
T-out: 3.1%, 404s: 15.7%
Robots: 0.8%, Other: 5.9%)

627,062
(20,388)

30,711,208
(927,696)

6,671,025,487
(170,896,399)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_1

17/07/2019 12:48:49

46 mins 1 sec

161

22

63.5%
(DNS: 1.1%, Conn: 0.0%
T-out: 13.9%, 404s: 16.0%
Robots: 0.0%, Other: 5.5%)

700,225
(21,775)

31,689,101
(962,041)

5,146,253,298
(138,631,493)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_1

17/07/2019 12:48:54

1 min 0 sec

274

104

52.7%
(DNS: 0.0%, Conn: 20.3%
T-out: 1.4%, 404s: 0.0%
Robots: 0.0%, Other: 25.7%)

655,719
(19,551)

30,101,994
(923,963)

4,564,330,538
(124,224,739)

v1.7.16 (.NET 4.5)   Linux

CHDN004_1

17/07/2019 12:49:20

1 hour 31 mins 3 secs

1,571

24

67.1%
(DNS: 2.1%, Conn: 0.7%
T-out: 2.9%, 404s: 13.2%
Robots: 2.5%, Other: 11.4%)

680,530
(20,082)

30,628,612
(942,130)

5,502,277,873
(147,429,832)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_1

17/07/2019 12:49:52

16 mins 0 sec

140

21

74.3%
(DNS: 0.0%, Conn: 0.5%
T-out: 18.8%, 404s: 3.5%
Robots: 0.0%, Other: 2.8%)

658,331
(20,318)

31,246,661
(947,335)

4,649,883,853
(130,819,377)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_5

17/07/2019 12:50:20

1 hour 1 min 2 secs

563

16

78.5%
(DNS: 0.1%, Conn: 0.3%
T-out: 6.1%, 404s: 6.1%
Robots: 0.1%, Other: 8.7%)

694,981
(20,224)

31,270,850
(946,892)

5,191,936,155
(139,080,494)

v1.7.16 (.NET 4.5)   Linux

CHDN004_9

17/07/2019 12:51:30

1 hour 1 min 1 sec

433

26

74.6%
(DNS: 1.5%, Conn: 0.1%
T-out: 8.4%, 404s: 12.7%
Robots: 0.1%, Other: 2.5%)

683,427
(19,184)

30,900,737
(940,894)

1,796,800,738
(55,633,601)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_5

17/07/2019 12:51:52

1 hour 46 mins 2 secs

1,066

10

69.0%
(DNS: 2.5%, Conn: 0.7%
T-out: 3.1%, 404s: 12.3%
Robots: 2.9%, Other: 9.5%)

683,936
(20,558)

31,993,158
(971,524)

6,976,092,355
(179,462,323)

v1.7.16 (.NET 4.5)   Linux

CHDN003_1

17/07/2019 12:51:57

1 hour 31 mins 3 secs

1,248

12

68.6%
(DNS: 2.9%, Conn: 0.7%
T-out: 4.2%, 404s: 11.4%
Robots: 2.1%, Other: 10.0%)

716,824
(22,050)

33,489,128
(1,016,655)

5,172,759,834
(135,617,577)

Total (19 nodes)

12,810

514

-

12,352,033
(371,397)

578,530,342
(17,618,637)

91,430,169,933
(2,449,932,476)

The following chart shows Majestic12's contribution (blue) to overall crawling effort by day.

Last updated: 17 Jul 2019 12:55:11:580 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12