Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Majestic12

Country:

United Kingdom United Kingdom

ID:

3684

Team:

Not in a team yet. Join one now!

Joined:

01/10/2010 14:16:00

URLs crawled:

576,793,132,089

Data (MB)*:

13,870,316,985

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_1

26/03/2019 18:37:25

1 hour 46 mins 1 sec

1,173

9

71.3%
(DNS: 1.5%, Conn: 1.2%
T-out: 4.4%, 404s: 6.3%
Robots: 5.1%, Other: 10.4%)

894,081
(26,409)

31,930,212
(968,111)

4,534,197,735
(127,338,060)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_5

26/03/2019 18:38:45

1 hour 31 mins 1 sec

792

7

71.5%
(DNS: 1.3%, Conn: 1.5%
T-out: 3.2%, 404s: 6.9%
Robots: 3.4%, Other: 12.2%)

894,834
(27,185)

33,262,307
(1,004,337)

5,994,684,177
(150,318,788)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_5

26/03/2019 18:39:00

1 hour 16 mins 1 sec

982

9

73.6%
(DNS: 3.2%, Conn: 0.3%
T-out: 4.9%, 404s: 5.6%
Robots: 2.5%, Other: 9.9%)

888,918
(28,794)

31,666,442
(962,652)

5,487,674,570
(149,185,364)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_1

26/03/2019 18:39:04

1 hour 31 mins 1 sec

900

7

70.7%
(DNS: 4.1%, Conn: 0.4%
T-out: 2.7%, 404s: 4.7%
Robots: 1.6%, Other: 15.7%)

899,874
(29,094)

33,230,546
(1,001,844)

6,554,681,366
(167,427,521)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_5

26/03/2019 18:39:23

1 hour 16 mins 1 sec

1,368

5

70.9%
(DNS: 1.6%, Conn: 0.2%
T-out: 2.1%, 404s: 11.0%
Robots: 3.0%, Other: 11.2%)

878,743
(26,003)

30,749,057
(940,664)

4,608,690,409
(124,777,631)

v1.7.16 (.NET 4.5)   Linux

CHDN003_1

26/03/2019 18:39:47

1 hour 1 min 1 sec

1,560

13

72.7%
(DNS: 3.1%, Conn: 0.3%
T-out: 2.5%, 404s: 8.7%
Robots: 2.5%, Other: 10.1%)

986,152
(30,685)

41,563,545
(1,225,907)

5,044,258,178
(131,776,091)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_1

26/03/2019 18:41:51

1 hour 16 mins 1 sec

1,445

16

73.2%
(DNS: 1.4%, Conn: 1.4%
T-out: 0.8%, 404s: 3.9%
Robots: 4.0%, Other: 15.2%)

952,442
(29,759)

31,371,875
(955,284)

4,751,255,051
(129,675,897)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_5

26/03/2019 18:41:52

1 hour 16 mins 2 secs

1,452

8

71.1%
(DNS: 2.1%, Conn: 1.4%
T-out: 3.5%, 404s: 9.3%
Robots: 2.8%, Other: 9.7%)

900,646
(29,617)

32,764,936
(993,667)

5,075,583,100
(135,574,481)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_1

26/03/2019 18:42:03

1 min 0 sec

452

n/a

93.1%
(DNS: 1.0%, Conn: 0.0%
T-out: 0.0%, 404s: 1.0%
Robots: 0.0%, Other: 5.0%)

911,898
(28,713)

31,161,350
(947,465)

3,153,768,264
(87,967,341)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_5

26/03/2019 18:42:25

1 hour 16 mins 2 secs

1,281

14

79.1%
(DNS: 2.7%, Conn: 0.5%
T-out: 0.9%, 404s: 6.1%
Robots: 2.5%, Other: 8.3%)

884,368
(27,984)

30,996,664
(940,925)

4,402,742,200
(120,258,589)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_1

26/03/2019 18:44:09

1 hour 16 mins 1 sec

1,348

9

66.8%
(DNS: 1.1%, Conn: 0.8%
T-out: 2.3%, 404s: 8.6%
Robots: 4.4%, Other: 16.0%)

919,493
(28,509)

32,952,351
(999,331)

5,029,769,392
(135,129,656)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_1

26/03/2019 18:45:01

1 hour 16 mins 0 sec

1,143

10

76.2%
(DNS: 1.0%, Conn: 0.7%
T-out: 3.4%, 404s: 3.9%
Robots: 4.3%, Other: 10.4%)

902,435
(29,257)

31,426,626
(952,509)

4,453,195,651
(120,867,562)

v1.7.16 (.NET 4.5)   Linux

CHDN004_1

26/03/2019 18:46:05

46 mins 1 sec

119

8

74.0%
(DNS: 0.0%, Conn: 0.5%
T-out: 11.8%, 404s: 1.7%
Robots: 0.0%, Other: 12.0%)

863,256
(26,429)

31,110,399
(942,833)

5,389,693,833
(144,027,223)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_1

26/03/2019 18:46:53

1 hour 46 mins 2 secs

1,244

7

72.9%
(DNS: 0.4%, Conn: 1.3%
T-out: 1.1%, 404s: 9.3%
Robots: 5.0%, Other: 9.8%)

783,993
(24,218)

31,066,840
(949,262)

4,614,314,395
(125,258,732)

v1.7.16 (.NET 4.5)   Linux

CHDN004_9

26/03/2019 18:47:01

16 mins 1 sec

61

9

49.4%
(DNS: 0.0%, Conn: 0.0%
T-out: 24.3%, 404s: 7.0%
Robots: 0.0%, Other: 19.3%)

910,892
(28,430)

31,761,032
(965,834)

1,683,893,518
(52,223,582)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_5

26/03/2019 18:47:47

31 mins 0 sec

53

7

91.0%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.1%, 404s: 3.2%
Robots: 0.0%, Other: 5.7%)

865,729
(26,708)

31,644,063
(954,629)

2,486,173,902
(71,120,867)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_5

26/03/2019 18:49:35

1 min 0 sec

37

20

9.4%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.0%, 404s: 0.0%
Robots: 0.0%, Other: 90.6%)

556,287
(18,494)

21,663,461
(653,493)

3,980,774,694
(105,742,080)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_5

26/03/2019 18:50:35

16 mins 0 sec

136

8

48.6%
(DNS: 0.0%, Conn: 0.0%
T-out: 43.8%, 404s: 7.3%
Robots: 0.0%, Other: 0.3%)

903,571
(27,459)

36,180,408
(1,061,730)

6,856,145,429
(175,878,007)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_1

26/03/2019 18:51:00

1 hour 16 mins 1 sec

874

10

72.9%
(DNS: 2.5%, Conn: 0.2%
T-out: 1.6%, 404s: 12.9%
Robots: 2.0%, Other: 8.0%)

868,531
(25,777)

34,768,639
(1,037,315)

5,185,388,937
(130,932,595)

Total (19 nodes)

16,420

176

-

16,666,143
(519,524)

611,270,753
(18,457,792)

89,286,884,801
(2,385,480,067)

The following chart shows Majestic12's contribution (blue) to overall crawling effort by day.

Last updated: 26 Mar 2019 18:52:04:257 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12