Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Majestic12

Country:

United Kingdom United Kingdom

ID:

3684

Team:

Not in a team yet. Join one now!

Joined:

01/10/2010 14:16:00

URLs crawled:

580,502,755,559

Data (MB)*:

13,989,781,028

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.20   Linux

MJ12-leaseweb5_1

18/10/2019 01:50:04

1 hour 31 mins 3 secs

1,625

42

61.4%
(DNS: 4.2%, Conn: 0.3%
T-out: 1.5%, 404s: 23.4%
Robots: 3.5%, Other: 5.5%)

168,571
(5,374)

20,624,035
(737,730)

5,390,919,909
(137,572,243)

v1.7.20   Linux

MJ12-CHDN005_1

18/10/2019 01:57:33

46 mins 0 sec

2,421

37

65.1%
(DNS: 1.3%, Conn: 0.7%
T-out: 3.8%, 404s: 15.3%
Robots: 4.9%, Other: 8.8%)

211,941
(6,095)

20,571,230
(723,022)

5,231,126,891
(141,611,372)

v1.7.20   Linux

Leaseweb8_1

18/10/2019 01:57:57

3 hours 31 mins 5 secs

1,615

30

60.5%
(DNS: 1.8%, Conn: 1.5%
T-out: 2.3%, 404s: 24.0%
Robots: 3.1%, Other: 6.8%)

221,529
(5,883)

19,798,822
(682,288)

4,932,423,271
(135,431,109)

v1.7.20   Linux

MJ12-leaseweb5_5

18/10/2019 01:57:59

46 mins 1 sec

1,363

43

66.3%
(DNS: 2.0%, Conn: 0.6%
T-out: 2.2%, 404s: 16.8%
Robots: 6.8%, Other: 5.1%)

199,446
(5,752)

20,948,296
(736,823)

7,064,993,652
(182,585,764)

v1.7.20   Linux

CHDN004_9

18/10/2019 01:58:00

1 hour 1 min 1 sec

1,436

37

63.8%
(DNS: 1.0%, Conn: 0.5%
T-out: 3.3%, 404s: 20.9%
Robots: 3.7%, Other: 6.8%)

198,385
(5,531)

20,925,252
(731,804)

1,882,401,468
(58,623,040)

v1.7.20   Linux

MJ12-leaseweb4_5

18/10/2019 01:58:00

3 hours 46 mins 5 secs

1,594

27

60.5%
(DNS: 3.6%, Conn: 1.1%
T-out: 2.8%, 404s: 22.8%
Robots: 3.3%, Other: 5.8%)

201,673
(5,955)

20,134,137
(703,383)

6,196,747,914
(156,799,583)

v1.7.21   Linux

MJ12-CHDN007_1

18/10/2019 01:58:03

1 hour 31 mins 3 secs

1,661

45

66.4%
(DNS: 2.3%, Conn: 0.5%
T-out: 2.4%, 404s: 22.4%
Robots: 1.3%, Other: 4.7%)

184,329
(5,247)

20,694,844
(721,667)

3,348,375,756
(94,258,388)

v1.7.20   Linux

MJ12-CHDN008_5

18/10/2019 01:58:05

1 hour 1 min 1 sec

1,310

50

64.8%
(DNS: 1.7%, Conn: 0.3%
T-out: 4.2%, 404s: 17.6%
Robots: 4.4%, Other: 6.9%)

222,917
(5,679)

20,744,056
(718,149)

2,682,760,113
(77,486,889)

v1.7.20   Linux

Leaseweb8_5

18/10/2019 01:58:09

1 hour 46 mins 1 sec

2,195

47

62.7%
(DNS: 3.0%, Conn: 0.6%
T-out: 2.1%, 404s: 22.6%
Robots: 3.0%, Other: 6.0%)

190,780
(5,931)

20,325,411
(702,095)

5,684,554,057
(155,516,033)

v1.7.20 RC1   Linux

CHDN003_1

18/10/2019 01:58:16

1 hour 46 mins 3 secs

2,313

35

59.7%
(DNS: 3.5%, Conn: 0.5%
T-out: 2.8%, 404s: 23.6%
Robots: 3.1%, Other: 6.8%)

195,242
(5,189)

21,385,491
(743,085)

5,266,222,911
(138,880,605)

v1.7.20   Linux

MJ12-leaseweb7_5

18/10/2019 01:58:17

1 hour 46 mins 3 secs

1,724

43

60.2%
(DNS: 4.7%, Conn: 1.1%
T-out: 2.7%, 404s: 20.8%
Robots: 3.5%, Other: 6.9%)

206,945
(5,883)

20,661,999
(714,434)

4,599,648,538
(126,613,881)

v1.7.21   Linux

MJ12-CHDN007_5

18/10/2019 01:58:19

1 min 0 sec

127

n/a

66.7%
(DNS: 0.0%, Conn: 0.0%
T-out: 1.7%, 404s: 26.7%
Robots: 0.0%, Other: 5.0%)

192,418
(5,196)

20,645,251
(711,431)

4,803,410,589
(131,081,121)

v1.7.20   Linux

MJ12-CHDN005_5

18/10/2019 01:58:22

1 hour 16 mins 4 secs

1,099

46

71.5%
(DNS: 0.8%, Conn: 0.4%
T-out: 2.9%, 404s: 17.4%
Robots: 1.5%, Other: 5.4%)

204,276
(5,646)

20,657,018
(722,554)

5,277,231,158
(142,071,477)

v1.7.20   Linux

CHDN004_1

18/10/2019 01:58:22

1 hour 46 mins 3 secs

1,810

45

63.4%
(DNS: 3.0%, Conn: 0.5%
T-out: 3.2%, 404s: 21.1%
Robots: 2.6%, Other: 6.2%)

199,773
(5,650)

20,762,789
(723,628)

5,587,060,799
(150,376,543)

v1.7.20   Linux

MJ12-leaseweb7_1

18/10/2019 01:58:24

1 hour 31 mins 3 secs

1,573

43

70.0%
(DNS: 1.6%, Conn: 1.3%
T-out: 2.6%, 404s: 16.6%
Robots: 2.1%, Other: 5.9%)

194,608
(5,689)

20,491,687
(712,327)

4,809,989,091
(131,557,557)

v1.7.20   Linux

MJ12-CHDN006_1

18/10/2019 01:58:25

46 mins 1 sec

904

30

58.8%
(DNS: 4.4%, Conn: 1.9%
T-out: 2.0%, 404s: 22.6%
Robots: 3.3%, Other: 7.0%)

223,245
(5,826)

21,086,752
(730,453)

4,731,102,988
(133,651,166)

v1.7.20   Linux

MJ12-leaseweb4_1

18/10/2019 01:58:30

3 hours 16 mins 3 secs

1,934

32

60.1%
(DNS: 3.0%, Conn: 1.0%
T-out: 1.8%, 404s: 23.6%
Robots: 3.9%, Other: 6.6%)

217,516
(5,770)

19,869,743
(691,664)

6,755,609,167
(173,848,492)

v1.7.20   Linux

MJ12-CHDN006_5

18/10/2019 01:58:31

31 mins 1 sec

916

37

73.1%
(DNS: 0.1%, Conn: 1.4%
T-out: 2.6%, 404s: 16.8%
Robots: 1.2%, Other: 4.8%)

110,736
(3,108)

13,529,143
(480,476)

4,103,851,888
(109,756,178)

v1.7.20   Linux

MJ12-CHDN008_1

18/10/2019 01:58:32

1 hour 46 mins 3 secs

2,132

49

58.7%
(DNS: 3.8%, Conn: 0.5%
T-out: 3.1%, 404s: 23.4%
Robots: 2.6%, Other: 7.9%)

204,946
(5,824)

20,546,043
(720,208)

4,647,944,317
(127,218,405)

Total (19 nodes)

29,752

718

-

3,749,276
(105,228)

384,401,999
(13,407,221)

92,996,374,477
(2,504,939,846)

The following chart shows Majestic12's contribution (blue) to overall crawling effort by day.

Last updated: 18 Oct 2019 01:59:15:193 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12