Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Majestic12

Country:

United Kingdom United Kingdom

ID:

3684

Team:

Not in a team yet. Join one now!

Joined:

01/10/2010 14:16:00

URLs crawled:

579,683,420,324

Data (MB)*:

13,959,769,007

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.20   Linux

CHDN004_1

23/08/2019 01:47:28

1 hour 16 mins 1 sec

1,201

57

68.3%
(DNS: 2.3%, Conn: 0.8%
T-out: 3.1%, 404s: 17.4%
Robots: 2.7%, Other: 5.4%)

141,680
(4,772)

33,312,608
(1,110,706)

5,541,432,688
(148,712,948)

v1.7.20   Linux

MJ12-leaseweb7_1

23/08/2019 01:47:30

1 hour 31 mins 3 secs

2,137

41

69.2%
(DNS: 3.5%, Conn: 1.3%
T-out: 4.3%, 404s: 15.4%
Robots: 1.5%, Other: 4.9%)

131,977
(4,964)

33,076,823
(1,111,017)

4,765,184,842
(129,926,117)

v1.7.20   Linux

CHDN004_9

23/08/2019 01:48:08

3 hours 46 mins 4 secs

2,650

52

67.9%
(DNS: 2.8%, Conn: 0.9%
T-out: 3.6%, 404s: 14.8%
Robots: 3.6%, Other: 6.3%)

178,814
(6,325)

33,709,963
(1,129,083)

1,836,435,925
(56,937,817)

v1.7.20   Linux

MJ12-leaseweb5_1

23/08/2019 01:48:30

1 hour 46 mins 3 secs

2,383

51

70.4%
(DNS: 2.3%, Conn: 1.0%
T-out: 4.0%, 404s: 13.5%
Robots: 2.8%, Other: 6.1%)

153,999
(5,963)

35,746,456
(1,217,776)

5,344,781,084
(135,853,948)

v1.7.20   Linux

MJ12-leaseweb5_5

23/08/2019 01:50:29

1 hour 46 mins 2 secs

2,622

40

68.1%
(DNS: 1.7%, Conn: 1.9%
T-out: 6.0%, 404s: 13.1%
Robots: 3.9%, Other: 5.3%)

147,058
(5,269)

35,931,961
(1,218,650)

7,018,214,539
(180,865,783)

v1.7.20   Linux

MJ12-leaseweb7_5

23/08/2019 01:53:42

1 hour 16 mins 0 sec

870

66

75.8%
(DNS: 1.2%, Conn: 0.2%
T-out: 4.0%, 404s: 9.4%
Robots: 1.4%, Other: 7.9%)

144,474
(5,369)

33,325,945
(1,138,351)

4,554,695,475
(124,960,917)

v1.7.20   Linux

MJ12-CHDN005_1

23/08/2019 01:55:00

1 hour 1 min 2 secs

217

57

63.9%
(DNS: 0.0%, Conn: 0.0%
T-out: 10.7%, 404s: 11.1%
Robots: 0.6%, Other: 13.8%)

163,029
(6,066)

34,387,797
(1,162,454)

5,186,631,548
(139,974,467)

v1.7.20   Linux

MJ12-leaseweb4_1

23/08/2019 01:55:04

2 hours 16 mins 3 secs

1,638

32

70.3%
(DNS: 0.9%, Conn: 1.0%
T-out: 5.7%, 404s: 14.3%
Robots: 3.0%, Other: 4.7%)

121,588
(4,677)

34,486,314
(1,162,440)

6,711,531,002
(172,237,980)

v1.7.20   Linux

MJ12-CHDN005_5

23/08/2019 01:57:03

1 hour 1 min 3 secs

371

46

67.3%
(DNS: 0.1%, Conn: 0.0%
T-out: 14.6%, 404s: 10.7%
Robots: 0.3%, Other: 7.0%)

148,130
(6,128)

34,587,298
(1,170,044)

5,232,466,187
(140,431,082)

v1.7.20 RC1   Linux

CHDN003_1

23/08/2019 01:57:44

1 hour 1 min 1 sec

636

40

62.4%
(DNS: 0.0%, Conn: 3.0%
T-out: 18.8%, 404s: 5.3%
Robots: 3.7%, Other: 6.8%)

161,577
(6,145)

38,591,783
(1,293,463)

5,217,929,016
(137,108,934)

v1.7.20   Linux

MJ12-CHDN007_5

23/08/2019 01:58:54

1 hour 46 mins 1 sec

2,689

45

72.0%
(DNS: 2.5%, Conn: 0.5%
T-out: 3.7%, 404s: 14.0%
Robots: 2.4%, Other: 5.0%)

137,169
(6,612)

33,869,924
(1,194,684)

4,760,607,916
(129,525,772)

v1.7.20   Linux

MJ12-CHDN006_1

23/08/2019 01:59:19

1 hour 31 mins 3 secs

2,082

39

75.3%
(DNS: 1.0%, Conn: 1.3%
T-out: 4.1%, 404s: 12.5%
Robots: 2.1%, Other: 3.7%)

133,932
(5,283)

33,714,012
(1,142,153)

4,689,540,562
(132,139,447)

v1.7.20   Linux

MJ12-CHDN006_5

23/08/2019 01:59:26

1 hour 31 mins 0 sec

1,176

26

68.2%
(DNS: 2.7%, Conn: 0.3%
T-out: 6.5%, 404s: 14.8%
Robots: 4.0%, Other: 3.6%)

89,596
(3,455)

20,506,438
(699,023)

4,077,508,312
(108,772,959)

v1.7.20   Linux

MJ12-leaseweb4_5

23/08/2019 01:59:36

2 hours 16 mins 5 secs

1,920

41

74.6%
(DNS: 3.2%, Conn: 1.6%
T-out: 3.4%, 404s: 10.3%
Robots: 2.9%, Other: 4.0%)

145,142
(6,166)

34,525,229
(1,159,976)

6,151,804,792
(155,151,900)

v1.7.20   Linux

MJ12-CHDN007_1

23/08/2019 01:59:45

1 hour 1 min 1 sec

276

29

66.2%
(DNS: 3.8%, Conn: 0.1%
T-out: 19.7%, 404s: 7.1%
Robots: 0.7%, Other: 2.4%)

159,294
(5,364)

33,278,454
(1,175,296)

3,305,602,306
(92,702,397)

v1.7.20   Linux

Leaseweb8_5

23/08/2019 01:59:49

1 hour 31 mins 2 secs

1,624

48

74.0%
(DNS: 1.2%, Conn: 0.5%
T-out: 4.7%, 404s: 13.4%
Robots: 2.5%, Other: 3.7%)

131,593
(4,606)

33,228,234
(1,110,862)

5,639,663,793
(153,880,441)

v1.7.20   Linux

MJ12-CHDN008_1

23/08/2019 01:59:49

1 hour 31 mins 3 secs

1,984

56

68.3%
(DNS: 1.4%, Conn: 1.1%
T-out: 4.1%, 404s: 16.5%
Robots: 2.6%, Other: 6.0%)

143,645
(6,044)

33,117,774
(1,174,716)

4,603,160,433
(125,573,122)

v1.7.20   Linux

Leaseweb8_1

23/08/2019 01:59:51

1 hour 46 mins 1 sec

2,095

35

71.5%
(DNS: 1.7%, Conn: 0.6%
T-out: 3.7%, 404s: 14.4%
Robots: 4.0%, Other: 4.2%)

124,563
(5,294)

32,939,160
(1,115,414)

4,901,810,259
(134,326,261)

v1.7.20   Linux

MJ12-CHDN008_5

23/08/2019 01:59:52

1 hour 31 mins 2 secs

2,255

56

72.0%
(DNS: 2.1%, Conn: 0.8%
T-out: 2.4%, 404s: 15.9%
Robots: 2.4%, Other: 4.5%)

156,421
(5,890)

33,480,075
(1,181,620)

2,638,038,563
(75,845,533)

Total (19 nodes)

30,826

857

-

2,713,681
(104,392)

635,816,248
(21,667,728)

92,177,039,242
(2,474,927,825)

The following chart shows Majestic12's contribution (blue) to overall crawling effort by day.

Last updated: 23 Aug 2019 02:00:38:613 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12