Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Majestic12

Country:

United Kingdom United Kingdom

ID:

3684

Team:

Not in a team yet. Join one now!

Joined:

01/10/2010 14:16:00

URLs crawled:

578,939,681,505

Data (MB)*:

13,934,869,183

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

CHDN004_1

17/07/2019 18:40:43

1 hour 16 mins 1 sec

1,278

10

74.1%
(DNS: 1.1%, Conn: 0.6%
T-out: 3.7%, 404s: 9.6%
Robots: 3.3%, Other: 7.6%)

824,039
(23,982)

30,772,121
(946,030)

5,502,421,382
(147,433,732)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_5

17/07/2019 18:40:53

46 mins 1 sec

232

20

73.4%
(DNS: 5.6%, Conn: 0.0%
T-out: 11.8%, 404s: 1.1%
Robots: 0.0%, Other: 8.1%)

877,302
(25,934)

31,453,171
(952,602)

5,192,118,476
(139,086,204)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_1

17/07/2019 18:41:34

1 min 0 sec

539

n/a

98.3%
(DNS: 0.0%, Conn: 0.8%
T-out: 0.0%, 404s: 0.0%
Robots: 0.0%, Other: 0.8%)

830,847
(25,728)

31,419,177
(952,745)

4,650,056,369
(130,824,787)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_1

17/07/2019 18:41:45

31 mins 0 sec

390

19

87.5%
(DNS: 0.0%, Conn: 0.1%
T-out: 0.7%, 404s: 7.8%
Robots: 0.0%, Other: 4.0%)

874,894
(26,998)

31,863,770
(967,264)

5,146,427,967
(138,636,716)

v1.7.16 (.NET 4.5)   Linux

CHDN003_1

17/07/2019 18:41:48

1 hour 16 mins 1 sec

934

12

76.9%
(DNS: 1.8%, Conn: 0.3%
T-out: 1.0%, 404s: 7.8%
Robots: 3.4%, Other: 8.9%)

897,673
(27,054)

33,669,977
(1,021,659)

5,172,940,683
(135,622,581)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_5

17/07/2019 18:42:03

1 hour 31 mins 2 secs

981

9

74.3%
(DNS: 2.4%, Conn: 1.2%
T-out: 1.3%, 404s: 9.8%
Robots: 2.3%, Other: 8.9%)

849,572
(25,391)

32,158,794
(976,357)

6,976,257,991
(179,467,156)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_1

17/07/2019 18:46:54

1 min 0 sec

374

n/a

94.3%
(DNS: 0.0%, Conn: 0.0%
T-out: 3.8%, 404s: 0.0%
Robots: 0.0%, Other: 1.9%)

824,451
(23,888)

31,758,681
(962,514)

5,303,025,427
(134,455,442)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_5

17/07/2019 18:47:21

1 hour 31 mins 2 secs

961

8

73.9%
(DNS: 1.8%, Conn: 0.7%
T-out: 2.6%, 404s: 10.1%
Robots: 0.6%, Other: 10.4%)

832,794
(24,556)

31,078,276
(948,092)

6,111,455,046
(153,816,808)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_5

17/07/2019 18:47:25

1 min 0 sec

76

n/a

97.2%
(DNS: 0.0%, Conn: 0.0%
T-out: 2.8%, 404s: 0.0%
Robots: 0.0%, Other: 0.0%)

822,011
(25,375)

31,022,384
(942,652)

4,515,695,807
(123,653,188)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_5

17/07/2019 18:49:23

1 hour 1 min 1 sec

520

14

69.9%
(DNS: 0.5%, Conn: 0.0%
T-out: 4.3%, 404s: 7.0%
Robots: 5.2%, Other: 13.0%)

831,249
(24,362)

30,916,463
(944,829)

4,721,041,246
(128,161,527)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_1

17/07/2019 18:49:45

1 hour 31 mins 1 sec

1,247

9

77.6%
(DNS: 2.5%, Conn: 0.1%
T-out: 2.4%, 404s: 5.4%
Robots: 3.3%, Other: 8.6%)

806,639
(23,334)

30,739,077
(932,061)

3,266,670,024
(91,359,176)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_1

17/07/2019 18:50:23

3 hours 1 min 2 secs

652

5

78.5%
(DNS: 1.4%, Conn: 0.3%
T-out: 2.0%, 404s: 6.6%
Robots: 2.9%, Other: 8.3%)

796,308
(25,570)

30,880,454
(932,878)

6,671,194,733
(170,901,581)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_5

17/07/2019 18:50:28

1 hour 16 mins 1 sec

591

5

74.8%
(DNS: 1.5%, Conn: 0.7%
T-out: 2.1%, 404s: 7.9%
Robots: 2.2%, Other: 10.8%)

501,104
(15,515)

19,530,234
(612,352)

4,053,283,265
(107,962,397)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_5

17/07/2019 18:51:42

16 mins 0 sec

28

18

66.5%
(DNS: 0.0%, Conn: 0.0%
T-out: 1.6%, 404s: 0.0%
Robots: 31.7%, Other: 0.2%)

836,605
(24,922)

30,826,591
(943,644)

5,600,695,119
(152,599,187)

v1.7.16 (.NET 4.5)   Linux

CHDN004_9

17/07/2019 18:52:54

3 hours 1 min 1 sec

532

4

80.4%
(DNS: 1.2%, Conn: 0.1%
T-out: 2.7%, 404s: 6.5%
Robots: 3.1%, Other: 6.0%)

864,642
(24,528)

31,081,952
(946,238)

1,796,981,953
(55,638,945)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_5

17/07/2019 18:53:08

46 mins 0 sec

164

17

66.8%
(DNS: 0.1%, Conn: 1.0%
T-out: 3.4%, 404s: 13.4%
Robots: 4.2%, Other: 11.0%)

857,393
(26,916)

31,082,835
(936,384)

2,598,855,915
(74,493,114)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_1

17/07/2019 18:53:12

16 mins 0 sec

244

16

79.9%
(DNS: 0.1%, Conn: 0.0%
T-out: 1.9%, 404s: 6.0%
Robots: 9.8%, Other: 2.4%)

856,886
(26,447)

30,746,035
(936,900)

4,863,355,767
(133,044,715)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_1

17/07/2019 18:53:15

1 hour 46 mins 2 secs

1,103

8

72.9%
(DNS: 0.6%, Conn: 0.1%
T-out: 2.9%, 404s: 11.1%
Robots: 3.4%, Other: 9.1%)

800,167
(25,202)

30,516,618
(933,329)

4,726,450,487
(128,644,337)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_1

17/07/2019 18:53:35

1 min 0 sec

300

n/a

95.2%
(DNS: 0.0%, Conn: 0.0%
T-out: 4.8%, 404s: 0.0%
Robots: 0.0%, Other: 0.0%)

831,741
(25,484)

30,278,016
(929,896)

4,564,506,560
(124,230,672)

Total (19 nodes)

11,146

174

-

15,616,317
(471,186)

581,794,626
(17,718,426)

91,433,434,217
(2,450,032,265)

The following chart shows Majestic12's contribution (blue) to overall crawling effort by day.

Last updated: 17 Jul 2019 18:55:12:690 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12