Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Majestic12

Country:

United Kingdom United Kingdom

ID:

3684

Team:

Not in a team yet. Join one now!

Joined:

01/10/2010 14:16:00

URLs crawled:

552,623,323,864

Data (MB)*:

13,097,739,933

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_5

28/04/2017 02:47:55

1 hour 36 mins 4 secs

2,462

48

83.3%
(DNS: 1.5%, Conn: 1.4%
T-out: 2.8%, 404s: 4.0%
Robots: 3.1%, Other: 3.9%)

282,606
(9,267)

50,552,626
(1,679,554)

5,780,683,046
(141,184,507)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_5

28/04/2017 02:48:19

46 mins 1 sec

1,362

26

83.2%
(DNS: 1.4%, Conn: 1.3%
T-out: 1.8%, 404s: 3.6%
Robots: 3.2%, Other: 5.5%)

292,051
(9,715)

74,104,011
(2,167,887)

3,771,986,315
(93,052,834)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_5

28/04/2017 02:49:25

1 hour 16 mins 3 secs

2,135

49

77.2%
(DNS: 1.4%, Conn: 1.1%
T-out: 2.6%, 404s: 5.0%
Robots: 5.8%, Other: 7.0%)

298,628
(9,876)

59,635,510
(1,972,265)

4,872,394,429
(117,119,101)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb2_1

28/04/2017 02:50:08

1 hour 1 min 0 sec

981

35

69.3%
(DNS: 1.1%, Conn: 0.2%
T-out: 2.7%, 404s: 6.2%
Robots: 2.5%, Other: 18.1%)

327,481
(11,194)

82,444,514
(2,761,837)

5,360,201,136
(131,417,457)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_5

28/04/2017 02:50:11

1 min 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

173,075
(5,671)

45,236,121
(1,505,742)

3,248,280,444
(82,313,444)

v1.7.16 (.NET 4.5)   Linux

CHDN004_1

28/04/2017 02:50:45

1 hour 31 mins 2 secs

963

38

76.6%
(DNS: 2.6%, Conn: 0.2%
T-out: 5.3%, 404s: 9.0%
Robots: 3.6%, Other: 2.8%)

331,771
(10,160)

29,367,184
(779,224)

4,139,892,484
(103,750,148)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_1

28/04/2017 02:51:22

1 min 0 sec

n/a

n/a

0.0%
(DNS: 0.0%, Conn: 0.0%
T-out: 100.0%, 404s: 0.0%
Robots: 0.0%, Other: 0.0%)

237,124
(8,114)

71,656,445
(2,383,670)

3,188,178,859
(84,268,652)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_1

28/04/2017 02:51:44

31 mins 1 sec

634

29

80.4%
(DNS: 0.4%, Conn: 0.2%
T-out: 1.0%, 404s: 14.2%
Robots: 1.8%, Other: 2.0%)

267,621
(8,839)

44,368,987
(1,461,196)

4,217,975,932
(99,800,574)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb3_5

28/04/2017 02:52:14

16 mins 0 sec

582

14

93.8%
(DNS: 0.0%, Conn: 0.5%
T-out: 2.6%, 404s: 2.4%
Robots: 0.0%, Other: 0.7%)

352,062
(12,545)

95,240,597
(3,207,079)

6,173,872,629
(152,699,472)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_5

28/04/2017 02:52:25

1 hour 1 min 2 secs

1,611

43

78.9%
(DNS: 1.0%, Conn: 0.3%
T-out: 4.1%, 404s: 8.9%
Robots: 1.4%, Other: 5.4%)

327,521
(11,348)

73,064,707
(2,217,798)

3,176,743,868
(80,388,639)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb2_5

28/04/2017 02:52:37

1 hour 16 mins 1 sec

1,201

36

80.5%
(DNS: 0.9%, Conn: 0.0%
T-out: 2.8%, 404s: 5.9%
Robots: 4.6%, Other: 5.2%)

360,759
(12,069)

85,016,031
(2,842,938)

4,882,064,867
(117,844,965)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb6_1

28/04/2017 02:53:23

1 hour 1 min 2 secs

2,045

34

80.6%
(DNS: 2.2%, Conn: 0.2%
T-out: 2.6%, 404s: 5.3%
Robots: 3.2%, Other: 5.9%)

317,860
(10,334)

74,956,443
(2,508,852)

1,381,291,664
(37,675,938)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_1

28/04/2017 02:54:12

1 hour 46 mins 3 secs

1,868

56

85.1%
(DNS: 1.6%, Conn: 0.7%
T-out: 0.8%, 404s: 3.9%
Robots: 3.9%, Other: 4.1%)

307,080
(10,503)

64,211,196
(1,902,763)

3,441,714,514
(87,010,799)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_1

28/04/2017 02:54:12

31 mins 1 sec

710

53

84.3%
(DNS: 0.0%, Conn: 3.4%
T-out: 2.1%, 404s: 5.2%
Robots: 0.5%, Other: 4.5%)

242,142
(8,432)

63,439,589
(1,743,903)

3,525,541,515
(90,433,189)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_1

28/04/2017 02:54:46

1 min 0 sec

4

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

252,762
(8,623)

51,070,066
(1,659,786)

5,449,839,470
(134,834,315)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_5

28/04/2017 02:55:00

1 hour 1 min 2 secs

1,344

26

83.7%
(DNS: 2.1%, Conn: 1.7%
T-out: 2.1%, 404s: 3.9%
Robots: 2.1%, Other: 4.4%)

312,731
(10,622)

73,697,308
(2,098,788)

4,217,451,261
(108,545,623)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_1

28/04/2017 02:55:03

1 hour 31 mins 2 secs

1,729

39

78.3%
(DNS: 2.3%, Conn: 0.1%
T-out: 1.5%, 404s: 6.5%
Robots: 4.2%, Other: 7.2%)

367,397
(10,741)

69,739,300
(1,760,687)

1,940,853,079
(49,511,764)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_1

28/04/2017 02:56:15

1 hour 1 min 1 sec

1,007

23

82.3%
(DNS: 1.3%, Conn: 0.1%
T-out: 1.8%, 404s: 8.0%
Robots: 3.7%, Other: 2.9%)

291,149
(9,441)

91,153,510
(3,050,225)

3,330,862,170
(84,472,697)

v1.7.16 (.NET 4.5)   Linux

evo-h121-1_5

28/04/2017 02:56:20

1 hour 31 mins 2 secs

961

41

81.4%
(DNS: 1.0%, Conn: 0.2%
T-out: 2.3%, 404s: 4.6%
Robots: 1.9%, Other: 8.7%)

321,753
(10,857)

70,854,758
(2,372,393)

5,612,180,411
(134,250,274)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb3_1

28/04/2017 02:57:26

31 mins 0 sec

1,164

27

79.9%
(DNS: 2.6%, Conn: 1.9%
T-out: 5.2%, 404s: 3.5%
Robots: 4.9%, Other: 2.0%)

397,173
(14,019)

95,286,665
(3,221,347)

5,852,258,282
(144,678,676)

v1.7.16 (.NET 4.5)   Linux

evo-h121-1_1

28/04/2017 02:57:35

46 mins 0 sec

327

28

71.0%
(DNS: 7.9%, Conn: 3.9%
T-out: 2.4%, 404s: 5.8%
Robots: 0.4%, Other: 8.7%)

248,231
(9,168)

72,332,474
(2,410,909)

5,404,175,094
(129,335,712)

v1.7.16 (.NET 4.5)   Linux

CHDN004_9

28/04/2017 02:58:54

1 hour 46 mins 2 secs

941

47

82.8%
(DNS: 2.1%, Conn: 0.1%
T-out: 3.1%, 404s: 4.7%
Robots: 2.0%, Other: 5.3%)

356,220
(12,405)

31,452,402
(879,721)

386,307,576
(10,439,359)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_1

28/04/2017 02:59:16

1 hour 46 mins 3 secs

1,598

41

82.7%
(DNS: 1.3%, Conn: 1.5%
T-out: 2.2%, 404s: 4.0%
Robots: 2.9%, Other: 5.3%)

321,772
(10,621)

72,140,551
(2,078,034)

3,749,318,327
(93,356,165)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_5

28/04/2017 02:59:52

1 hour 1 min 2 secs

884

23

82.4%
(DNS: 0.1%, Conn: 1.4%
T-out: 2.5%, 404s: 6.0%
Robots: 1.4%, Other: 6.1%)

314,341
(9,186)

77,193,042
(2,071,325)

3,353,040,221
(85,054,721)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb6_5

28/04/2017 03:01:02

46 mins 1 sec

770

31

84.6%
(DNS: 0.4%, Conn: 0.2%
T-out: 4.2%, 404s: 3.2%
Robots: 6.0%, Other: 1.5%)

351,351
(11,671)

74,178,733
(2,486,292)

1,532,950,392
(42,094,151)

v1.7.16 (.NET 4.5)   Linux

CHDN003_1

28/04/2017 03:01:10

31 mins 1 sec

947

71

72.7%
(DNS: 0.7%, Conn: 0.2%
T-out: 3.5%, 404s: 6.2%
Robots: 7.9%, Other: 8.9%)

342,006
(11,656)

82,699,124
(2,722,452)

4,160,404,380
(105,131,573)

Total (26 nodes)

28,230

858

-

7,994,667
(267,077)

1,775,091,894
(55,946,667)

102,150,462,365
(2,540,664,749)

The following chart shows Majestic12's contribution (blue) to overall crawling effort by day.

Last updated: 28 Apr 2017 03:02:28:137 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12