Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Majestic12

Country:

United Kingdom United Kingdom

ID:

3684

Team:

Not in a team yet. Join one now!

Joined:

01/10/2010 14:16:00

URLs crawled:

571,242,230,485

Data (MB)*:

13,700,819,060

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_5

19/07/2018 01:43:33

46 mins 0 sec

95

11

79.0%
(DNS: 0.0%, Conn: 0.0%
T-out: 3.4%, 404s: 12.4%
Robots: 1.1%, Other: 4.1%)

55,276
(2,267)

48,360,765
(1,562,813)

4,106,394,450
(110,884,878)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_5

19/07/2018 01:44:38

46 mins 1 sec

55

5

77.2%
(DNS: 0.0%, Conn: 0.0%
T-out: 16.2%, 404s: 0.7%
Robots: 0.0%, Other: 5.9%)

64,274
(2,120)

51,435,127
(1,653,688)

4,766,482,789
(125,886,434)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_5

19/07/2018 01:44:39

1 hour 31 mins 0 sec

1,203

13

77.8%
(DNS: 1.9%, Conn: 0.3%
T-out: 2.0%, 404s: 5.9%
Robots: 3.5%, Other: 8.6%)

66,865
(2,436)

53,057,242
(1,540,832)

4,293,541,171
(115,281,510)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_1

19/07/2018 01:44:49

1 hour 1 min 1 sec

235

12

70.6%
(DNS: 0.1%, Conn: 0.1%
T-out: 9.5%, 404s: 7.1%
Robots: 5.2%, Other: 7.3%)

69,062
(2,209)

50,499,132
(1,486,683)

4,443,753,304
(120,372,548)

v1.7.16 (.NET 4.5)   Linux

CHDN004_9

19/07/2018 01:45:42

1 min 0 sec

n/a

n/a

33.3%
(DNS: 0.0%, Conn: 0.0%
T-out: 33.3%, 404s: 33.3%
Robots: 0.0%, Other: 0.0%)

81,365
(2,386)

52,646,771
(1,535,928)

1,367,956,388
(42,662,260)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_5

19/07/2018 01:46:00

31 mins 0 sec

284

14

86.1%
(DNS: 0.2%, Conn: 0.0%
T-out: 1.4%, 404s: 4.2%
Robots: 0.0%, Other: 8.0%)

71,883
(2,649)

43,535,558
(1,041,242)

5,744,795,252
(142,685,272)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_1

19/07/2018 01:46:55

1 hour 46 mins 2 secs

1,462

15

78.2%
(DNS: 0.3%, Conn: 0.4%
T-out: 3.9%, 404s: 7.3%
Robots: 4.9%, Other: 5.0%)

63,608
(2,644)

37,587,782
(1,221,211)

4,893,545,759
(122,063,943)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_1

19/07/2018 01:47:28

16 mins 1 sec

11

n/a

77.8%
(DNS: 0.0%, Conn: 0.0%
T-out: 22.2%, 404s: 0.0%
Robots: 0.0%, Other: 0.0%)

71,370
(2,786)

45,933,818
(1,497,275)

4,163,442,549
(111,788,334)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_1

19/07/2018 01:49:02

1 hour 16 mins 0 sec

482

13

90.3%
(DNS: 0.0%, Conn: 0.5%
T-out: 2.4%, 404s: 2.3%
Robots: 0.0%, Other: 4.5%)

66,656
(2,202)

52,824,706
(1,541,619)

4,214,603,678
(117,701,512)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_5

19/07/2018 01:50:19

1 min 0 sec

11

n/a

40.0%
(DNS: 0.0%, Conn: 60.0%
T-out: 0.0%, 404s: 0.0%
Robots: 0.0%, Other: 0.0%)

52,580
(2,456)

49,525,337
(1,596,543)

2,184,177,759
(61,662,999)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_1

19/07/2018 01:51:33

1 min 0 sec

65

n/a

100.0%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.0%, 404s: 0.0%
Robots: 0.0%, Other: 0.0%)

54,167
(2,138)

50,120,194
(1,621,684)

4,727,356,457
(125,629,440)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_1

19/07/2018 01:52:10

16 mins 1 sec

37

n/a

95.5%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.0%, 404s: 0.0%
Robots: 0.0%, Other: 4.5%)

61,363
(2,096)

45,220,077
(1,463,019)

4,329,025,652
(116,238,266)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_5

19/07/2018 01:52:36

16 mins 0 sec

11

2

70.2%
(DNS: 0.0%, Conn: 0.0%
T-out: 21.2%, 404s: 0.0%
Robots: 0.0%, Other: 8.7%)

54,127
(1,882)

40,876,429
(1,318,424)

6,556,456,739
(166,710,250)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_5

19/07/2018 01:54:56

16 mins 0 sec

196

3

81.2%
(DNS: 0.0%, Conn: 6.8%
T-out: 0.1%, 404s: 11.0%
Robots: 0.9%, Other: 0.0%)

54,426
(1,513)

30,898,402
(894,293)

3,785,114,129
(99,802,922)

v1.7.16 (.NET 4.5)   Linux

CHDN003_1

19/07/2018 01:55:19

31 mins 0 sec

5

1

100.0%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.0%, 404s: 0.0%
Robots: 0.0%, Other: 0.0%)

66,703
(2,435)

47,200,307
(1,368,437)

4,750,605,123
(123,607,426)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_1

19/07/2018 01:55:39

31 mins 0 sec

5

2

100.0%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.0%, 404s: 0.0%
Robots: 0.0%, Other: 0.0%)

76,757
(3,012)

51,257,940
(1,496,137)

2,841,215,816
(78,571,378)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_5

19/07/2018 01:56:05

1 hour 16 mins 1 sec

143

7

93.0%
(DNS: 0.0%, Conn: 0.1%
T-out: 0.3%, 404s: 0.0%
Robots: 0.0%, Other: 6.5%)

42,311
(1,940)

51,201,132
(1,483,269)

5,172,793,197
(139,700,680)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_1

19/07/2018 01:56:05

3 hours 46 mins 2 secs

1,352

15

79.1%
(DNS: 3.9%, Conn: 0.4%
T-out: 1.6%, 404s: 9.0%
Robots: 2.8%, Other: 3.3%)

72,101
(2,557)

42,976,564
(1,021,661)

6,309,351,215
(159,938,831)

v1.7.16 (.NET 4.5)   Linux

CHDN004_1

19/07/2018 01:56:50

1 hour 46 mins 1 sec

1,276

11

77.8%
(DNS: 2.1%, Conn: 0.2%
T-out: 2.0%, 404s: 4.9%
Robots: 4.3%, Other: 8.7%)

73,619
(2,100)

52,101,639
(1,518,658)

5,085,371,770
(134,793,259)

Total (19 nodes)

6,928

124

-

1,218,513
(43,828)

897,258,922
(26,863,416)

83,735,983,197
(2,215,982,142)

The following chart shows Majestic12's contribution (blue) to overall crawling effort by day.

Last updated: 19 Jul 2018 01:58:17:953 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12