Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Majestic12

Country:

United Kingdom United Kingdom

ID:

3684

Team:

Not in a team yet. Join one now!

Joined:

01/10/2010 14:16:00

URLs crawled:

575,389,968,189

Data (MB)*:

13,828,160,545

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_1

16/01/2019 20:43:19

1 hour 16 mins 2 secs

1,660

13

76.9%
(DNS: 1.6%, Conn: 0.5%
T-out: 1.7%, 404s: 7.0%
Robots: 4.0%, Other: 8.3%)

1,199,525
(37,953)

38,567,883
(1,201,577)

4,954,334,059
(132,845,693)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_5

16/01/2019 20:47:53

1 hour 46 mins 2 secs

1,026

12

75.4%
(DNS: 1.1%, Conn: 0.7%
T-out: 3.3%, 404s: 4.6%
Robots: 4.8%, Other: 10.1%)

1,288,821
(38,051)

41,112,973
(1,247,855)

6,773,724,771
(173,448,077)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_1

16/01/2019 20:48:42

1 hour 46 mins 2 secs

989

11

72.4%
(DNS: 2.0%, Conn: 0.6%
T-out: 1.3%, 404s: 7.4%
Robots: 3.9%, Other: 12.5%)

1,239,212
(38,121)

39,257,616
(1,204,510)

4,675,620,515
(127,417,369)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_5

16/01/2019 20:49:29

16 mins 0 sec

498

20

85.4%
(DNS: 0.0%, Conn: 0.0%
T-out: 1.0%, 404s: 11.0%
Robots: 1.0%, Other: 1.6%)

1,210,262
(37,584)

38,169,297
(1,216,007)

4,328,899,986
(117,994,152)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_5

16/01/2019 20:51:34

31 mins 1 sec

303

17

86.0%
(DNS: 0.1%, Conn: 0.1%
T-out: 6.8%, 404s: 2.7%
Robots: 1.1%, Other: 3.2%)

1,237,727
(39,985)

39,862,331
(1,236,307)

5,000,631,670
(133,308,951)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_5

16/01/2019 20:52:13

3 hours 46 mins 2 secs

1,100

11

81.9%
(DNS: 0.8%, Conn: 0.1%
T-out: 2.8%, 404s: 6.7%
Robots: 3.0%, Other: 4.7%)

1,040,955
(33,939)

30,343,657
(972,331)

5,927,337,891
(148,246,201)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_1

16/01/2019 20:52:31

3 hours 46 mins 4 secs

1,182

13

81.5%
(DNS: 0.8%, Conn: 0.9%
T-out: 2.5%, 404s: 6.7%
Robots: 3.1%, Other: 4.5%)

1,029,495
(32,823)

29,234,222
(937,416)

6,487,901,863
(165,369,687)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_5

16/01/2019 20:52:31

1 hour 31 mins 1 sec

1,323

8

73.5%
(DNS: 1.2%, Conn: 2.3%
T-out: 3.9%, 404s: 5.8%
Robots: 2.4%, Other: 10.9%)

1,297,523
(39,041)

39,559,263
(1,205,152)

5,410,711,678
(146,876,796)

v1.7.16 (.NET 4.5)   Linux

CHDN004_1

16/01/2019 20:53:09

16 mins 1 sec

76

20

53.7%
(DNS: 0.0%, Conn: 0.1%
T-out: 45.8%, 404s: 0.0%
Robots: 0.0%, Other: 0.4%)

1,245,109
(39,185)

38,857,059
(1,193,416)

5,316,123,882
(141,820,169)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_5

16/01/2019 20:54:01

1 hour 31 mins 0 sec

1,159

10

86.4%
(DNS: 0.2%, Conn: 1.9%
T-out: 2.9%, 404s: 3.3%
Robots: 3.2%, Other: 2.1%)

1,092,780
(37,546)

38,228,184
(1,196,313)

2,411,825,270
(68,877,839)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_1

16/01/2019 20:54:05

1 hour 31 mins 1 sec

1,420

9

80.9%
(DNS: 2.1%, Conn: 0.7%
T-out: 3.1%, 404s: 5.6%
Robots: 3.5%, Other: 4.2%)

1,128,844
(36,991)

36,257,980
(1,142,832)

4,378,942,679
(118,621,727)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_5

16/01/2019 20:55:08

1 hour 46 mins 0 sec

1,103

10

76.4%
(DNS: 0.7%, Conn: 1.1%
T-out: 2.0%, 404s: 6.5%
Robots: 2.6%, Other: 10.6%)

1,305,235
(41,371)

40,278,384
(1,234,721)

4,534,800,030
(122,541,856)

v1.7.16 (.NET 4.5)   Linux

CHDN004_9

16/01/2019 20:55:34

1 min 0 sec

94

n/a

88.9%
(DNS: 0.0%, Conn: 0.0%
T-out: 11.1%, 404s: 0.0%
Robots: 0.0%, Other: 0.0%)

1,324,836
(41,455)

39,920,668
(1,228,570)

1,609,522,202
(49,991,400)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_5

16/01/2019 20:55:58

1 hour 31 mins 0 sec

1,220

7

77.5%
(DNS: 1.5%, Conn: 0.4%
T-out: 1.7%, 404s: 8.8%
Robots: 2.4%, Other: 7.6%)

766,864
(22,835)

25,364,485
(776,152)

3,932,604,299
(104,290,911)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_1

16/01/2019 20:56:00

1 hour 46 mins 1 sec

1,295

17

78.1%
(DNS: 0.9%, Conn: 0.1%
T-out: 2.6%, 404s: 8.5%
Robots: 3.3%, Other: 6.4%)

1,320,152
(40,894)

39,183,248
(1,192,763)

5,106,207,673
(128,583,979)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_1

16/01/2019 20:56:03

46 mins 0 sec

1,975

16

85.7%
(DNS: 0.2%, Conn: 0.2%
T-out: 2.7%, 404s: 5.6%
Robots: 0.8%, Other: 4.8%)

1,365,642
(42,476)

40,789,373
(1,245,919)

4,459,434,372
(125,095,516)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_1

16/01/2019 20:56:09

1 hour 46 mins 1 sec

1,057

15

73.3%
(DNS: 0.7%, Conn: 0.6%
T-out: 1.6%, 404s: 4.2%
Robots: 7.2%, Other: 12.4%)

1,262,764
(38,017)

39,873,641
(1,227,201)

3,079,355,615
(85,727,658)

v1.7.16 (.NET 4.5)   Linux

CHDN003_1

16/01/2019 20:56:10

46 mins 1 sec

581

17

83.4%
(DNS: 0.0%, Conn: 0.3%
T-out: 1.4%, 404s: 5.4%
Robots: 6.9%, Other: 2.5%)

1,382,479
(36,159)

46,228,702
(1,202,388)

4,953,232,322
(129,215,855)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_1

16/01/2019 20:56:20

16 mins 0 sec

339

17

75.0%
(DNS: 0.1%, Conn: 1.0%
T-out: 12.8%, 404s: 8.5%
Robots: 0.0%, Other: 2.7%)

1,188,952
(36,811)

35,729,382
(1,122,905)

4,542,510,124
(123,049,791)

Total (19 nodes)

18,400

243

-

22,927,177
(711,237)

716,818,348
(21,984,335)

87,883,720,901
(2,343,323,627)

The following chart shows Majestic12's contribution (blue) to overall crawling effort by day.

Last updated: 16 Jan 2019 20:57:02:667 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12