Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

|MatMan|

Country:

Germany Germany

ID:

1251

Team:

Not in a team yet. Join one now!

Joined:

29/08/2006 10:20:00

URLs crawled:

82,432,421,795

Data (MB)*:

2,328,938,244

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

MatVM-XU03

16/02/2019 08:40:52

2 hours 1 min 2 secs

547

6

72.0%
(DNS: 0.3%, Conn: 1.6%
T-out: 1.0%, 404s: 7.4%
Robots: 2.9%, Other: 14.9%)

481,629
(15,814)

36,053,040
(1,079,256)

3,668,203,748
(102,697,115)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU08

16/02/2019 08:42:43

3 hours 46 mins 3 secs

751

11

80.1%
(DNS: 1.0%, Conn: 1.4%
T-out: 1.3%, 404s: 5.9%
Robots: 1.3%, Other: 8.9%)

355,305
(11,346)

32,378,728
(986,302)

1,140,394,348
(36,550,929)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU06

16/02/2019 08:42:51

3 hours 46 mins 3 secs

624

12

76.9%
(DNS: 1.3%, Conn: 1.4%
T-out: 2.2%, 404s: 5.0%
Robots: 2.8%, Other: 10.4%)

414,284
(14,616)

32,636,692
(1,005,755)

1,162,472,234
(37,329,208)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU03

16/02/2019 08:42:55

3 hours 46 mins 3 secs

806

11

80.6%
(DNS: 1.7%, Conn: 0.2%
T-out: 1.6%, 404s: 6.2%
Robots: 2.4%, Other: 7.3%)

409,758
(14,129)

30,175,152
(932,617)

1,194,592,069
(38,299,345)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU02

16/02/2019 08:42:57

3 hours 46 mins 3 secs

636

10

75.8%
(DNS: 0.6%, Conn: 0.6%
T-out: 2.6%, 404s: 9.7%
Robots: 4.0%, Other: 6.7%)

429,428
(13,671)

32,077,584
(985,832)

1,194,738,412
(38,307,419)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU05

16/02/2019 08:43:02

3 hours 46 mins 3 secs

567

10

81.1%
(DNS: 0.5%, Conn: 1.3%
T-out: 2.8%, 404s: 4.0%
Robots: 2.3%, Other: 7.9%)

394,782
(12,319)

32,335,022
(981,745)

1,149,793,537
(36,845,103)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU07

16/02/2019 08:43:04

3 hours 46 mins 3 secs

646

15

78.2%
(DNS: 0.5%, Conn: 0.8%
T-out: 1.7%, 404s: 4.9%
Robots: 2.9%, Other: 11.0%)

417,326
(13,753)

29,024,665
(890,292)

1,092,890,009
(35,114,636)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU09

16/02/2019 08:43:06

3 hours 46 mins 3 secs

616

11

72.7%
(DNS: 1.2%, Conn: 1.0%
T-out: 2.1%, 404s: 7.5%
Robots: 6.4%, Other: 9.0%)

415,321
(12,417)

31,994,508
(974,483)

1,092,744,762
(34,955,562)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU10

16/02/2019 08:43:15

3 hours 46 mins 3 secs

667

11

79.1%
(DNS: 0.4%, Conn: 0.4%
T-out: 1.8%, 404s: 5.2%
Robots: 4.4%, Other: 8.7%)

404,995
(12,012)

28,331,743
(853,880)

953,660,820
(30,429,639)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU01

16/02/2019 08:43:16

3 hours 46 mins 3 secs

787

10

75.4%
(DNS: 1.3%, Conn: 0.5%
T-out: 2.0%, 404s: 7.0%
Robots: 4.0%, Other: 9.7%)

404,794
(12,861)

29,843,648
(916,121)

1,285,893,261
(40,268,364)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU04

16/02/2019 08:43:25

31 mins 1 sec

523

11

90.4%
(DNS: 0.1%, Conn: 0.1%
T-out: 0.0%, 404s: 4.7%
Robots: 0.0%, Other: 4.6%)

403,513
(12,183)

35,748,813
(1,069,643)

3,650,420,839
(101,688,230)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU04

16/02/2019 08:43:25

3 hours 46 mins 30 secs

551

8

73.2%
(DNS: 1.0%, Conn: 0.4%
T-out: 6.6%, 404s: 7.3%
Robots: 2.7%, Other: 8.9%)

367,219
(12,123)

32,086,959
(981,869)

1,182,010,446
(37,874,928)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU01

16/02/2019 08:43:36

5 hours 1 min 7 secs

1,006

13

81.6%
(DNS: 0.6%, Conn: 1.2%
T-out: 1.5%, 404s: 5.5%
Robots: 2.1%, Other: 7.4%)

372,030
(11,843)

27,983,205
(843,697)

3,321,681,606
(92,360,658)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU09

16/02/2019 08:44:04

46 mins 1 sec

1,833

17

78.2%
(DNS: 0.4%, Conn: 0.6%
T-out: 0.5%, 404s: 5.8%
Robots: 3.9%, Other: 10.6%)

442,241
(13,145)

35,665,784
(1,076,954)

987,651,625
(29,683,801)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU05

16/02/2019 08:44:54

31 mins 1 sec

9

2

55.7%
(DNS: 0.0%, Conn: 0.3%
T-out: 0.0%, 404s: 38.9%
Robots: 0.0%, Other: 5.1%)

432,788
(13,952)

35,960,215
(1,078,914)

2,491,586,865
(69,581,984)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU07

16/02/2019 08:45:06

31 mins 1 sec

181

13

89.5%
(DNS: 0.1%, Conn: 0.1%
T-out: 6.2%, 404s: 0.5%
Robots: 0.5%, Other: 3.2%)

444,711
(13,613)

36,526,544
(1,090,309)

1,294,794,636
(38,141,508)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU08

16/02/2019 08:45:16

5 hours 1 min 7 secs

1,295

16

81.1%
(DNS: 1.0%, Conn: 0.5%
T-out: 1.5%, 404s: 5.6%
Robots: 2.1%, Other: 8.1%)

377,137
(12,867)

28,470,189
(867,548)

1,920,908,798
(53,002,154)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU02

16/02/2019 08:45:22

31 mins 1 sec

415

1

76.4%
(DNS: 0.4%, Conn: 0.0%
T-out: 0.0%, 404s: 3.6%
Robots: 11.2%, Other: 8.5%)

379,824
(12,056)

35,802,273
(1,074,119)

3,464,029,341
(97,786,361)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU01

16/02/2019 08:45:27

31 mins 1 sec

211

n/a

94.1%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.0%, 404s: 4.7%
Robots: 1.2%, Other: 0.0%)

407,234
(13,492)

35,879,342
(1,077,227)

3,609,582,839
(101,025,875)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU10

16/02/2019 08:46:17

31 mins 1 sec

185

16

73.0%
(DNS: 0.1%, Conn: 0.0%
T-out: 9.2%, 404s: 8.5%
Robots: 0.0%, Other: 9.2%)

468,099
(15,260)

36,074,041
(1,076,160)

1,088,315,725
(32,776,653)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU05

16/02/2019 08:46:25

2 hours 46 mins 8 secs

471

5

71.7%
(DNS: 0.1%, Conn: 0.5%
T-out: 10.5%, 404s: 6.3%
Robots: 5.1%, Other: 5.7%)

337,378
(9,558)

28,352,214
(867,161)

3,332,648,654
(92,693,106)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU06

16/02/2019 08:46:28

31 mins 1 sec

169

8

87.6%
(DNS: 0.0%, Conn: 0.0%
T-out: 2.5%, 404s: 6.3%
Robots: 0.0%, Other: 3.5%)

436,962
(14,237)

35,708,731
(1,062,022)

1,920,722,788
(54,483,271)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU03

16/02/2019 08:48:45

1 hour 31 mins 2 secs

754

8

76.7%
(DNS: 1.0%, Conn: 1.4%
T-out: 0.4%, 404s: 5.0%
Robots: 4.3%, Other: 11.4%)

350,788
(10,857)

28,670,607
(875,125)

3,232,155,182
(90,128,752)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU07

16/02/2019 08:48:47

1 hour 31 mins 2 secs

870

6

76.5%
(DNS: 1.1%, Conn: 0.1%
T-out: 1.7%, 404s: 5.5%
Robots: 5.1%, Other: 9.9%)

370,987
(12,466)

30,591,448
(932,958)

2,194,698,082
(62,634,598)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU12

16/02/2019 08:49:12

2 hours 31 mins 3 secs

334

6

77.9%
(DNS: 1.5%, Conn: 0.1%
T-out: 1.4%, 404s: 8.4%
Robots: 3.8%, Other: 6.9%)

397,039
(12,813)

35,506,711
(1,066,870)

793,287,584
(24,288,410)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU06

16/02/2019 08:49:33

1 hour 31 mins 1 sec

1,021

6

73.9%
(DNS: 1.2%, Conn: 2.0%
T-out: 0.7%, 404s: 11.2%
Robots: 3.8%, Other: 7.2%)

337,073
(10,844)

30,031,676
(910,683)

3,229,923,148
(89,610,099)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU02

16/02/2019 08:49:40

1 hour 31 mins 1 sec

942

6

78.3%
(DNS: 0.6%, Conn: 0.3%
T-out: 1.2%, 404s: 5.1%
Robots: 2.5%, Other: 11.9%)

370,968
(11,071)

25,266,332
(771,067)

3,262,439,333
(90,250,752)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU04

16/02/2019 08:49:56

1 hour 31 mins 2 secs

828

8

81.9%
(DNS: 0.1%, Conn: 0.2%
T-out: 0.6%, 404s: 7.7%
Robots: 3.0%, Other: 6.5%)

374,833
(11,847)

30,196,223
(924,534)

3,433,108,913
(94,895,885)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU11

16/02/2019 08:52:04

1 min 0 sec

17

n/a

85.7%
(DNS: 0.0%, Conn: 0.0%
T-out: 14.3%, 404s: 0.0%
Robots: 0.0%, Other: 0.0%)

449,841
(14,467)

31,806,902
(959,784)

908,462,640
(28,016,309)

Total (29 nodes)

18,262

257

-

11,648,287
(371,632)

931,178,991
(28,212,927)

59,253,812,244
(1,711,720,654)

The following chart shows |MatMan|'s contribution (blue) to overall crawling effort by day.

Last updated: 16 Feb 2019 08:55:02:037 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12