Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

|MatMan|

Country:

Germany Germany

ID:

1251

Team:

Not in a team yet. Join one now!

Joined:

29/08/2006 10:20:00

URLs crawled:

54,801,376,693

Data (MB)*:

1,457,230,758

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatSAN-XU09

26/06/2017 10:36:06

2 days 10 hours 17 mins 50 secs

2,552

27

79.5%
(DNS: 2.3%, Conn: 1.3%
T-out: 2.0%, 404s: 6.6%
Robots: 3.1%, Other: 5.2%)

0
(0)

28,740,975
(929,538)

237,885,810
(5,780,683)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatVM-XU06

27/06/2017 09:47:33

4 hours 46 mins 9 secs

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

405,257
(13,526)

970,962,918
(24,865,754)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatVM-XU05

27/06/2017 09:47:39

4 hours 46 mins 8 secs

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

449,595
(14,466)

1,566,078,645
(40,736,164)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatServ-XU09

28/06/2017 10:45:06

5 hours 1 min 12 secs

3,252

22

80.1%
(DNS: 1.2%, Conn: 1.8%
T-out: 1.5%, 404s: 8.2%
Robots: 2.2%, Other: 5.0%)

741,041
(24,973)

67,593,639
(2,224,479)

174,420,737
(5,764,787)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatSAN-XU04

28/06/2017 10:45:22

3 hours 46 mins 8 secs

4,186

28

76.6%
(DNS: 3.0%, Conn: 1.2%
T-out: 1.6%, 404s: 8.2%
Robots: 2.2%, Other: 7.2%)

701,133
(21,977)

57,883,984
(1,869,305)

2,678,957,833
(71,006,082)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatSAN-XU05

28/06/2017 10:46:21

16 mins 0 sec

4,861

79

75.7%
(DNS: 2.2%, Conn: 1.9%
T-out: 0.6%, 404s: 9.8%
Robots: 4.3%, Other: 5.4%)

755,028
(25,210)

58,937,373
(1,893,914)

2,561,057,276
(68,321,396)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatVM-XU04

28/06/2017 10:46:30

46 mins 1 sec

3,538

38

73.9%
(DNS: 3.9%, Conn: 2.5%
T-out: 1.1%, 404s: 9.4%
Robots: 3.1%, Other: 6.1%)

513,926
(17,086)

1,921,619
(62,146)

2,689,672,296
(71,834,371)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatSAN-XU02

28/06/2017 10:48:07

2 hours 46 mins 8 secs

4,929

40

79.4%
(DNS: 1.3%, Conn: 1.2%
T-out: 1.6%, 404s: 8.9%
Robots: 2.4%, Other: 5.2%)

650,899
(21,101)

58,708,359
(1,895,016)

2,603,287,657
(69,346,852)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatServ-XU03

28/06/2017 10:51:43

4 hours 46 mins 11 secs

3,651

26

78.8%
(DNS: 1.5%, Conn: 3.0%
T-out: 1.5%, 404s: 7.8%
Robots: 2.1%, Other: 5.4%)

751,436
(25,376)

67,791,607
(2,234,632)

282,199,708
(9,370,775)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatSAN-XU07

28/06/2017 10:52:26

4 hours 16 mins 6 secs

2,449

17

77.3%
(DNS: 2.8%, Conn: 1.8%
T-out: 3.4%, 404s: 7.9%
Robots: 1.8%, Other: 4.9%)

493,474
(16,495)

58,418,830
(1,888,565)

1,428,217,699
(38,456,226)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatSAN-XU01

28/06/2017 10:52:43

4 hours 16 mins 7 secs

3,771

28

77.1%
(DNS: 2.8%, Conn: 1.7%
T-out: 1.5%, 404s: 10.1%
Robots: 2.1%, Other: 4.7%)

700,939
(23,103)

58,735,025
(1,893,164)

2,549,014,274
(67,954,474)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatSAN-XU03

28/06/2017 10:52:49

4 hours 16 mins 9 secs

3,808

25

78.5%
(DNS: 2.9%, Conn: 2.0%
T-out: 1.8%, 404s: 7.5%
Robots: 2.7%, Other: 4.6%)

656,516
(21,371)

57,230,295
(1,851,698)

2,468,935,483
(66,020,811)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatVM-XU01

28/06/2017 10:56:17

3 hours 46 mins 6 secs

3,269

18

74.6%
(DNS: 2.5%, Conn: 1.8%
T-out: 2.5%, 404s: 8.4%
Robots: 5.0%, Other: 5.1%)

562,357
(17,510)

39,247,802
(1,246,803)

2,646,834,221
(71,020,890)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatSAN-XU06

28/06/2017 10:57:02

4 hours 1 min 9 secs

4,156

27

78.0%
(DNS: 2.0%, Conn: 1.4%
T-out: 3.0%, 404s: 8.6%
Robots: 2.7%, Other: 4.4%)

665,121
(20,831)

58,968,296
(1,906,992)

2,462,285,877
(65,452,038)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatServ-XU10

28/06/2017 10:57:30

1 min 0 sec

366

185

82.6%
(DNS: 0.0%, Conn: 0.9%
T-out: 8.3%, 404s: 6.4%
Robots: 0.9%, Other: 0.9%)

740,847
(23,329)

44,745,033
(1,495,253)

61,590,424
(2,050,253)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatServ-XU07

28/06/2017 10:57:42

1 min 0 sec

350

n/a

77.3%
(DNS: 0.0%, Conn: 0.0%
T-out: 2.7%, 404s: 13.6%
Robots: 0.0%, Other: 6.4%)

681,833
(22,122)

67,036,327
(2,213,787)

243,383,708
(8,104,630)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatServ-XU04

28/06/2017 10:58:05

2 hours 1 min 5 secs

5,872

57

79.9%
(DNS: 1.4%, Conn: 1.2%
T-out: 1.3%, 404s: 9.8%
Robots: 2.1%, Other: 4.4%)

741,156
(24,201)

67,493,857
(2,229,033)

279,676,921
(9,294,659)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatVM-XU02

28/06/2017 10:58:29

4 hours 31 mins 8 secs

2,351

14

77.7%
(DNS: 2.7%, Conn: 2.8%
T-out: 1.2%, 404s: 7.4%
Robots: 2.1%, Other: 6.1%)

482,211
(16,717)

38,782,315
(1,239,586)

2,507,925,475
(67,959,829)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatServ-XU02

28/06/2017 10:58:44

4 hours 1 min 10 secs

4,614

27

79.5%
(DNS: 1.1%, Conn: 1.9%
T-out: 2.2%, 404s: 8.9%
Robots: 2.0%, Other: 4.4%)

707,000
(23,389)

66,998,247
(2,208,396)

282,273,140
(9,364,896)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatServ-XU05

28/06/2017 10:59:21

4 hours 46 mins 10 secs

3,638

29

76.9%
(DNS: 1.8%, Conn: 1.8%
T-out: 1.4%, 404s: 9.4%
Robots: 3.4%, Other: 5.3%)

750,281
(23,609)

66,330,076
(2,197,312)

241,663,246
(8,050,100)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatServ-XU01

28/06/2017 10:59:27

5 hours 1 min 13 secs

3,217

19

75.8%
(DNS: 2.9%, Conn: 2.3%
T-out: 1.9%, 404s: 9.1%
Robots: 3.1%, Other: 4.8%)

625,802
(19,951)

58,907,007
(1,949,070)

395,638,322
(12,005,286)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatServ-XU12

28/06/2017 10:59:32

3 hours 31 mins 8 secs

4,496

34

76.9%
(DNS: 3.1%, Conn: 2.2%
T-out: 1.4%, 404s: 9.3%
Robots: 2.2%, Other: 4.8%)

760,346
(25,499)

33,941,820
(1,122,299)

36,255,438
(1,198,534)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatVM-XU03

28/06/2017 10:59:36

3 hours 46 mins 9 secs

3,402

17

76.5%
(DNS: 1.6%, Conn: 2.1%
T-out: 1.7%, 404s: 9.1%
Robots: 3.7%, Other: 5.3%)

533,315
(16,138)

3,005,707
(95,073)

2,720,430,530
(73,111,204)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatSAN-XU08

28/06/2017 10:59:45

4 hours 31 mins 11 secs

5,472

36

75.4%
(DNS: 2.2%, Conn: 1.9%
T-out: 2.5%, 404s: 9.3%
Robots: 2.7%, Other: 6.1%)

909,181
(30,682)

55,795,928
(1,816,500)

1,137,055,628
(28,251,046)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatServ-XU11

28/06/2017 10:59:46

1 min 0 sec

262

n/a

72.1%
(DNS: 1.5%, Conn: 0.0%
T-out: 8.8%, 404s: 1.5%
Robots: 1.5%, Other: 14.7%)

685,324
(23,290)

33,329,750
(1,108,482)

35,844,081
(1,189,995)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatServ-XU08

28/06/2017 10:59:50

4 hours 46 mins 10 secs

4,038

25

77.6%
(DNS: 2.0%, Conn: 1.5%
T-out: 1.7%, 404s: 8.5%
Robots: 3.1%, Other: 5.5%)

660,032
(21,598)

66,606,198
(2,202,707)

244,389,425
(8,145,594)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MatServ-XU06

28/06/2017 11:00:01

5 hours 46 mins 10 secs

3,150

21

77.1%
(DNS: 3.1%, Conn: 2.1%
T-out: 1.3%, 404s: 9.0%
Robots: 2.4%, Other: 5.1%)

676,934
(22,581)

67,068,413
(2,208,938)

269,976,075
(8,988,274)

Total (27 nodes)

85,650

839

-

16,146,132
(528,139)

1,285,073,334
(42,010,680)

33,775,912,847
(913,645,603)

The following chart shows |MatMan|'s contribution (blue) to overall crawling effort by day.

Last updated: 28 Jun 2017 11:00:23:050 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12