Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

|MatMan|

Country:

Germany Germany

ID:

1251

Team:

Not in a team yet. Join one now!

Joined:

29/08/2006 10:20:00

URLs crawled:

74,332,318,992

Data (MB)*:

2,085,687,750

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

MatServ-XU07

18/06/2018 06:55:22

5 hours 46 mins 12 secs

4,454

51

58.9%
(DNS: 6.7%, Conn: 1.8%
T-out: 2.4%, 404s: 11.6%
Robots: 2.7%, Other: 16.0%)

0
(0)

36,616,487
(1,103,385)

833,061,946
(27,167,884)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU01

24/06/2018 16:45:10

3 hours 16 mins 7 secs

1,990

25

64.5%
(DNS: 3.1%, Conn: 1.9%
T-out: 2.8%, 404s: 13.9%
Robots: 2.9%, Other: 10.9%)

762,184
(21,757)

48,160,743
(1,424,982)

1,006,857,225
(31,739,962)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU03

24/06/2018 16:45:14

3 hours 16 mins 7 secs

2,214

21

70.2%
(DNS: 4.2%, Conn: 1.5%
T-out: 1.2%, 404s: 9.0%
Robots: 1.6%, Other: 12.3%)

1,636,511
(43,989)

49,556,135
(1,463,127)

906,674,560
(29,552,253)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU06

24/06/2018 16:46:05

3 hours 16 mins 8 secs

1,924

18

61.9%
(DNS: 4.1%, Conn: 1.2%
T-out: 1.3%, 404s: 16.5%
Robots: 2.8%, Other: 12.2%)

1,616,723
(43,539)

48,623,384
(1,435,036)

894,078,788
(29,133,444)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU05

24/06/2018 16:46:33

3 hours 16 mins 8 secs

2,222

19

69.6%
(DNS: 2.1%, Conn: 0.5%
T-out: 3.6%, 404s: 11.6%
Robots: 3.0%, Other: 9.6%)

1,543,375
(42,374)

51,351,167
(1,513,316)

864,812,479
(28,172,970)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU10

24/06/2018 16:46:53

3 hours 16 mins 7 secs

2,033

24

65.8%
(DNS: 2.2%, Conn: 1.0%
T-out: 2.3%, 404s: 11.7%
Robots: 1.7%, Other: 15.3%)

1,598,123
(43,833)

50,787,291
(1,493,291)

685,581,041
(22,261,691)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU06

24/06/2018 16:49:00

2 hours 16 mins 3 secs

2,007

23

62.7%
(DNS: 2.7%, Conn: 1.9%
T-out: 2.5%, 404s: 14.7%
Robots: 5.1%, Other: 10.4%)

1,425,961
(39,820)

45,506,585
(1,336,067)

2,987,896,450
(82,368,262)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU05

24/06/2018 16:50:15

4 hours 46 mins 11 secs

1,695

19

66.0%
(DNS: 3.4%, Conn: 1.3%
T-out: 2.1%, 404s: 11.5%
Robots: 2.0%, Other: 13.6%)

1,589,459
(44,753)

43,927,651
(1,285,085)

3,095,717,694
(85,575,561)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU04

24/06/2018 16:51:09

3 hours 16 mins 9 secs

2,017

26

68.5%
(DNS: 2.6%, Conn: 0.5%
T-out: 2.3%, 404s: 10.9%
Robots: 2.5%, Other: 12.8%)

1,699,596
(48,571)

50,755,671
(1,496,573)

891,749,889
(29,062,338)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU07

24/06/2018 16:51:28

4 hours 31 mins 8 secs

1,833

15

67.1%
(DNS: 2.5%, Conn: 1.1%
T-out: 2.3%, 404s: 11.7%
Robots: 2.4%, Other: 13.0%)

943,276
(26,534)

45,113,726
(1,334,724)

1,959,521,843
(55,610,038)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU02

24/06/2018 16:51:45

3 hours 1 min 5 secs

1,721

29

63.4%
(DNS: 5.1%, Conn: 1.3%
T-out: 4.1%, 404s: 11.2%
Robots: 3.7%, Other: 11.1%)

691,654
(20,851)

46,539,272
(1,358,885)

3,051,566,613
(83,878,015)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU03

24/06/2018 16:51:55

2 hours 16 mins 6 secs

1,975

20

61.2%
(DNS: 2.9%, Conn: 0.8%
T-out: 2.4%, 404s: 15.2%
Robots: 3.3%, Other: 14.2%)

1,552,961
(41,205)

47,257,523
(1,386,189)

3,003,708,343
(83,257,825)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU04

24/06/2018 16:52:12

2 hours 16 mins 3 secs

2,691

22

67.0%
(DNS: 5.1%, Conn: 0.8%
T-out: 2.6%, 404s: 10.3%
Robots: 2.2%, Other: 12.0%)

1,462,507
(42,300)

45,731,355
(1,344,088)

3,221,885,520
(88,501,759)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU04

24/06/2018 16:53:30

1 hour 1 min 2 secs

2,047

32

75.0%
(DNS: 5.3%, Conn: 0.8%
T-out: 1.3%, 404s: 10.2%
Robots: 3.8%, Other: 3.6%)

1,627,063
(43,890)

50,579,218
(1,448,669)

3,347,305,995
(92,693,017)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU12

24/06/2018 16:53:32

1 hour 1 min 2 secs

1,773

25

56.2%
(DNS: 2.5%, Conn: 1.1%
T-out: 2.0%, 404s: 12.7%
Robots: 1.5%, Other: 24.1%)

1,620,441
(46,791)

50,542,850
(1,455,942)

535,539,429
(16,661,181)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU11

24/06/2018 16:53:32

1 hour 1 min 2 secs

1,898

26

65.8%
(DNS: 2.0%, Conn: 1.2%
T-out: 2.1%, 404s: 18.6%
Robots: 2.2%, Other: 8.1%)

1,660,838
(43,347)

48,763,029
(1,407,377)

610,341,788
(19,173,823)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU07

24/06/2018 16:53:32

1 hour 1 min 2 secs

2,022

27

52.4%
(DNS: 10.0%, Conn: 0.5%
T-out: 2.7%, 404s: 9.3%
Robots: 2.5%, Other: 22.6%)

1,685,239
(44,728)

50,950,019
(1,458,254)

991,841,174
(29,156,204)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU06

24/06/2018 16:53:33

1 hour 1 min 2 secs

1,651

21

60.7%
(DNS: 0.1%, Conn: 0.8%
T-out: 1.1%, 404s: 17.1%
Robots: 0.7%, Other: 19.6%)

1,916,452
(45,333)

47,459,256
(1,344,805)

1,627,908,320
(45,783,916)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU09

24/06/2018 16:53:33

1 hour 1 min 2 secs

1,577

29

61.0%
(DNS: 5.9%, Conn: 0.8%
T-out: 0.9%, 404s: 15.5%
Robots: 1.0%, Other: 14.9%)

1,706,252
(46,428)

50,592,028
(1,458,521)

688,539,739
(20,780,179)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU05

24/06/2018 16:53:33

1 hour 1 min 2 secs

2,024

28

65.8%
(DNS: 5.8%, Conn: 0.7%
T-out: 0.5%, 404s: 12.4%
Robots: 1.1%, Other: 13.8%)

1,749,912
(45,103)

37,984,969
(1,079,350)

2,201,199,189
(60,941,574)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU03

24/06/2018 16:53:33

1 hour 1 min 2 secs

1,664

21

64.9%
(DNS: 2.7%, Conn: 0.4%
T-out: 3.8%, 404s: 13.1%
Robots: 1.9%, Other: 13.1%)

1,731,051
(45,922)

46,698,960
(1,338,258)

3,391,326,377
(94,498,378)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU08

24/06/2018 16:53:33

1 hour 1 min 2 secs

2,038

29

57.9%
(DNS: 1.1%, Conn: 5.8%
T-out: 8.7%, 404s: 14.0%
Robots: 0.8%, Other: 11.6%)

1,662,371
(45,474)

51,219,980
(1,480,102)

939,568,799
(27,793,999)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU01

24/06/2018 16:53:33

1 hour 1 min 2 secs

2,124

32

64.3%
(DNS: 4.6%, Conn: 1.1%
T-out: 1.7%, 404s: 9.5%
Robots: 4.8%, Other: 13.9%)

1,767,144
(45,757)

51,773,004
(1,480,976)

3,308,300,577
(92,083,467)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU02

24/06/2018 16:53:33

1 hour 1 min 2 secs

1,634

25

59.2%
(DNS: 5.3%, Conn: 1.4%
T-out: 5.1%, 404s: 12.0%
Robots: 5.3%, Other: 11.7%)

1,638,519
(45,389)

50,917,585
(1,455,556)

3,185,414,214
(89,482,212)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU10

24/06/2018 16:53:33

1 hour 1 min 3 secs

2,756

28

69.6%
(DNS: 1.9%, Conn: 0.9%
T-out: 2.8%, 404s: 12.0%
Robots: 5.8%, Other: 7.1%)

1,753,249
(44,043)

51,620,901
(1,474,453)

794,711,149
(24,064,030)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU08

24/06/2018 16:54:14

3 hours 1 min 6 secs

1,548

22

62.9%
(DNS: 5.3%, Conn: 0.9%
T-out: 2.3%, 404s: 14.1%
Robots: 4.5%, Other: 9.9%)

1,570,035
(43,201)

45,485,604
(1,335,139)

1,687,465,634
(45,975,975)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU01

24/06/2018 16:57:15

31 mins 0 sec

809

20

71.9%
(DNS: 2.3%, Conn: 0.6%
T-out: 1.6%, 404s: 19.2%
Robots: 3.2%, Other: 1.2%)

1,568,275
(41,479)

44,989,722
(1,308,791)

3,085,560,079
(85,311,005)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU08

24/06/2018 16:58:56

46 mins 2 secs

820

25

68.3%
(DNS: 0.4%, Conn: 1.7%
T-out: 0.7%, 404s: 15.3%
Robots: 1.8%, Other: 11.9%)

1,746,212
(48,167)

49,710,501
(1,451,977)

863,701,770
(28,124,240)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU02

24/06/2018 16:59:23

3 hours 31 mins 7 secs

1,920

22

70.9%
(DNS: 1.8%, Conn: 1.9%
T-out: 1.4%, 404s: 10.7%
Robots: 3.6%, Other: 9.8%)

1,726,021
(49,698)

49,068,106
(1,461,201)

905,218,374
(29,507,428)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU09

24/06/2018 16:59:39

3 hours 31 mins 8 secs

1,968

21

66.3%
(DNS: 3.6%, Conn: 1.2%
T-out: 1.0%, 404s: 12.5%
Robots: 3.4%, Other: 12.0%)

1,660,655
(48,708)

49,799,974
(1,457,976)

806,270,066
(26,251,964)

Total (30 nodes)

59,049

745

-

45,312,059
(1,232,984)

1,438,082,696
(41,872,095)

52,373,325,064
(1,504,564,594)

The following chart shows |MatMan|'s contribution (blue) to overall crawling effort by day.

Last updated: 24 Jun 2018 17:00:00:513 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12