Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

|MatMan|

Country:

Germany Germany

ID:

1251

Team:

Not in a team yet. Join one now!

Joined:

29/08/2006 10:20:00

URLs crawled:

80,307,885,517

Data (MB)*:

2,264,257,351

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU05

14/12/2018 02:15:58

3 hours 46 mins 5 secs

928

7

73.3%
(DNS: 1.1%, Conn: 0.7%
T-out: 2.1%, 404s: 11.3%
Robots: 2.8%, Other: 8.6%)

69,253
(2,285)

33,628,937
(995,657)

3,266,739,136
(90,676,407)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU02

14/12/2018 02:34:41

2 hours 31 mins 3 secs

863

7

68.5%
(DNS: 3.5%, Conn: 1.7%
T-out: 5.6%, 404s: 9.1%
Robots: 4.3%, Other: 7.4%)

66,611
(2,172)

40,077,337
(1,178,851)

3,384,240,002
(95,375,611)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU05

14/12/2018 02:34:52

2 hours 31 mins 3 secs

934

9

72.7%
(DNS: 3.8%, Conn: 2.8%
T-out: 1.0%, 404s: 8.7%
Robots: 4.7%, Other: 6.3%)

83,366
(2,692)

40,140,035
(1,174,335)

2,411,656,397
(67,180,231)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU08

14/12/2018 02:35:29

2 hours 31 mins 3 secs

1,011

6

74.2%
(DNS: 3.1%, Conn: 1.0%
T-out: 2.3%, 404s: 8.2%
Robots: 2.7%, Other: 8.6%)

78,678
(2,656)

40,035,139
(1,167,091)

1,162,361,007
(34,362,257)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU12

14/12/2018 02:44:05

5 hours 46 mins 7 secs

793

7

75.7%
(DNS: 1.8%, Conn: 1.5%
T-out: 1.6%, 404s: 8.5%
Robots: 2.6%, Other: 8.3%)

67,080
(2,141)

29,739,299
(854,997)

739,155,254
(22,654,606)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU07

14/12/2018 02:45:18

4 hours 16 mins 5 secs

960

10

71.0%
(DNS: 5.1%, Conn: 1.5%
T-out: 2.4%, 404s: 9.5%
Robots: 2.2%, Other: 8.4%)

79,140
(2,530)

36,460,329
(1,071,880)

2,132,012,720
(60,716,509)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU08

14/12/2018 02:45:26

4 hours 16 mins 5 secs

894

7

73.8%
(DNS: 2.6%, Conn: 1.4%
T-out: 2.0%, 404s: 9.9%
Robots: 3.4%, Other: 6.8%)

76,708
(2,485)

36,447,127
(1,071,547)

1,859,409,251
(51,120,095)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU06

14/12/2018 02:45:28

4 hours 1 min 5 secs

679

5

71.9%
(DNS: 3.0%, Conn: 1.8%
T-out: 3.1%, 404s: 11.4%
Robots: 1.9%, Other: 6.8%)

46,707
(1,450)

36,295,322
(1,059,028)

3,162,351,382
(87,547,117)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU02

14/12/2018 02:46:36

1 hour 46 mins 3 secs

1,218

8

76.1%
(DNS: 4.3%, Conn: 0.4%
T-out: 0.2%, 404s: 7.7%
Robots: 0.9%, Other: 10.4%)

93,740
(2,661)

39,269,117
(1,173,844)

1,120,252,024
(36,011,487)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU04

14/12/2018 02:46:38

4 hours 16 mins 5 secs

953

7

74.0%
(DNS: 1.9%, Conn: 0.9%
T-out: 2.7%, 404s: 9.3%
Robots: 2.4%, Other: 8.8%)

67,055
(2,209)

20,425,632
(620,570)

3,373,839,426
(93,087,223)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU07

14/12/2018 02:46:42

16 mins 1 sec

6,890

2

80.9%
(DNS: 1.5%, Conn: 0.8%
T-out: 1.8%, 404s: 6.9%
Robots: 1.1%, Other: 7.0%)

96,617
(3,065)

39,339,265
(1,174,721)

1,021,259,134
(32,903,756)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU06

14/12/2018 02:49:23

2 hours 46 mins 4 secs

1,286

6

74.7%
(DNS: 2.9%, Conn: 1.1%
T-out: 1.1%, 404s: 10.5%
Robots: 1.7%, Other: 7.9%)

61,847
(2,151)

39,932,886
(1,168,737)

1,847,575,803
(52,293,806)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU04

14/12/2018 02:49:30

2 hours 46 mins 4 secs

1,676

9

77.1%
(DNS: 1.8%, Conn: 1.1%
T-out: 1.6%, 404s: 7.8%
Robots: 3.0%, Other: 7.6%)

89,134
(3,330)

39,945,455
(1,172,812)

3,570,869,908
(99,294,362)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU09

14/12/2018 02:50:03

2 hours 46 mins 3 secs

1,302

7

73.2%
(DNS: 4.6%, Conn: 2.5%
T-out: 1.9%, 404s: 6.7%
Robots: 3.3%, Other: 7.8%)

73,912
(2,308)

39,975,272
(1,169,412)

907,821,985
(27,278,419)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU03

14/12/2018 02:50:26

2 hours 46 mins 4 secs

1,526

8

75.8%
(DNS: 2.9%, Conn: 0.7%
T-out: 1.7%, 404s: 8.1%
Robots: 3.2%, Other: 7.6%)

84,147
(2,573)

40,077,438
(1,165,968)

3,592,105,011
(100,408,350)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU07

14/12/2018 02:50:27

2 hours 46 mins 3 secs

1,372

8

72.4%
(DNS: 3.8%, Conn: 2.3%
T-out: 2.9%, 404s: 7.7%
Robots: 2.8%, Other: 8.1%)

81,757
(2,585)

39,712,377
(1,162,271)

1,214,458,843
(35,727,921)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU01

14/12/2018 02:50:33

2 hours 46 mins 4 secs

1,504

6

75.6%
(DNS: 2.0%, Conn: 0.9%
T-out: 2.2%, 404s: 8.8%
Robots: 1.7%, Other: 8.7%)

78,871
(2,683)

39,538,055
(1,159,880)

3,530,499,682
(98,647,693)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU11

14/12/2018 02:51:01

2 hours 46 mins 4 secs

1,390

6

75.9%
(DNS: 1.1%, Conn: 1.0%
T-out: 1.5%, 404s: 9.9%
Robots: 2.6%, Other: 8.0%)

60,867
(1,885)

39,727,026
(1,158,139)

833,332,415
(25,741,930)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU10

14/12/2018 02:51:02

2 hours 46 mins 4 secs

1,545

8

75.3%
(DNS: 2.6%, Conn: 2.3%
T-out: 1.8%, 404s: 8.7%
Robots: 1.4%, Other: 7.9%)

73,779
(2,777)

33,011,238
(969,500)

1,009,220,459
(30,393,047)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU02

14/12/2018 02:54:32

3 hours 1 min 3 secs

1,142

7

76.6%
(DNS: 1.8%, Conn: 1.9%
T-out: 1.4%, 404s: 9.7%
Robots: 1.7%, Other: 6.9%)

71,485
(2,079)

18,214,440
(538,196)

3,199,754,265
(88,326,417)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU03

14/12/2018 02:54:44

3 hours 1 min 4 secs

1,001

5

74.9%
(DNS: 1.6%, Conn: 0.7%
T-out: 3.3%, 404s: 9.8%
Robots: 2.1%, Other: 7.6%)

54,434
(1,605)

29,641,028
(876,117)

3,165,902,948
(88,104,491)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU01

14/12/2018 02:54:54

3 hours 1 min 4 secs

975

6

69.8%
(DNS: 9.7%, Conn: 3.5%
T-out: 1.2%, 404s: 6.8%
Robots: 2.9%, Other: 6.1%)

62,127
(1,598)

31,542,287
(923,174)

3,256,337,690
(90,373,688)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU10

14/12/2018 02:57:53

2 hours 1 min 2 secs

1,213

9

76.1%
(DNS: 1.4%, Conn: 0.8%
T-out: 0.9%, 404s: 12.3%
Robots: 2.3%, Other: 6.1%)

71,653
(2,203)

39,491,935
(1,187,025)

891,863,573
(28,542,890)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU09

14/12/2018 02:58:30

2 hours 1 min 3 secs

1,631

7

81.4%
(DNS: 1.9%, Conn: 1.0%
T-out: 1.6%, 404s: 6.2%
Robots: 2.3%, Other: 5.6%)

86,296
(2,855)

39,172,939
(1,170,722)

1,017,811,915
(32,651,777)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU06

14/12/2018 02:58:39

3 hours 46 mins 5 secs

1,180

8

78.5%
(DNS: 2.9%, Conn: 0.8%
T-out: 2.3%, 404s: 7.2%
Robots: 1.8%, Other: 6.5%)

73,794
(2,304)

29,431,145
(885,514)

1,094,212,558
(35,219,165)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU05

14/12/2018 02:58:42

3 hours 46 mins 5 secs

1,321

9

76.2%
(DNS: 3.2%, Conn: 0.9%
T-out: 2.1%, 404s: 8.7%
Robots: 2.0%, Other: 6.9%)

106,207
(3,272)

39,637,062
(1,177,493)

1,075,241,950
(34,554,429)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU08

14/12/2018 02:58:51

3 hours 46 mins 5 secs

891

5

76.5%
(DNS: 1.9%, Conn: 1.4%
T-out: 2.4%, 404s: 9.4%
Robots: 2.6%, Other: 5.8%)

59,013
(1,907)

29,212,578
(881,640)

1,065,707,558
(34,256,954)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU04

14/12/2018 02:58:55

16 mins 0 sec

5,623

31

74.3%
(DNS: 4.7%, Conn: 0.8%
T-out: 1.1%, 404s: 11.0%
Robots: 1.1%, Other: 7.0%)

64,073
(2,470)

39,555,888
(1,173,191)

1,107,248,229
(35,570,975)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU03

14/12/2018 02:58:56

2 hours 1 min 3 secs

1,369

9

73.8%
(DNS: 7.1%, Conn: 3.7%
T-out: 1.2%, 404s: 7.5%
Robots: 1.6%, Other: 5.1%)

74,504
(2,441)

39,667,493
(1,179,945)

1,122,084,521
(36,068,498)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU01

14/12/2018 02:59:03

2 hours 1 min 3 secs

1,288

7

75.8%
(DNS: 3.3%, Conn: 1.1%
T-out: 2.5%, 404s: 9.8%
Robots: 0.9%, Other: 6.7%)

59,663
(1,700)

39,553,931
(1,180,274)

1,213,566,543
(38,044,084)

Total (30 nodes)

45,358

236

-

2,212,518
(71,072)

1,078,898,012
(31,842,531)

58,348,891,589
(1,683,134,195)

The following chart shows |MatMan|'s contribution (blue) to overall crawling effort by day.

Last updated: 14 Dec 2018 02:59:30:700 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12