Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

|MatMan|

Country:

Germany Germany

ID:

1251

Team:

Not in a team yet. Join one now!

Joined:

29/08/2006 10:20:00

URLs crawled:

78,244,083,193

Data (MB)*:

2,203,257,061

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU05

16/10/2018 14:49:01

5 hours 1 min 6 secs

1,178

13

70.6%
(DNS: 1.5%, Conn: 1.1%
T-out: 1.7%, 404s: 12.2%
Robots: 4.1%, Other: 8.8%)

829,592
(24,077)

34,011,982
(1,030,696)

3,201,091,847
(88,746,621)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU08

16/10/2018 14:49:15

5 hours 1 min 8 secs

1,238

12

75.6%
(DNS: 1.4%, Conn: 1.0%
T-out: 2.4%, 404s: 9.4%
Robots: 2.4%, Other: 7.8%)

785,250
(22,989)

33,984,642
(1,029,184)

1,795,077,459
(49,206,430)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU08

16/10/2018 14:50:27

5 hours 16 mins 7 secs

1,214

13

71.5%
(DNS: 2.2%, Conn: 2.0%
T-out: 1.2%, 404s: 10.4%
Robots: 3.1%, Other: 9.7%)

910,128
(27,349)

36,871,350
(1,132,788)

1,003,198,129
(32,385,328)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU01

16/10/2018 14:50:41

5 hours 16 mins 6 secs

1,453

13

71.0%
(DNS: 3.1%, Conn: 1.0%
T-out: 1.6%, 404s: 11.4%
Robots: 2.9%, Other: 9.0%)

977,453
(28,899)

37,261,155
(1,139,549)

1,143,450,742
(35,921,338)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU09

16/10/2018 14:50:45

2 hours 31 mins 3 secs

758

10

72.6%
(DNS: 3.9%, Conn: 3.3%
T-out: 1.1%, 404s: 7.2%
Robots: 2.9%, Other: 9.0%)

1,045,039
(29,426)

35,952,031
(1,079,377)

834,995,835
(25,139,368)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU05

16/10/2018 14:50:48

2 hours 31 mins 3 secs

473

7

74.3%
(DNS: 0.7%, Conn: 1.2%
T-out: 8.1%, 404s: 8.1%
Robots: 2.0%, Other: 5.6%)

1,073,157
(31,165)

36,247,464
(1,088,855)

2,337,874,766
(65,004,831)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU11

16/10/2018 14:50:50

2 hours 31 mins 3 secs

885

9

74.7%
(DNS: 3.4%, Conn: 0.9%
T-out: 2.1%, 404s: 8.8%
Robots: 2.9%, Other: 7.3%)

996,993
(29,727)

36,100,154
(1,092,522)

756,566,943
(23,504,728)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU04

16/10/2018 14:50:52

2 hours 31 mins 3 secs

615

13

75.2%
(DNS: 3.5%, Conn: 0.3%
T-out: 2.8%, 404s: 10.8%
Robots: 3.5%, Other: 3.9%)

1,073,700
(31,802)

36,229,042
(1,101,810)

3,494,162,630
(97,054,397)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU03

16/10/2018 14:51:04

2 hours 31 mins 3 secs

439

9

64.8%
(DNS: 1.0%, Conn: 3.3%
T-out: 2.6%, 404s: 16.1%
Robots: 5.5%, Other: 6.8%)

876,961
(25,523)

35,513,056
(1,070,091)

3,515,058,086
(98,173,764)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU08

16/10/2018 14:51:11

2 hours 31 mins 3 secs

781

10

69.5%
(DNS: 1.9%, Conn: 2.4%
T-out: 1.1%, 404s: 11.5%
Robots: 4.5%, Other: 9.1%)

1,066,585
(31,863)

36,145,664
(1,092,095)

1,087,420,265
(32,170,877)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU10

16/10/2018 14:58:30

2 hours 31 mins 3 secs

554

8

81.8%
(DNS: 0.4%, Conn: 0.6%
T-out: 0.9%, 404s: 7.2%
Robots: 3.8%, Other: 5.2%)

1,078,973
(32,199)

36,518,319
(1,095,111)

941,153,262
(28,394,327)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU07

16/10/2018 14:58:31

2 hours 31 mins 3 secs

547

10

75.5%
(DNS: 1.7%, Conn: 0.6%
T-out: 2.3%, 404s: 6.3%
Robots: 4.2%, Other: 9.4%)

1,046,595
(31,135)

35,905,614
(1,090,532)

1,137,630,056
(33,490,259)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU01

16/10/2018 14:58:31

5 hours 1 min 6 secs

1,115

11

70.1%
(DNS: 2.1%, Conn: 1.3%
T-out: 1.7%, 404s: 10.4%
Robots: 5.1%, Other: 9.4%)

833,039
(24,325)

34,388,021
(1,036,605)

3,191,606,201
(88,480,502)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU06

16/10/2018 14:58:34

2 hours 31 mins 3 secs

578

8

75.3%
(DNS: 0.5%, Conn: 0.9%
T-out: 2.6%, 404s: 7.6%
Robots: 2.5%, Other: 10.6%)

1,026,895
(29,961)

36,067,714
(1,091,753)

1,772,741,099
(50,099,212)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU07

16/10/2018 14:58:35

5 hours 1 min 6 secs

933

10

72.8%
(DNS: 2.6%, Conn: 0.7%
T-out: 1.8%, 404s: 11.9%
Robots: 2.7%, Other: 7.6%)

823,952
(23,120)

30,921,524
(938,711)

2,062,409,956
(58,680,477)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU04

16/10/2018 14:58:45

5 hours 1 min 6 secs

1,052

12

72.3%
(DNS: 2.1%, Conn: 0.8%
T-out: 1.6%, 404s: 10.3%
Robots: 2.4%, Other: 10.4%)

822,198
(24,554)

33,769,252
(1,020,611)

3,328,738,772
(91,705,575)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU06

16/10/2018 14:58:51

5 hours 1 min 6 secs

1,174

13

73.9%
(DNS: 1.3%, Conn: 0.8%
T-out: 2.8%, 404s: 9.4%
Robots: 2.4%, Other: 9.4%)

813,252
(24,704)

34,149,442
(1,024,569)

3,094,654,538
(85,567,154)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU02

16/10/2018 14:58:55

5 hours 1 min 6 secs

1,142

13

71.4%
(DNS: 1.6%, Conn: 1.4%
T-out: 2.7%, 404s: 9.8%
Robots: 4.5%, Other: 8.5%)

786,800
(22,941)

29,985,030
(904,675)

3,153,976,548
(86,954,428)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU06

16/10/2018 14:58:55

5 hours 16 mins 7 secs

1,469

13

75.9%
(DNS: 1.6%, Conn: 0.6%
T-out: 1.4%, 404s: 8.2%
Robots: 3.2%, Other: 9.0%)

937,269
(29,284)

36,793,817
(1,133,143)

1,032,120,750
(33,359,992)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU02

16/10/2018 14:59:03

2 hours 31 mins 3 secs

600

9

76.5%
(DNS: 2.3%, Conn: 0.2%
T-out: 1.5%, 404s: 6.7%
Robots: 2.9%, Other: 9.9%)

1,046,654
(31,454)

32,553,298
(978,576)

3,324,746,034
(93,607,594)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU10

16/10/2018 14:59:10

5 hours 16 mins 6 secs

1,454

15

73.3%
(DNS: 1.8%, Conn: 1.2%
T-out: 1.5%, 404s: 9.8%
Robots: 2.4%, Other: 10.0%)

965,073
(28,964)

36,933,379
(1,139,109)

821,988,899
(26,424,018)

v1.7.16 (.NET 4.5)   Linux

MatSAN-XU03

16/10/2018 14:59:34

5 hours 1 min 6 secs

1,313

13

71.6%
(DNS: 1.7%, Conn: 0.6%
T-out: 2.2%, 404s: 11.0%
Robots: 2.8%, Other: 10.1%)

811,521
(24,385)

34,043,412
(1,037,684)

3,106,588,273
(86,354,159)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU02

16/10/2018 14:59:36

5 hours 16 mins 6 secs

1,385

13

73.0%
(DNS: 2.0%, Conn: 0.9%
T-out: 1.8%, 404s: 8.9%
Robots: 3.6%, Other: 9.9%)

932,873
(27,870)

37,010,838
(1,136,045)

1,044,962,474
(33,769,391)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU05

16/10/2018 14:59:36

5 hours 16 mins 7 secs

1,358

13

71.3%
(DNS: 2.7%, Conn: 0.4%
T-out: 1.5%, 404s: 11.3%
Robots: 3.5%, Other: 9.2%)

941,283
(29,121)

36,838,147
(1,127,098)

1,005,407,853
(32,461,460)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU01

16/10/2018 14:59:36

2 hours 31 mins 3 secs

707

30

77.1%
(DNS: 1.8%, Conn: 0.5%
T-out: 2.0%, 404s: 6.5%
Robots: 6.5%, Other: 5.6%)

1,050,719
(31,468)

36,222,261
(1,090,386)

3,455,560,709
(96,450,101)

v1.7.16 (.NET 4.5)   Linux

MatVM-XU12

16/10/2018 14:59:37

5 hours 31 mins 11 secs

1,416

14

71.6%
(DNS: 2.8%, Conn: 1.0%
T-out: 2.2%, 404s: 11.2%
Robots: 2.9%, Other: 8.3%)

1,038,429
(30,364)

26,673,394
(800,815)

672,831,265
(20,725,025)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU09

16/10/2018 14:59:38

5 hours 16 mins 7 secs

1,534

12

71.9%
(DNS: 1.4%, Conn: 0.7%
T-out: 1.3%, 404s: 9.8%
Robots: 3.3%, Other: 11.5%)

940,653
(28,944)

36,892,009
(1,131,693)

943,064,395
(30,434,038)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU07

16/10/2018 14:59:38

5 hours 16 mins 7 secs

1,356

12

72.2%
(DNS: 0.8%, Conn: 1.2%
T-out: 1.8%, 404s: 12.0%
Robots: 3.7%, Other: 8.3%)

933,641
(28,998)

36,212,803
(1,105,003)

946,591,900
(30,681,732)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU03

16/10/2018 14:59:38

5 hours 16 mins 6 secs

1,299

13

72.9%
(DNS: 2.0%, Conn: 0.9%
T-out: 2.6%, 404s: 9.3%
Robots: 3.6%, Other: 8.7%)

967,189
(28,959)

36,944,673
(1,135,928)

1,046,873,331
(33,832,021)

v1.7.16 (.NET 4.5)   Linux

MatServ-XU04

16/10/2018 14:59:38

5 hours 16 mins 7 secs

1,303

15

71.0%
(DNS: 2.5%, Conn: 1.1%
T-out: 1.5%, 404s: 10.7%
Robots: 4.5%, Other: 8.8%)

977,102
(29,690)

36,852,082
(1,132,124)

1,032,546,248
(33,354,758)

Total (30 nodes)

31,323

366

-

28,408,968
(845,260)

1,053,991,569
(32,007,138)

56,285,089,265
(1,622,133,905)

The following chart shows |MatMan|'s contribution (blue) to overall crawling effort by day.

Last updated: 16 Oct 2018 15:00:02:027 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12