Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

dog02

Country:

United States United States

ID:

4173

Team:

XtremeSystems (Join this team)

Web site:

http://www.finezt.com

Joined:

28/10/2011 17:09:00

URLs crawled:

20,264,378,226

Data (MB)*:

572,726,434

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

Crawling Cluster 2

12/12/2017 02:19:20

12 hours 16 mins 22 secs

3,142

29

77.7%
(DNS: 2.3%, Conn: 3.2%
T-out: 0.8%, 404s: 8.6%
Robots: 3.3%, Other: 4.1%)

0
(0)

8,372,563
(274,993)

8,372,563
(274,993)

v1.7.16 (.NET 4.5)   Linux

Crawling Cluster 2

12/12/2017 02:19:21

12 hours 16 mins 23 secs

2,720

27

77.1%
(DNS: 1.6%, Conn: 3.7%
T-out: 0.5%, 404s: 8.8%
Robots: 3.6%, Other: 4.7%)

0
(0)

8,452,182
(284,968)

8,452,182
(284,968)

v1.7.16 (.NET 4.5)   Linux

Crawling Cluster 2

12/12/2017 02:19:22

12 hours 16 mins 24 secs

3,148

28

74.9%
(DNS: 1.8%, Conn: 4.6%
T-out: 0.8%, 404s: 9.7%
Robots: 3.3%, Other: 4.9%)

0
(0)

8,837,540
(289,901)

8,837,540
(289,901)

v1.7.16 (.NET 4.5)   Linux

Crawling Cluster 2

12/12/2017 02:19:23

12 hours 16 mins 25 secs

2,991

27

76.9%
(DNS: 1.9%, Conn: 3.3%
T-out: 0.5%, 404s: 9.4%
Robots: 3.5%, Other: 4.5%)

0
(0)

8,407,363
(271,351)

8,407,363
(271,351)

v1.7.16 (.NET 4.5)   Linux

Crawling Cluster 2

12/12/2017 02:19:23

12 hours 16 mins 25 secs

2,998

27

77.3%
(DNS: 1.9%, Conn: 3.1%
T-out: 0.8%, 404s: 9.3%
Robots: 3.7%, Other: 4.0%)

0
(0)

8,643,672
(288,382)

8,643,672
(288,382)

v1.7.16 (.NET 4.5)   Linux

Crawling Cluster 2

12/12/2017 02:19:23

12 hours 16 mins 25 secs

3,045

25

76.9%
(DNS: 2.5%, Conn: 2.7%
T-out: 0.5%, 404s: 8.8%
Robots: 3.9%, Other: 4.8%)

0
(0)

8,876,992
(296,410)

8,876,992
(296,410)

v1.7.16 (.NET 4.5)   Linux

Crawling Cluster 2

12/12/2017 02:19:24

12 hours 16 mins 26 secs

2,852

28

77.7%
(DNS: 1.1%, Conn: 3.5%
T-out: 0.6%, 404s: 8.9%
Robots: 3.7%, Other: 4.4%)

0
(0)

7,956,544
(262,547)

7,956,544
(262,547)

v1.7.16 (.NET 4.5)   Linux

Crawling Cluster 2

12/12/2017 02:19:26

12 hours 16 mins 28 secs

2,729

23

76.8%
(DNS: 2.1%, Conn: 3.8%
T-out: 0.6%, 404s: 8.6%
Robots: 3.6%, Other: 4.6%)

0
(0)

8,450,626
(275,239)

8,450,626
(275,239)

v1.7.16 (.NET 4.5)   Linux

Crawling Cluster 2

12/12/2017 02:19:27

12 hours 16 mins 29 secs

2,792

23

78.4%
(DNS: 1.9%, Conn: 2.9%
T-out: 0.6%, 404s: 8.9%
Robots: 3.1%, Other: 4.3%)

0
(0)

6,499,074
(210,133)

6,499,074
(210,133)

v1.7.16 (.NET 4.5)   Linux

Crawling Cluster 2

12/12/2017 02:19:29

12 hours 16 mins 31 secs

3,052

27

78.0%
(DNS: 1.9%, Conn: 3.1%
T-out: 0.4%, 404s: 9.3%
Robots: 3.1%, Other: 4.2%)

0
(0)

8,320,610
(278,479)

8,320,610
(278,479)

v1.7.16 (.NET 4.5)   Linux

Crawling Cluster 2

18/12/2017 09:58:46

2 days 9 hours 17 mins 48 secs

4,086

42

81.9%
(DNS: 1.4%, Conn: 2.5%
T-out: 0.9%, 404s: 7.1%
Robots: 2.6%, Other: 3.6%)

1,223,581
(42,545)

21,488,096
(718,188)

21,488,096
(718,188)

v1.7.16 (.NET 4.5)   Linux

Crawling Cluster 2

18/12/2017 09:58:48

2 days 9 hours 17 mins 51 secs

4,347

44

81.6%
(DNS: 1.3%, Conn: 2.4%
T-out: 0.9%, 404s: 7.1%
Robots: 2.8%, Other: 3.7%)

1,405,646
(48,550)

23,869,459
(798,580)

23,869,459
(798,580)

v1.7.16 (.NET 4.5)   Linux

Crawling Cluster 2

18/12/2017 09:58:48

2 days 9 hours 17 mins 51 secs

4,024

40

81.9%
(DNS: 1.3%, Conn: 2.4%
T-out: 0.7%, 404s: 7.3%
Robots: 2.5%, Other: 3.8%)

1,179,342
(40,911)

22,799,676
(751,180)

22,799,676
(751,180)

v1.7.16 (.NET 4.5)   Linux

Crawling Cluster 2

18/12/2017 09:58:49

2 days 9 hours 17 mins 51 secs

7

n/a

64.3%
(DNS: 0.0%, Conn: 1.4%
T-out: 4.1%, 404s: 1.5%
Robots: 1.0%, Other: 27.7%)

0
(0)

11,899,856
(395,446)

11,899,856
(395,446)

v1.7.16 (.NET 4.5)   Linux

Crawling Cluster 2

18/12/2017 09:58:53

2 days 9 hours 17 mins 55 secs

4,146

42

80.9%
(DNS: 1.3%, Conn: 2.4%
T-out: 0.8%, 404s: 7.8%
Robots: 3.0%, Other: 3.8%)

1,358,399
(45,547)

22,762,068
(753,491)

22,762,068
(753,491)

v1.7.16 (.NET 4.5)   Linux

Crawling Cluster 2

18/12/2017 09:58:53

2 days 9 hours 17 mins 56 secs

4,245

43

82.0%
(DNS: 1.2%, Conn: 2.4%
T-out: 0.7%, 404s: 7.2%
Robots: 2.7%, Other: 3.7%)

1,372,096
(45,821)

21,426,053
(716,498)

21,426,053
(716,498)

v1.7.16 (.NET 4.5)   Linux

Crawling Cluster 2

18/12/2017 09:58:54

2 days 9 hours 17 mins 56 secs

4,337

43

81.9%
(DNS: 1.2%, Conn: 2.5%
T-out: 0.8%, 404s: 7.2%
Robots: 2.6%, Other: 3.8%)

1,421,045
(48,582)

22,625,985
(753,161)

22,625,985
(753,161)

v1.7.16 (.NET 4.5)   Linux

Crawling Cluster 2

18/12/2017 09:58:55

2 days 9 hours 17 mins 58 secs

4,153

41

81.5%
(DNS: 1.4%, Conn: 2.3%
T-out: 0.8%, 404s: 7.5%
Robots: 2.7%, Other: 3.8%)

1,458,207
(51,879)

22,203,042
(740,258)

22,203,042
(740,258)

v1.7.16 (.NET 4.5)   Linux

Crawling Cluster 2

18/12/2017 09:58:57

2 days 9 hours 17 mins 59 secs

4,034

42

81.3%
(DNS: 1.4%, Conn: 2.6%
T-out: 0.9%, 404s: 7.3%
Robots: 2.6%, Other: 3.9%)

1,347,103
(45,281)

22,865,624
(763,664)

22,865,624
(763,664)

v1.7.16 (.NET 4.5)   Linux

Crawling Cluster 2

18/12/2017 09:58:58

2 days 9 hours 18 mins 1 sec

3,986

40

81.7%
(DNS: 1.3%, Conn: 2.4%
T-out: 0.8%, 404s: 7.3%
Robots: 2.5%, Other: 4.0%)

1,392,658
(44,268)

22,594,782
(751,133)

22,594,782
(751,133)

Total (20 nodes)

66,834

641

-

12,158,077
(413,384)

297,351,807
(9,874,002)

297,351,807
(9,874,002)

The following chart shows dog02's contribution (blue) to overall crawling effort by day.

Last updated: 18 Dec 2017 10:02:57:900 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12