Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Phil

Country:

United Kingdom United Kingdom

ID:

1060

Team:

OcUK (Join this team)

Joined:

02/06/2006 21:41:00

URLs crawled:

28,075,326,455

Data (MB)*:

712,431,848

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.15 Update 2 (.NET 4.5) Windows

AWS

20/07/2017 14:57:59

7 days 18 hours 39 mins 30 secs

1,830

19

81.0%
(DNS: 1.8%, Conn: 1.7%
T-out: 0.7%, 404s: 7.3%
Robots: 3.2%, Other: 4.4%)

0
(0)

16,159,902
(546,658)

130,418,762
(4,308,418)

v1.7.15 Update 3.1 (.NET 4.5)   Linux

N2

24/07/2017 11:08:49

1 day 10 hours 1 min 58 secs

2,173

21

77.3%
(DNS: 2.4%, Conn: 3.5%
T-out: 2.7%, 404s: 6.8%
Robots: 2.7%, Other: 4.7%)

815,113
(25,324)

36,828,161
(1,184,163)

36,828,161
(1,184,163)

v1.7.15 Update 3.1 (.NET 4.5)   Linux

N1

24/07/2017 22:52:33

1 day 21 hours 47 mins 17 secs

2,278

24

78.9%
(DNS: 1.0%, Conn: 2.6%
T-out: 2.5%, 404s: 7.7%
Robots: 2.7%, Other: 4.6%)

1,610,921
(49,583)

38,645,917
(1,248,962)

38,645,917
(1,248,962)

v1.7.15 Update 2 (.NET 4.5) Windows

3770K

24/07/2017 22:52:33

11 hours 16 mins 21 secs

2,037

23

79.8%
(DNS: 0.4%, Conn: 2.1%
T-out: 0.9%, 404s: 8.3%
Robots: 4.1%, Other: 4.4%)

1,529,000
(49,400)

59,295,683
(1,969,079)

1,739,021,296
(50,139,403)

v1.7.15 Update 3.1 (.NET 4.5)   Linux

N3

24/07/2017 22:56:12

1 day 21 hours 47 mins 20 secs

2,367

24

79.6%
(DNS: 0.6%, Conn: 2.2%
T-out: 2.7%, 404s: 7.5%
Robots: 2.6%, Other: 4.7%)

1,654,016
(54,421)

39,484,601
(1,283,921)

39,484,601
(1,283,921)

v1.7.15 Update 3.1 (.NET 4.5)   Linux

N4

24/07/2017 22:57:14

1 day 21 hours 47 mins 16 secs

2,583

27

79.7%
(DNS: 0.8%, Conn: 1.9%
T-out: 2.4%, 404s: 7.5%
Robots: 3.2%, Other: 4.7%)

1,700,767
(56,206)

39,754,745
(1,287,693)

39,754,745
(1,287,693)

v1.7.15 Update 2 (.NET 4.5) Windows

3570k

24/07/2017 22:58:13

1 day 5 hours 16 mins 54 secs

2,232

23

81.6%
(DNS: 0.3%, Conn: 2.2%
T-out: 0.9%, 404s: 7.5%
Robots: 2.9%, Other: 4.6%)

1,477,146
(50,135)

57,845,862
(1,931,239)

3,589,968,435
(98,170,864)

v1.7.15 Update 3.1 (.NET 4.5)   Linux

N5

24/07/2017 22:58:26

1 day 21 hours 47 mins 5 secs

2,656

28

79.6%
(DNS: 0.9%, Conn: 1.8%
T-out: 2.3%, 404s: 7.4%
Robots: 3.1%, Other: 4.9%)

1,735,537
(57,052)

13,748,987
(443,683)

13,748,987
(443,683)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

brix4

24/07/2017 22:59:27

1 day 2 hours 46 mins 29 secs

1,825

20

79.0%
(DNS: 0.7%, Conn: 3.8%
T-out: 2.0%, 404s: 6.6%
Robots: 3.4%, Other: 4.5%)

1,310,391
(42,222)

45,129,480
(1,438,875)

343,509,074
(11,199,081)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

brix3

24/07/2017 22:59:30

1 day 2 hours 46 mins 36 secs

2,134

22

78.1%
(DNS: 0.5%, Conn: 3.6%
T-out: 2.4%, 404s: 7.9%
Robots: 2.9%, Other: 4.7%)

1,525,421
(47,032)

46,837,540
(1,478,122)

345,098,266
(11,187,735)

v1.7.15 Update 3.1 (.NET 4.5)   Linux

brix2

24/07/2017 22:59:31

1 day 2 hours 46 mins 39 secs

2,050

23

78.4%
(DNS: 0.5%, Conn: 3.5%
T-out: 2.6%, 404s: 7.4%
Robots: 2.7%, Other: 4.9%)

1,428,833
(44,284)

46,448,876
(1,459,744)

325,463,328
(10,574,227)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

brix1

24/07/2017 22:59:43

1 day 2 hours 46 mins 28 secs

2,089

23

78.4%
(DNS: 0.6%, Conn: 3.6%
T-out: 2.2%, 404s: 7.5%
Robots: 3.1%, Other: 4.6%)

1,516,107
(47,981)

49,568,957
(1,582,116)

361,791,062
(11,793,009)

Total (12 nodes)

26,254

277

-

16,303,252
(523,640)

489,748,711
(15,854,255)

7,003,732,634
(202,821,159)

The following chart shows Phil's contribution (blue) to overall crawling effort by day.

Last updated: 24 Jul 2017 23:01:10:850 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12