Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://www.patdavies.net

Joined:

18/10/2005 21:15:00

URLs crawled:

33,683,957,300

Data (MB)*:

938,437,254

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.15 Update 2 (.NET 4.5)   Linux

lxapp-kan-01-03

24/03/2017 09:16:07

4 hours 16 mins 6 secs

5,693

35

83.6%
(DNS: 1.5%, Conn: 1.7%
T-out: 1.5%, 404s: 6.6%
Robots: 1.8%, Other: 3.2%)

0
(0)

98,303,159
(3,255,359)

317,605,126
(10,631,690)

v1.7.15 Update 2 (.NET 4.5)   Linux

lxapp-kan-01-02

24/03/2017 09:16:08

4 hours 16 mins 7 secs

5,834

31

82.3%
(DNS: 1.4%, Conn: 1.9%
T-out: 1.8%, 404s: 7.1%
Robots: 1.6%, Other: 3.8%)

0
(0)

97,519,870
(3,222,947)

306,750,655
(10,241,874)

v1.7.15 Update 2 (.NET 4.5)   Linux

lxapp-kan-01-01

24/03/2017 09:16:09

4 hours 16 mins 8 secs

5,847

32

82.4%
(DNS: 2.0%, Conn: 1.8%
T-out: 1.5%, 404s: 6.6%
Robots: 2.1%, Other: 3.6%)

0
(0)

96,550,788
(3,185,491)

313,863,155
(10,473,905)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

lxapp-kan-02-01

24/03/2017 23:46:06

46 mins 3 secs

1,424

118

80.7%
(DNS: 0.5%, Conn: 3.0%
T-out: 3.2%, 404s: 7.4%
Robots: 3.1%, Other: 2.2%)

9,846
(282)

94,366,847
(3,132,283)

97,354,847
(3,234,225)

v1.7.15 Update 2 (.NET 4.5) Windows

MJ12-KAN-04

24/03/2017 23:46:49

2 days 3 hours 17 mins 43 secs

7,093

77

81.9%
(DNS: 1.3%, Conn: 2.5%
T-out: 0.7%, 404s: 6.8%
Robots: 3.0%, Other: 3.8%)

4,971
(133)

117,877,908
(3,934,250)

1,163,572,685
(32,634,010)

v1.7.15 Update 2 (.NET 4.5) Windows

MJ12-KAN-10

24/03/2017 23:56:19

2 hours 31 mins 5 secs

4,613

48

78.5%
(DNS: 1.3%, Conn: 2.1%
T-out: 0.3%, 404s: 8.3%
Robots: 5.4%, Other: 4.1%)

0
(0)

83,103,353
(2,770,708)

667,707,160
(19,076,027)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-08-03

25/03/2017 00:01:02

1 hour 1 min 1 sec

1,560

95

79.0%
(DNS: 0.9%, Conn: 2.9%
T-out: 3.3%, 404s: 5.2%
Robots: 4.6%, Other: 4.1%)

4,998
(158)

86,592,590
(2,849,776)

769,509,075
(22,901,866)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-07-02

25/03/2017 00:01:02

1 hour 1 min 2 secs

2,531

70

80.8%
(DNS: 2.5%, Conn: 1.7%
T-out: 3.8%, 404s: 3.8%
Robots: 3.8%, Other: 3.6%)

4,977
(216)

89,012,326
(2,927,035)

1,020,689,174
(29,324,528)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-03-02

25/03/2017 00:01:03

1 hour 1 min 0 sec

462

18

79.8%
(DNS: 0.2%, Conn: 1.9%
T-out: 1.4%, 404s: 5.1%
Robots: 4.5%, Other: 7.1%)

0
(0)

5,009,623
(166,801)

660,598,644
(16,960,099)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-09-03

25/03/2017 00:01:03

1 hour 1 min 1 sec

2,047

78

82.0%
(DNS: 0.4%, Conn: 1.5%
T-out: 2.9%, 404s: 7.1%
Robots: 2.5%, Other: 3.5%)

9,735
(239)

90,074,571
(2,951,088)

744,172,941
(22,151,485)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-09-02

25/03/2017 00:01:03

1 hour 1 min 2 secs

2,564

80

75.7%
(DNS: 0.8%, Conn: 1.1%
T-out: 5.7%, 404s: 6.9%
Robots: 5.3%, Other: 4.4%)

4,979
(159)

85,646,042
(2,822,085)

935,234,587
(26,786,125)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-03-03

25/03/2017 00:01:03

1 hour 1 min 1 sec

1,390

55

80.5%
(DNS: 1.1%, Conn: 0.4%
T-out: 4.0%, 404s: 7.1%
Robots: 2.4%, Other: 4.5%)

4,965
(151)

43,937,222
(1,408,566)

572,096,755
(16,452,994)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-08-01

25/03/2017 00:01:03

1 hour 1 min 2 secs

1,963

79

78.7%
(DNS: 0.5%, Conn: 1.2%
T-out: 4.1%, 404s: 7.0%
Robots: 6.2%, Other: 2.3%)

4,967
(173)

89,938,779
(2,963,874)

1,002,455,343
(28,686,805)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-07-03

25/03/2017 00:01:03

1 hour 1 min 2 secs

1,749

83

81.6%
(DNS: 0.7%, Conn: 2.9%
T-out: 1.8%, 404s: 4.0%
Robots: 5.0%, Other: 4.0%)

4,841
(169)

91,356,138
(2,999,777)

460,724,436
(13,522,742)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-06-01

25/03/2017 00:01:03

1 hour 1 min 2 secs

858

79

77.2%
(DNS: 1.4%, Conn: 2.2%
T-out: 5.0%, 404s: 6.4%
Robots: 6.7%, Other: 1.2%)

4,983
(166)

87,521,150
(2,888,688)

986,149,874
(28,071,325)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-06-03

25/03/2017 00:01:03

1 hour 1 min 2 secs

2,493

71

80.1%
(DNS: 3.3%, Conn: 1.4%
T-out: 2.2%, 404s: 5.9%
Robots: 2.3%, Other: 4.8%)

4,946
(193)

89,100,654
(2,930,192)

776,622,303
(22,987,035)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-05-03

25/03/2017 00:01:03

1 hour 1 min 1 sec

1,493

85

84.3%
(DNS: 0.1%, Conn: 1.7%
T-out: 2.0%, 404s: 4.9%
Robots: 2.9%, Other: 4.0%)

4,745
(171)

82,573,688
(2,714,916)

761,794,620
(22,674,995)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-06-02

25/03/2017 00:01:03

1 hour 1 min 2 secs

1,286

85

68.9%
(DNS: 0.8%, Conn: 1.8%
T-out: 12.4%, 404s: 9.9%
Robots: 2.6%, Other: 3.6%)

4,991
(231)

89,544,165
(2,937,500)

990,270,191
(28,398,290)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-08-02

25/03/2017 00:01:03

1 hour 1 min 2 secs

1,926

89

74.7%
(DNS: 0.9%, Conn: 1.8%
T-out: 1.5%, 404s: 11.1%
Robots: 6.7%, Other: 3.2%)

4,984
(90)

90,966,575
(2,996,178)

984,741,019
(28,365,045)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

lxapp-kan-02-02

25/03/2017 00:01:03

1 hour 1 min 2 secs

1,755

83

77.5%
(DNS: 1.8%, Conn: 2.3%
T-out: 3.5%, 404s: 5.4%
Robots: 4.3%, Other: 5.3%)

0
(0)

93,050,171
(3,086,707)

95,885,654
(3,184,568)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-01-02

25/03/2017 00:01:03

1 hour 1 min 2 secs

1,969

86

77.6%
(DNS: 0.2%, Conn: 1.6%
T-out: 6.6%, 404s: 6.9%
Robots: 2.4%, Other: 4.6%)

4,972
(72)

85,061,290
(2,789,846)

1,034,331,295
(29,384,459)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-05-02

25/03/2017 00:01:04

1 hour 1 min 2 secs

786

102

80.9%
(DNS: 2.4%, Conn: 3.6%
T-out: 3.9%, 404s: 4.5%
Robots: 1.0%, Other: 3.8%)

0
(0)

84,617,817
(2,780,274)

1,049,992,801
(29,851,613)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-01-03

25/03/2017 00:01:04

1 hour 1 min 2 secs

1,408

84

77.2%
(DNS: 1.6%, Conn: 1.9%
T-out: 3.2%, 404s: 7.4%
Robots: 3.3%, Other: 5.3%)

4,880
(202)

86,107,682
(2,840,501)

770,350,881
(22,816,776)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-02-03

25/03/2017 00:01:04

1 hour 1 min 2 secs

1,955

79

78.1%
(DNS: 1.9%, Conn: 1.3%
T-out: 5.4%, 404s: 6.2%
Robots: 3.8%, Other: 3.2%)

9,908
(246)

82,833,360
(2,722,470)

710,821,464
(20,861,790)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-01-01

25/03/2017 00:01:04

1 hour 1 min 2 secs

658

83

75.5%
(DNS: 0.1%, Conn: 0.2%
T-out: 8.5%, 404s: 6.4%
Robots: 1.1%, Other: 8.2%)

4,904
(98)

85,369,698
(2,810,997)

1,006,411,634
(28,708,134)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-09-01

25/03/2017 00:01:04

1 hour 1 min 3 secs

1,478

81

73.4%
(DNS: 5.6%, Conn: 1.2%
T-out: 5.0%, 404s: 7.3%
Robots: 2.7%, Other: 4.7%)

4,997
(159)

91,351,113
(3,005,606)

1,005,947,342
(28,701,377)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-02-01

25/03/2017 00:01:04

1 hour 1 min 2 secs

1,961

95

78.2%
(DNS: 1.4%, Conn: 0.5%
T-out: 4.9%, 404s: 6.4%
Robots: 3.8%, Other: 4.9%)

4,978
(112)

86,744,635
(2,866,540)

1,029,619,344
(28,918,384)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-07-01

25/03/2017 00:01:04

1 hour 1 min 3 secs

4,026

72

82.4%
(DNS: 1.9%, Conn: 2.2%
T-out: 1.6%, 404s: 4.6%
Robots: 3.2%, Other: 4.1%)

0
(0)

87,297,643
(2,853,961)

979,343,905
(28,341,157)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

lxapp-kan-02-03

25/03/2017 00:01:04

1 hour 1 min 2 secs

2,301

98

75.1%
(DNS: 2.3%, Conn: 2.8%
T-out: 2.4%, 404s: 7.7%
Robots: 4.9%, Other: 4.8%)

9,931
(568)

90,742,857
(3,004,756)

93,643,321
(3,104,379)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-05-01

25/03/2017 00:01:04

1 hour 1 min 3 secs

1,625

90

85.3%
(DNS: 0.3%, Conn: 1.0%
T-out: 1.1%, 404s: 6.3%
Robots: 2.7%, Other: 3.2%)

4,990
(171)

86,041,787
(2,829,728)

992,849,959
(28,505,945)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-03-01

25/03/2017 00:01:04

1 hour 1 min 3 secs

1,749

102

78.3%
(DNS: 0.2%, Conn: 1.3%
T-out: 3.2%, 404s: 8.2%
Robots: 5.8%, Other: 3.0%)

9,926
(346)

44,409,461
(1,429,808)

826,670,363
(22,757,602)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-02-02

25/03/2017 00:01:05

1 hour 1 min 3 secs

1,712

89

84.4%
(DNS: 2.7%, Conn: 0.4%
T-out: 1.6%, 404s: 6.3%
Robots: 2.1%, Other: 2.5%)

4,791
(121)

84,363,418
(2,776,452)

939,252,811
(26,531,295)

Total (32 nodes)

76,209

2,452

-

143,205
(4,626)

2,696,986,380
(88,855,160)

24,067,033,364
(695,242,544)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 25 Mar 2017 00:01:31:067 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12