Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://www.patdavies.net

Joined:

18/10/2005 21:15:00

URLs crawled:

28,866,415,282

Data (MB)*:

777,762,426

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-03-01

17/01/2017 20:54:51

5 hours 46 mins 8 secs

4,297

38

79.2%
(DNS: 1.2%, Conn: 1.2%
T-out: 2.7%, 404s: 8.1%
Robots: 3.6%, Other: 4.0%)

0
(0)

6,111,989
(185,270)

782,260,902
(21,327,794)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-03-03

18/01/2017 02:55:01

11 hours 46 mins 18 secs

3,779

39

83.5%
(DNS: 1.3%, Conn: 1.1%
T-out: 2.1%, 404s: 5.3%
Robots: 2.9%, Other: 3.7%)

0
(0)

10,543,297
(336,689)

528,159,533
(15,044,428)

v1.7.15 Update 2 (.NET 4.5) Windows

MJ12-KAN-10

18/01/2017 20:43:42

1 day 12 hours 32 mins 13 secs

4,656

55

81.7%
(DNS: 1.4%, Conn: 3.0%
T-out: 0.7%, 404s: 6.6%
Robots: 3.1%, Other: 3.4%)

0
(0)

73,597,255
(2,445,223)

527,864,198
(14,366,049)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-09-01

20/01/2017 12:01:03

1 min 0 sec

23

n/a

27.3%
(DNS: 0.0%, Conn: 72.7%
T-out: 0.0%, 404s: 0.0%
Robots: 0.0%, Other: 0.0%)

1,423,880
(47,327)

96,438,751
(3,166,766)

832,478,223
(22,918,319)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-03-02

20/01/2017 14:55:02

2 days 23 hours 46 mins 22 secs

443

5

81.0%
(DNS: 1.4%, Conn: 1.4%
T-out: 2.5%, 404s: 7.5%
Robots: 3.2%, Other: 3.0%)

194,061
(6,296)

7,208,669
(240,228)

645,724,989
(16,456,780)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-09-03

20/01/2017 15:01:06

3 hours 1 min 4 secs

3,582

90

82.0%
(DNS: 1.5%, Conn: 1.7%
T-out: 2.1%, 404s: 6.5%
Robots: 2.5%, Other: 3.7%)

1,723,430
(56,090)

101,801,987
(3,336,371)

573,927,110
(16,484,373)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-08-02

20/01/2017 15:01:06

3 hours 1 min 5 secs

3,481

89

82.6%
(DNS: 1.1%, Conn: 1.3%
T-out: 3.9%, 404s: 5.1%
Robots: 1.9%, Other: 4.1%)

1,946,183
(64,749)

102,591,482
(3,359,732)

811,613,275
(22,585,720)

v1.7.15 Update 2 (.NET 4.5)   Linux

lxapp-kan-01-01

20/01/2017 15:01:06

3 hours 1 min 5 secs

4,456

85

83.0%
(DNS: 1.3%, Conn: 1.4%
T-out: 2.2%, 404s: 6.5%
Robots: 2.4%, Other: 3.1%)

2,184,387
(71,151)

109,594,401
(3,620,363)

127,202,829
(4,237,838)

v1.7.15 Update 2 (.NET 4.5)   Linux

lxapp-kan-01-02

20/01/2017 15:01:07

3 hours 1 min 6 secs

4,453

70

82.5%
(DNS: 1.1%, Conn: 1.3%
T-out: 2.8%, 404s: 6.7%
Robots: 3.3%, Other: 2.3%)

2,033,504
(70,300)

110,736,275
(3,667,775)

117,317,229
(3,893,647)

v1.7.15 Update 2 (.NET 4.5)   Linux

lxapp-kan-01-03

20/01/2017 15:01:07

3 hours 1 min 5 secs

4,253

73

80.6%
(DNS: 2.0%, Conn: 1.6%
T-out: 1.7%, 404s: 6.2%
Robots: 3.3%, Other: 4.5%)

2,019,206
(65,610)

110,218,799
(3,651,329)

128,019,163
(4,279,306)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-02-01

20/01/2017 15:01:07

3 hours 1 min 5 secs

4,050

71

83.6%
(DNS: 1.0%, Conn: 1.2%
T-out: 2.0%, 404s: 6.3%
Robots: 2.4%, Other: 3.4%)

2,067,919
(70,534)

48,198,129
(1,582,570)

862,738,064
(23,339,169)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-07-02

20/01/2017 15:01:07

3 hours 1 min 6 secs

3,312

83

80.8%
(DNS: 0.8%, Conn: 2.2%
T-out: 4.4%, 404s: 6.0%
Robots: 2.4%, Other: 3.4%)

2,072,404
(68,224)

102,983,456
(3,393,369)

849,951,281
(23,640,124)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-06-02

20/01/2017 15:01:07

3 hours 1 min 5 secs

3,545

61

80.8%
(DNS: 1.2%, Conn: 1.6%
T-out: 3.6%, 404s: 6.7%
Robots: 2.2%, Other: 3.9%)

1,763,608
(57,263)

100,479,622
(3,297,732)

819,007,028
(22,713,073)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-01-02

20/01/2017 15:01:08

3 hours 1 min 5 secs

4,295

57

81.1%
(DNS: 1.4%, Conn: 1.5%
T-out: 2.9%, 404s: 6.6%
Robots: 2.9%, Other: 3.6%)

1,923,716
(62,864)

105,014,792
(3,455,749)

869,250,985
(23,883,899)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-08-03

20/01/2017 15:01:08

3 hours 1 min 7 secs

3,399

76

80.3%
(DNS: 1.0%, Conn: 2.0%
T-out: 3.1%, 404s: 6.8%
Robots: 3.1%, Other: 3.8%)

1,834,486
(61,582)

101,225,910
(3,313,612)

601,355,171
(17,295,633)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-09-02

20/01/2017 15:01:08

3 hours 1 min 6 secs

4,043

74

83.1%
(DNS: 0.7%, Conn: 1.2%
T-out: 4.1%, 404s: 6.2%
Robots: 1.9%, Other: 2.8%)

1,973,739
(66,442)

99,277,544
(3,250,170)

767,337,194
(21,192,382)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-02-03

20/01/2017 15:01:08

3 hours 1 min 4 secs

4,479

39

83.2%
(DNS: 1.7%, Conn: 1.2%
T-out: 2.0%, 404s: 6.0%
Robots: 2.8%, Other: 3.0%)

726,111
(24,921)

37,964,385
(1,257,669)

549,499,713
(15,475,705)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-08-01

20/01/2017 15:01:08

3 hours 1 min 7 secs

3,016

83

80.3%
(DNS: 1.4%, Conn: 1.4%
T-out: 4.8%, 404s: 6.6%
Robots: 2.4%, Other: 3.1%)

1,906,952
(62,295)

97,694,736
(3,195,569)

831,362,726
(22,995,664)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-01-01

20/01/2017 15:01:08

3 hours 1 min 6 secs

3,065

79

81.7%
(DNS: 0.8%, Conn: 3.1%
T-out: 2.2%, 404s: 6.3%
Robots: 3.1%, Other: 2.7%)

1,717,825
(59,675)

106,043,245
(3,491,125)

839,444,826
(23,129,974)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-02-02

20/01/2017 15:01:08

3 hours 1 min 6 secs

3,873

60

81.2%
(DNS: 1.2%, Conn: 1.7%
T-out: 3.1%, 404s: 6.0%
Robots: 3.1%, Other: 3.6%)

1,970,498
(67,829)

33,747,556
(1,122,971)

774,168,178
(21,018,441)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-01-03

20/01/2017 15:01:09

3 hours 1 min 6 secs

3,906

74

82.8%
(DNS: 1.6%, Conn: 1.6%
T-out: 2.8%, 404s: 5.9%
Robots: 2.6%, Other: 2.7%)

1,812,377
(62,255)

101,445,873
(3,344,102)

604,046,301
(17,240,863)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-06-03

20/01/2017 15:01:09

3 hours 1 min 6 secs

3,688

88

81.1%
(DNS: 1.3%, Conn: 1.1%
T-out: 2.4%, 404s: 8.1%
Robots: 3.2%, Other: 2.9%)

1,937,510
(64,589)

102,134,439
(3,347,148)

606,406,862
(17,337,722)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-07-03

20/01/2017 15:01:09

3 hours 1 min 7 secs

3,663

85

82.2%
(DNS: 1.5%, Conn: 1.2%
T-out: 2.3%, 404s: 6.8%
Robots: 3.0%, Other: 3.1%)

1,922,014
(63,822)

87,867,842
(2,886,251)

289,036,425
(7,807,433)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-07-01

20/01/2017 15:01:09

3 hours 1 min 8 secs

3,481

80

81.1%
(DNS: 2.0%, Conn: 1.7%
T-out: 2.7%, 404s: 6.3%
Robots: 2.4%, Other: 3.9%)

1,746,355
(56,455)

98,765,437
(3,249,530)

810,807,801
(22,745,921)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-06-01

20/01/2017 15:01:09

3 hours 1 min 7 secs

3,412

82

81.5%
(DNS: 1.9%, Conn: 1.9%
T-out: 1.8%, 404s: 6.2%
Robots: 3.4%, Other: 3.3%)

1,937,692
(63,708)

100,075,239
(3,273,926)

818,135,475
(22,465,013)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-05-03

20/01/2017 15:01:09

3 hours 1 min 6 secs

3,951

78

82.0%
(DNS: 0.9%, Conn: 2.8%
T-out: 2.9%, 404s: 5.7%
Robots: 2.7%, Other: 2.9%)

1,946,765
(64,688)

103,145,728
(3,402,285)

599,181,133
(17,245,777)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-05-01

20/01/2017 15:01:09

3 hours 1 min 6 secs

3,766

67

83.0%
(DNS: 1.6%, Conn: 1.1%
T-out: 2.3%, 404s: 7.6%
Robots: 2.0%, Other: 2.4%)

1,817,176
(62,396)

101,067,323
(3,336,661)

825,750,214
(22,925,819)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-05-02

20/01/2017 15:01:10

3 hours 1 min 7 secs

3,134

87

80.6%
(DNS: 1.7%, Conn: 1.4%
T-out: 2.8%, 404s: 6.8%
Robots: 3.1%, Other: 3.5%)

1,896,185
(61,311)

103,523,078
(3,392,343)

883,980,874
(24,305,924)

v1.7.15 Update 2 (.NET 4.5) Windows

MJ12-KAN-04

20/01/2017 15:01:42

23 hours 46 mins 45 secs

6,093

65

83.7%
(DNS: 1.5%, Conn: 2.2%
T-out: 0.5%, 404s: 6.3%
Robots: 2.6%, Other: 3.2%)

2,666,609
(91,230)

125,311,723
(4,191,744)

973,463,644
(26,214,926)

Total (29 nodes)

105,594

1,933

-

47,164,592
(1,573,606)

2,484,808,962
(81,794,272)

19,249,491,346
(534,567,716)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 20 Jan 2017 15:02:31:120 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12