Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://patdavies.net/

Joined:

18/10/2005 21:15:00

URLs crawled:

93,053,384,998

Data (MB)*:

2,842,671,425

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

mj12-kan-27-03

22/05/2019 02:31:19

2 hours 31 mins 2 secs

1,030

21

68.1%
(DNS: 0.7%, Conn: 1.3%
T-out: 4.2%, 404s: 11.8%
Robots: 1.3%, Other: 12.6%)

235,777
(6,121)

25,229,583
(749,507)

718,566,922
(22,182,711)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-23-03

22/05/2019 02:46:20

2 hours 46 mins 2 secs

1,448

21

73.9%
(DNS: 3.7%, Conn: 0.7%
T-out: 2.4%, 404s: 9.6%
Robots: 2.0%, Other: 7.6%)

232,900
(5,683)

25,777,964
(762,814)

924,925,931
(29,093,080)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-27-01

22/05/2019 02:46:20

2 hours 46 mins 2 secs

1,271

20

63.3%
(DNS: 8.7%, Conn: 1.9%
T-out: 2.7%, 404s: 11.3%
Robots: 1.6%, Other: 10.5%)

238,187
(6,229)

25,294,707
(752,785)

718,383,765
(22,211,978)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-28-02

22/05/2019 02:46:20

2 hours 46 mins 2 secs

881

17

64.3%
(DNS: 2.6%, Conn: 2.0%
T-out: 1.4%, 404s: 19.0%
Robots: 2.1%, Other: 8.5%)

223,506
(5,777)

25,692,837
(769,815)

743,621,033
(23,105,272)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-21-01

22/05/2019 02:46:20

2 hours 46 mins 2 secs

1,277

18

68.2%
(DNS: 6.8%, Conn: 1.4%
T-out: 3.9%, 404s: 10.6%
Robots: 2.2%, Other: 6.9%)

249,230
(5,832)

25,083,320
(746,191)

903,786,781
(28,272,404)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-22-01

22/05/2019 02:46:20

2 hours 46 mins 3 secs

1,576

18

68.7%
(DNS: 3.7%, Conn: 1.2%
T-out: 3.2%, 404s: 12.2%
Robots: 1.5%, Other: 9.6%)

243,026
(6,495)

25,345,601
(752,652)

929,949,660
(29,248,038)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-22-03

22/05/2019 02:46:21

2 hours 46 mins 3 secs

1,127

17

68.3%
(DNS: 3.5%, Conn: 1.0%
T-out: 3.7%, 404s: 11.4%
Robots: 2.7%, Other: 9.3%)

225,609
(5,749)

24,716,557
(738,161)

913,220,752
(28,743,745)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-25-02

22/05/2019 02:46:21

2 hours 46 mins 3 secs

1,176

20

62.3%
(DNS: 3.4%, Conn: 0.8%
T-out: 2.7%, 404s: 17.7%
Robots: 2.6%, Other: 10.5%)

249,656
(6,078)

24,860,789
(744,556)

919,795,471
(28,998,068)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-28-03

22/05/2019 02:46:21

2 hours 46 mins 3 secs

1,689

19

72.2%
(DNS: 2.4%, Conn: 1.1%
T-out: 2.9%, 404s: 12.3%
Robots: 1.3%, Other: 7.7%)

253,874
(6,442)

24,750,854
(739,575)

742,660,273
(23,082,881)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-28-01

22/05/2019 02:46:21

2 hours 46 mins 3 secs

1,293

20

67.9%
(DNS: 4.2%, Conn: 1.2%
T-out: 3.4%, 404s: 12.6%
Robots: 2.2%, Other: 8.5%)

235,901
(6,247)

25,253,028
(756,536)

736,195,386
(22,896,338)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-23-02

22/05/2019 02:46:21

2 hours 46 mins 3 secs

954

20

65.2%
(DNS: 1.6%, Conn: 0.7%
T-out: 3.9%, 404s: 14.9%
Robots: 3.1%, Other: 10.7%)

225,758
(5,110)

25,802,702
(769,992)

928,380,292
(29,261,332)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-26-01

22/05/2019 02:46:21

2 hours 46 mins 3 secs

1,426

18

71.4%
(DNS: 1.7%, Conn: 0.8%
T-out: 3.1%, 404s: 12.2%
Robots: 3.2%, Other: 7.6%)

226,662
(5,386)

25,444,942
(763,305)

737,564,435
(22,928,434)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-22-02

22/05/2019 02:46:21

2 hours 46 mins 3 secs

1,357

22

65.7%
(DNS: 2.6%, Conn: 1.0%
T-out: 3.5%, 404s: 11.3%
Robots: 4.0%, Other: 11.9%)

249,041
(6,684)

25,806,057
(774,436)

925,858,457
(29,197,716)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-24-01

22/05/2019 02:46:21

2 hours 46 mins 3 secs

874

19

68.6%
(DNS: 2.1%, Conn: 0.7%
T-out: 5.1%, 404s: 13.3%
Robots: 2.2%, Other: 7.9%)

237,265
(5,853)

25,600,400
(763,733)

923,532,716
(29,133,208)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-24-03

22/05/2019 02:46:22

2 hours 46 mins 4 secs

1,704

18

67.9%
(DNS: 3.9%, Conn: 1.1%
T-out: 2.6%, 404s: 12.4%
Robots: 2.8%, Other: 9.2%)

252,767
(6,987)

25,289,829
(755,352)

926,262,391
(29,223,258)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-21-03

22/05/2019 02:46:22

2 hours 46 mins 4 secs

1,099

19

62.3%
(DNS: 5.1%, Conn: 1.4%
T-out: 4.0%, 404s: 17.1%
Robots: 2.5%, Other: 7.6%)

208,114
(4,938)

25,271,223
(757,621)

906,032,436
(28,459,309)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-25-01

22/05/2019 02:46:30

2 hours 46 mins 3 secs

1,362

26

68.4%
(DNS: 3.5%, Conn: 1.6%
T-out: 2.4%, 404s: 13.3%
Robots: 1.8%, Other: 9.1%)

245,525
(6,236)

25,103,819
(751,350)

921,253,031
(29,026,111)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-24-02

22/05/2019 02:46:30

2 hours 46 mins 3 secs

934

22

67.9%
(DNS: 2.4%, Conn: 1.1%
T-out: 3.4%, 404s: 15.9%
Robots: 2.9%, Other: 6.4%)

226,118
(5,646)

25,676,125
(762,128)

927,228,210
(29,200,800)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-26-03

22/05/2019 02:57:48

2 hours 46 mins 4 secs

1,449

20

67.4%
(DNS: 1.9%, Conn: 0.9%
T-out: 3.6%, 404s: 14.7%
Robots: 2.0%, Other: 9.5%)

246,316
(6,454)

25,391,062
(759,034)

731,905,889
(22,755,774)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-21-02

22/05/2019 02:57:53

2 hours 46 mins 3 secs

1,553

25

68.0%
(DNS: 2.4%, Conn: 1.1%
T-out: 3.4%, 404s: 11.9%
Robots: 2.1%, Other: 11.1%)

255,316
(6,585)

25,239,813
(755,875)

914,130,461
(28,624,712)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-27-02

22/05/2019 02:58:04

2 hours 46 mins 3 secs

1,651

20

67.2%
(DNS: 2.1%, Conn: 1.6%
T-out: 3.3%, 404s: 14.8%
Robots: 2.6%, Other: 8.4%)

246,191
(6,484)

25,778,159
(767,395)

721,684,472
(22,265,997)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-26-02

22/05/2019 02:58:06

2 hours 46 mins 2 secs

1,543

18

68.6%
(DNS: 4.4%, Conn: 1.2%
T-out: 2.9%, 404s: 11.3%
Robots: 2.8%, Other: 8.7%)

243,381
(6,045)

25,693,140
(761,574)

731,856,625
(22,844,743)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-23-01

22/05/2019 02:58:28

2 hours 46 mins 4 secs

1,929

20

67.7%
(DNS: 4.1%, Conn: 1.2%
T-out: 3.6%, 404s: 11.1%
Robots: 2.7%, Other: 9.5%)

268,236
(6,671)

25,200,736
(752,045)

921,881,820
(29,041,504)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-25-03

22/05/2019 02:58:30

2 hours 46 mins 2 secs

1,276

22

64.1%
(DNS: 7.7%, Conn: 2.1%
T-out: 2.8%, 404s: 13.6%
Robots: 3.1%, Other: 6.4%)

254,062
(6,356)

25,764,712
(766,999)

918,966,800
(29,047,651)

Total (24 nodes)

31,879

480

-

5,772,418
(146,088)

609,067,959
(18,173,431)

20,387,644,009
(638,845,064)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 22 May 2019 02:59:07:607 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12