Majestic-12 logo
Distributed Search Engine
Use it:
Install the 'Majestic-12' search plugin.
Home | DSearch | Projects | Stats | Download | Forum | Blog | About | SEO Services

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://patdavies.net/

Joined:

18/10/2005 21:15:00

URLs crawled:

106,761,985,366

Data (MB)*:

3,307,310,660

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.21   Linux

mj12-kan-25-03

14/06/2021 23:46:51

5 hours 46 mins 4 secs

998

15

70.6%
(DNS: 5.6%, Conn: 1.7%
T-out: 2.9%, 404s: 10.4%
Robots: 1.6%, Other: 7.3%)

849,664
(36,898)

22,256,112
(777,947)

1,500,063,403
(48,543,914)

v1.7.21   Linux

mj12-kan-23-02

14/06/2021 23:46:51

5 hours 46 mins 4 secs

1,204

15

71.2%
(DNS: 3.9%, Conn: 1.0%
T-out: 3.2%, 404s: 11.5%
Robots: 2.3%, Other: 6.8%)

898,784
(34,669)

22,611,637
(837,622)

1,508,507,614
(48,839,608)

v1.7.21   Linux

mj12-kan-25-01

14/06/2021 23:46:51

5 hours 46 mins 5 secs

1,465

19

74.3%
(DNS: 1.0%, Conn: 1.3%
T-out: 3.1%, 404s: 10.7%
Robots: 3.1%, Other: 6.4%)

915,488
(36,166)

22,671,401
(789,421)

1,502,233,258
(48,556,926)

v1.7.21   Linux

mj12-kan-22-01

14/06/2021 23:46:51

5 hours 46 mins 6 secs

1,362

21

72.3%
(DNS: 3.7%, Conn: 1.5%
T-out: 2.7%, 404s: 10.1%
Robots: 2.8%, Other: 7.0%)

858,613
(35,486)

23,601,077
(870,637)

1,513,421,990
(48,891,806)

v1.7.21   Linux

mj12-kan-23-03

14/06/2021 23:46:51

5 hours 46 mins 5 secs

1,212

20

71.7%
(DNS: 4.2%, Conn: 1.4%
T-out: 2.5%, 404s: 11.3%
Robots: 3.8%, Other: 5.2%)

930,606
(38,457)

23,373,499
(865,331)

1,508,009,748
(48,719,799)

v1.7.21   Linux

mj12-kan-21-01

14/06/2021 23:46:52

5 hours 46 mins 5 secs

1,201

21

72.2%
(DNS: 3.6%, Conn: 1.9%
T-out: 2.8%, 404s: 10.6%
Robots: 2.8%, Other: 6.1%)

906,305
(37,869)

23,970,651
(872,736)

1,487,350,791
(47,978,528)

v1.7.21   Linux

mj12-kan-27-03

14/06/2021 23:46:52

5 hours 46 mins 6 secs

987

17

70.5%
(DNS: 5.4%, Conn: 1.6%
T-out: 2.4%, 404s: 10.8%
Robots: 2.6%, Other: 6.7%)

865,533
(34,090)

22,458,936
(828,044)

1,297,147,515
(41,710,867)

v1.7.21   Linux

mj12-kan-24-03

14/06/2021 23:46:53

5 hours 46 mins 6 secs

1,245

19

73.8%
(DNS: 2.3%, Conn: 1.0%
T-out: 2.4%, 404s: 11.4%
Robots: 2.7%, Other: 6.3%)

902,194
(35,261)

22,628,149
(845,558)

1,506,859,826
(48,780,516)

v1.7.21   Linux

mj12-kan-24-01

14/06/2021 23:46:53

5 hours 46 mins 7 secs

1,349

21

73.9%
(DNS: 2.6%, Conn: 1.0%
T-out: 3.6%, 404s: 11.3%
Robots: 1.9%, Other: 5.8%)

936,505
(39,064)

23,269,241
(847,490)

1,504,161,308
(48,729,257)

v1.7.21   Linux

mj12-kan-28-01

14/06/2021 23:46:53

5 hours 46 mins 6 secs

1,044

16

66.9%
(DNS: 6.3%, Conn: 1.3%
T-out: 3.5%, 404s: 14.0%
Robots: 2.1%, Other: 5.9%)

890,123
(35,316)

21,536,147
(794,356)

1,317,529,063
(42,570,486)

v1.7.21   Linux

mj12-kan-21-03

14/06/2021 23:58:55

5 hours 46 mins 6 secs

1,223

15

72.4%
(DNS: 3.7%, Conn: 1.5%
T-out: 3.5%, 404s: 11.7%
Robots: 2.6%, Other: 4.7%)

833,376
(31,721)

23,244,303
(854,032)

1,487,407,857
(48,107,760)

v1.7.21   Linux

mj12-kan-28-02

14/06/2021 23:58:57

5 hours 46 mins 6 secs

892

17

74.9%
(DNS: 2.6%, Conn: 1.5%
T-out: 3.3%, 404s: 10.4%
Robots: 1.8%, Other: 5.6%)

898,307
(37,772)

22,678,183
(843,813)

1,323,609,216
(42,678,491)

v1.7.21   Linux

mj12-kan-28-03

14/06/2021 23:59:03

5 hours 46 mins 5 secs

1,352

23

68.7%
(DNS: 2.4%, Conn: 1.3%
T-out: 3.3%, 404s: 13.2%
Robots: 3.8%, Other: 7.2%)

852,574
(36,919)

22,479,358
(830,490)

1,322,914,258
(42,605,815)

v1.7.21   Linux

mj12-kan-23-01

14/06/2021 23:59:11

5 hours 46 mins 6 secs

1,134

16

71.2%
(DNS: 4.1%, Conn: 1.8%
T-out: 3.9%, 404s: 11.2%
Robots: 2.5%, Other: 5.3%)

930,654
(36,586)

22,707,910
(855,649)

1,506,672,886
(48,805,814)

v1.7.21   Linux

mj12-kan-26-01

14/06/2021 23:59:14

5 hours 46 mins 6 secs

1,166

20

71.9%
(DNS: 3.7%, Conn: 1.3%
T-out: 3.6%, 404s: 11.6%
Robots: 1.7%, Other: 6.2%)

900,863
(39,718)

18,177,974
(736,073)

1,218,760,179
(39,969,262)

v1.7.21   Linux

mj12-kan-21-02

14/06/2021 23:59:26

5 hours 46 mins 7 secs

1,431

21

74.0%
(DNS: 3.1%, Conn: 1.1%
T-out: 3.4%, 404s: 11.5%
Robots: 2.3%, Other: 4.6%)

966,774
(39,526)

23,237,149
(862,344)

1,495,954,759
(48,247,141)

v1.7.21   Linux

mj12-kan-27-01

14/06/2021 23:59:35

5 hours 46 mins 6 secs

1,365

21

73.0%
(DNS: 1.6%, Conn: 1.4%
T-out: 3.3%, 404s: 12.0%
Robots: 2.7%, Other: 6.1%)

929,228
(37,371)

21,568,335
(816,392)

1,297,255,976
(41,787,056)

v1.7.21   Linux

mj12-kan-26-03

14/06/2021 23:59:43

5 hours 46 mins 6 secs

1,052

15

73.4%
(DNS: 1.3%, Conn: 1.7%
T-out: 2.8%, 404s: 12.7%
Robots: 2.5%, Other: 5.7%)

873,559
(35,092)

17,770,660
(727,019)

1,214,638,298
(39,896,108)

v1.7.21   Linux

mj12-kan-22-02

14/06/2021 23:59:43

5 hours 46 mins 5 secs

1,189

21

71.6%
(DNS: 6.2%, Conn: 1.0%
T-out: 2.4%, 404s: 10.5%
Robots: 2.1%, Other: 6.4%)

870,678
(36,760)

23,016,047
(843,436)

1,508,176,840
(48,753,482)

v1.7.21   Linux

mj12-kan-25-02

14/06/2021 23:59:45

5 hours 46 mins 7 secs

949

13

69.4%
(DNS: 6.5%, Conn: 1.3%
T-out: 4.0%, 404s: 11.9%
Robots: 1.8%, Other: 5.2%)

885,316
(36,713)

21,692,365
(768,762)

1,500,709,925
(48,590,665)

v1.7.21   Linux

mj12-kan-26-02

14/06/2021 23:59:49

5 hours 46 mins 5 secs

1,053

16

70.2%
(DNS: 5.4%, Conn: 2.2%
T-out: 3.8%, 404s: 12.1%
Robots: 2.2%, Other: 4.1%)

849,798
(35,931)

17,933,302
(713,787)

1,213,809,423
(39,870,462)

v1.7.21   Linux

mj12-kan-24-02

14/06/2021 23:59:55

5 hours 46 mins 4 secs

1,059

20

69.9%
(DNS: 5.6%, Conn: 1.6%
T-out: 3.2%, 404s: 11.1%
Robots: 2.3%, Other: 6.4%)

885,179
(37,467)

23,622,176
(876,224)

1,506,649,774
(48,826,698)

v1.7.21   Linux

mj12-kan-22-03

14/06/2021 23:59:55

5 hours 46 mins 7 secs

1,074

19

71.0%
(DNS: 1.4%, Conn: 1.0%
T-out: 4.5%, 404s: 12.6%
Robots: 3.2%, Other: 6.2%)

857,259
(34,441)

23,106,087
(845,903)

1,496,985,496
(48,389,740)

v1.7.21   Linux

mj12-kan-27-02

14/06/2021 23:59:56

5 hours 46 mins 7 secs

1,139

18

71.3%
(DNS: 3.2%, Conn: 1.6%
T-out: 2.7%, 404s: 11.1%
Robots: 3.5%, Other: 6.7%)

848,868
(33,856)

22,529,059
(834,374)

1,303,240,059
(41,885,456)

Total (24 nodes)

28,145

439

-

21,336,248
(873,149)

532,139,758
(19,737,440)

34,042,069,462
(1,101,735,657)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 15 Jun 2021 00:01:42:300 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12