Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | About

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://patdavies.net/

Joined:

18/10/2005 21:15:00

URLs crawled:

97,404,569,045

Data (MB)*:

2,988,672,846

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.20   Linux

mj12-kan-22-01

05/12/2019 22:46:28

4 hours 46 mins 1 sec

120

11

59.9%
(DNS: 2.9%, Conn: 1.3%
T-out: 5.9%, 404s: 17.0%
Robots: 6.3%, Other: 6.7%)

831,735
(30,250)

35,718,148
(1,328,936)

1,110,167,097
(35,307,386)

v1.7.20   Linux

mj12-kan-22-03

05/12/2019 22:46:28

4 hours 46 mins 1 sec

120

9

62.9%
(DNS: 3.7%, Conn: 1.9%
T-out: 11.1%, 404s: 14.6%
Robots: 2.5%, Other: 3.3%)

852,150
(29,590)

35,898,764
(1,337,183)

1,092,654,591
(34,765,267)

v1.7.20   Linux

mj12-kan-22-02

05/12/2019 22:46:28

4 hours 46 mins 1 sec

93

15

75.6%
(DNS: 2.4%, Conn: 0.9%
T-out: 1.5%, 404s: 5.3%
Robots: 2.4%, Other: 11.9%)

857,082
(31,563)

35,872,193
(1,329,912)

1,105,203,271
(35,204,460)

v1.7.20   Linux

mj12-kan-24-03

05/12/2019 22:46:28

4 hours 46 mins 1 sec

86

14

77.0%
(DNS: 2.5%, Conn: 0.6%
T-out: 3.7%, 404s: 5.3%
Robots: 3.7%, Other: 7.1%)

883,358
(33,296)

35,814,227
(1,320,324)

1,104,563,311
(35,213,041)

v1.7.20   Linux

mj12-kan-23-01

05/12/2019 22:46:28

4 hours 46 mins 1 sec

100

10

72.2%
(DNS: 2.3%, Conn: 2.3%
T-out: 4.2%, 404s: 10.5%
Robots: 2.8%, Other: 5.7%)

877,240
(30,891)

35,862,597
(1,336,413)

1,100,933,080
(35,047,303)

v1.7.20   Linux

mj12-kan-28-02

05/12/2019 22:46:28

4 hours 46 mins 1 sec

107

10

76.7%
(DNS: 1.9%, Conn: 1.0%
T-out: 2.3%, 404s: 8.7%
Robots: 2.9%, Other: 6.6%)

866,208
(30,416)

35,675,757
(1,329,766)

921,757,934
(29,077,382)

v1.7.20   Linux

mj12-kan-27-03

05/12/2019 22:46:28

4 hours 46 mins 1 sec

98

9

67.5%
(DNS: 7.1%, Conn: 4.0%
T-out: 3.7%, 404s: 11.3%
Robots: 0.6%, Other: 5.7%)

842,534
(31,721)

35,758,885
(1,329,122)

896,646,639
(28,172,851)

v1.7.20   Linux

mj12-kan-24-02

05/12/2019 22:46:28

4 hours 46 mins 2 secs

99

8

65.8%
(DNS: 2.9%, Conn: 1.6%
T-out: 7.1%, 404s: 10.4%
Robots: 0.5%, Other: 11.7%)

852,270
(32,279)

35,761,949
(1,348,398)

1,106,111,279
(35,241,870)

v1.7.20   Linux

mj12-kan-25-03

05/12/2019 22:46:29

4 hours 46 mins 1 sec

132

12

71.3%
(DNS: 3.0%, Conn: 0.3%
T-out: 6.3%, 404s: 11.0%
Robots: 2.3%, Other: 5.7%)

854,933
(31,113)

35,303,564
(1,305,242)

1,098,244,180
(35,052,318)

v1.7.20   Linux

mj12-kan-23-03

05/12/2019 22:46:29

4 hours 46 mins 2 secs

155

12

69.3%
(DNS: 9.0%, Conn: 1.8%
T-out: 4.3%, 404s: 7.9%
Robots: 2.4%, Other: 5.2%)

837,947
(30,513)

35,562,617
(1,332,043)

1,103,035,064
(35,082,860)

v1.7.19   Linux

mj12-sf-01-02

05/12/2019 22:46:29

4 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,451,555
(64,172)

v1.7.19   Linux

mj12-sf-01-01

05/12/2019 22:46:30

4 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,865,336
(77,144)

v1.7.19   Linux

mj12-sf-01-03

05/12/2019 22:46:30

4 hours 46 mins 1 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

714,519
(28,617)

v1.7.19   Linux

mj12-nyc-01-03

05/12/2019 22:46:31

4 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

936,660
(36,821)

v1.7.19   Linux

mj12-nyc-01-01

05/12/2019 22:46:31

4 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,740,326
(70,473)

v1.7.19   Linux

mj12-nyc-01-02

05/12/2019 22:46:31

4 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,433,338
(55,391)

v1.7.20   Linux

mj12-kan-27-02

05/12/2019 22:52:00

4 hours 46 mins 1 sec

129

12

66.8%
(DNS: 3.3%, Conn: 1.4%
T-out: 2.0%, 404s: 14.7%
Robots: 2.8%, Other: 8.9%)

857,708
(32,186)

35,980,176
(1,331,564)

900,485,856
(28,249,824)

v1.7.20   Linux

mj12-kan-26-03

05/12/2019 22:52:48

4 hours 46 mins 1 sec

64

11

67.9%
(DNS: 2.9%, Conn: 1.7%
T-out: 5.1%, 404s: 11.6%
Robots: 1.7%, Other: 9.0%)

869,804
(31,798)

35,846,175
(1,340,651)

912,533,897
(28,817,606)

v1.7.20   Linux

mj12-kan-21-01

05/12/2019 22:53:40

4 hours 46 mins 1 sec

76

10

70.6%
(DNS: 3.4%, Conn: 1.8%
T-out: 4.8%, 404s: 11.1%
Robots: 3.4%, Other: 4.8%)

816,671
(29,723)

35,977,758
(1,328,205)

1,083,898,239
(34,313,268)

v1.7.20   Linux

mj12-kan-21-03

05/12/2019 22:53:57

4 hours 46 mins 1 sec

231

11

77.3%
(DNS: 2.3%, Conn: 1.7%
T-out: 5.9%, 404s: 5.2%
Robots: 2.4%, Other: 5.2%)

842,104
(31,511)

35,716,651
(1,329,744)

1,083,553,302
(34,424,804)

v1.7.20   Linux

mj12-kan-26-02

05/12/2019 22:54:10

4 hours 46 mins 1 sec

103

12

73.8%
(DNS: 2.5%, Conn: 3.2%
T-out: 2.2%, 404s: 8.6%
Robots: 3.6%, Other: 6.2%)

858,972
(31,553)

35,907,537
(1,337,719)

911,770,538
(28,874,657)

v1.7.20   Linux

mj12-kan-21-02

05/12/2019 22:54:17

4 hours 46 mins 1 sec

127

11

78.8%
(DNS: 1.1%, Conn: 0.9%
T-out: 0.6%, 404s: 7.1%
Robots: 2.4%, Other: 9.1%)

870,050
(31,731)

35,974,383
(1,322,792)

1,093,690,963
(34,664,001)

v1.7.20   Linux

mj12-kan-25-01

05/12/2019 22:54:41

4 hours 46 mins 1 sec

74

10

63.4%
(DNS: 1.6%, Conn: 3.6%
T-out: 8.8%, 404s: 12.8%
Robots: 0.6%, Other: 9.3%)

844,199
(29,160)

35,634,575
(1,320,639)

1,099,278,888
(34,995,483)

v1.7.20   Linux

mj12-kan-23-02

05/12/2019 22:54:45

4 hours 46 mins 1 sec

144

17

69.7%
(DNS: 1.3%, Conn: 1.5%
T-out: 5.9%, 404s: 7.9%
Robots: 3.6%, Other: 10.1%)

844,497
(32,676)

35,929,465
(1,348,918)

1,106,530,705
(35,257,364)

v1.7.20   Linux

mj12-kan-28-01

05/12/2019 22:54:47

4 hours 46 mins 1 sec

122

11

65.1%
(DNS: 5.4%, Conn: 1.9%
T-out: 4.3%, 404s: 13.1%
Robots: 2.5%, Other: 7.7%)

820,147
(30,203)

35,803,090
(1,339,697)

916,286,752
(28,938,808)

v1.7.20   Linux

mj12-kan-28-03

05/12/2019 22:54:51

4 hours 46 mins 2 secs

129

13

52.3%
(DNS: 24.3%, Conn: 0.3%
T-out: 10.0%, 404s: 7.7%
Robots: 2.1%, Other: 3.4%)

867,225
(31,443)

35,722,316
(1,321,178)

921,634,053
(29,057,558)

v1.7.20   Linux

mj12-kan-26-01

05/12/2019 22:54:52

4 hours 46 mins 2 secs

164

9

73.6%
(DNS: 2.9%, Conn: 2.2%
T-out: 3.6%, 404s: 10.8%
Robots: 4.3%, Other: 2.7%)

855,532
(30,611)

36,007,006
(1,352,399)

916,756,252
(28,949,769)

v1.7.20   Linux

mj12-kan-24-01

05/12/2019 22:54:53

4 hours 46 mins 2 secs

114

11

54.4%
(DNS: 7.5%, Conn: 7.8%
T-out: 11.6%, 404s: 9.5%
Robots: 3.0%, Other: 6.1%)

832,265
(30,791)

35,834,903
(1,329,951)

1,103,078,997
(35,153,628)

v1.7.20   Linux

mj12-kan-25-02

05/12/2019 22:54:55

4 hours 46 mins 1 sec

100

13

59.4%
(DNS: 12.2%, Conn: 2.1%
T-out: 4.3%, 404s: 11.0%
Robots: 2.0%, Other: 9.0%)

877,575
(31,472)

35,913,677
(1,331,899)

1,097,638,122
(34,972,316)

v1.7.20   Linux

mj12-kan-27-01

05/12/2019 22:55:02

4 hours 46 mins 1 sec

93

8

67.4%
(DNS: 3.9%, Conn: 3.3%
T-out: 8.6%, 404s: 6.6%
Robots: 3.3%, Other: 6.9%)

857,548
(30,242)

36,082,812
(1,334,020)

898,200,131
(28,264,019)

Total (30 nodes)

2,780

269

-

20,469,754
(746,732)

859,559,225
(31,966,715)

24,692,794,875
(783,430,461)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 05 Dec 2019 22:55:46:757 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12