Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://patdavies.net/

Joined:

18/10/2005 21:15:00

URLs crawled:

95,319,764,035

Data (MB)*:

2,912,325,566

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.19   Linux

mj12-sf-01-02

23/08/2019 01:01:30

1 min 0 sec

215

42

85.8%
(DNS: 0.0%, Conn: 0.9%
T-out: 0.9%, 404s: 6.6%
Robots: 0.0%, Other: 5.7%)

68,217
(2,742)

1,188,375
(53,176)

1,188,375
(53,176)

v1.7.19   Linux

mj12-sf-01-03

23/08/2019 01:01:30

1 min 0 sec

2,789

n/a

89.4%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.0%, 404s: 6.4%
Robots: 0.0%, Other: 4.2%)

0
(0)

681,928
(27,223)

681,928
(27,223)

v1.7.19   Linux

mj12-sf-01-01

23/08/2019 01:01:30

1 min 0 sec

1,138

65

73.6%
(DNS: 0.0%, Conn: 1.6%
T-out: 0.0%, 404s: 18.7%
Robots: 2.6%, Other: 3.5%)

4,693
(182)

931,394
(42,021)

931,394
(42,021)

v1.7.19   Linux

mj12-kan-22-01

23/08/2019 01:46:29

1 hour 46 mins 2 secs

2,165

39

73.3%
(DNS: 1.5%, Conn: 0.8%
T-out: 2.8%, 404s: 11.4%
Robots: 4.1%, Other: 6.2%)

127,166
(4,642)

31,548,462
(1,033,687)

1,023,266,057
(32,118,319)

v1.7.19   Linux

mj12-kan-28-01

23/08/2019 01:46:29

1 hour 46 mins 1 sec

2,524

43

68.8%
(DNS: 1.9%, Conn: 1.4%
T-out: 3.6%, 404s: 16.6%
Robots: 3.7%, Other: 4.0%)

143,520
(5,585)

31,096,911
(1,006,682)

829,819,174
(25,765,812)

v1.7.19   Linux

mj12-kan-26-03

23/08/2019 01:46:29

1 hour 46 mins 2 secs

2,425

47

71.0%
(DNS: 3.1%, Conn: 1.1%
T-out: 4.1%, 404s: 13.0%
Robots: 2.9%, Other: 4.7%)

128,818
(5,066)

30,895,745
(997,731)

825,316,117
(25,612,574)

v1.7.19   Linux

mj12-kan-25-02

23/08/2019 01:46:29

1 hour 46 mins 2 secs

2,269

35

69.5%
(DNS: 2.9%, Conn: 1.1%
T-out: 4.1%, 404s: 14.6%
Robots: 2.5%, Other: 5.3%)

140,375
(4,820)

29,998,040
(971,886)

1,011,024,046
(31,803,252)

v1.7.19   Linux

mj12-kan-25-03

23/08/2019 01:46:29

1 hour 46 mins 2 secs

2,212

36

73.1%
(DNS: 2.0%, Conn: 1.3%
T-out: 3.9%, 404s: 12.3%
Robots: 2.7%, Other: 4.6%)

129,947
(4,642)

30,824,806
(999,697)

1,011,929,883
(31,907,566)

v1.7.19   Linux

mj12-kan-24-02

23/08/2019 01:46:30

1 hour 46 mins 2 secs

2,467

27

70.4%
(DNS: 2.5%, Conn: 1.2%
T-out: 4.7%, 404s: 14.2%
Robots: 3.0%, Other: 4.0%)

102,202
(4,053)

30,701,783
(1,005,801)

1,019,513,534
(32,046,827)

v1.7.19   Linux

mj12-kan-22-02

23/08/2019 01:46:30

1 hour 46 mins 3 secs

2,029

47

72.0%
(DNS: 2.8%, Conn: 0.7%
T-out: 3.4%, 404s: 12.9%
Robots: 2.3%, Other: 6.0%)

140,721
(5,606)

30,952,228
(1,010,397)

1,018,119,943
(32,016,013)

v1.7.19   Linux

mj12-kan-22-03

23/08/2019 01:46:30

1 hour 46 mins 3 secs

2,188

39

71.1%
(DNS: 3.8%, Conn: 0.9%
T-out: 3.9%, 404s: 13.4%
Robots: 2.6%, Other: 4.4%)

158,158
(5,461)

30,930,802
(1,001,001)

1,005,605,745
(31,570,392)

v1.7.19   Linux

mj12-kan-23-01

23/08/2019 01:46:30

1 hour 46 mins 2 secs

2,051

38

72.2%
(DNS: 1.7%, Conn: 1.3%
T-out: 4.3%, 404s: 12.1%
Robots: 3.6%, Other: 4.7%)

121,384
(4,934)

29,888,040
(969,164)

1,014,020,750
(31,864,299)

v1.7.19   Linux

mj12-kan-27-03

23/08/2019 01:46:30

1 hour 46 mins 3 secs

1,824

43

66.4%
(DNS: 2.2%, Conn: 1.7%
T-out: 4.8%, 404s: 14.6%
Robots: 3.8%, Other: 6.6%)

146,320
(4,616)

29,596,092
(969,128)

809,771,258
(24,990,315)

v1.7.19   Linux

mj12-kan-24-01

23/08/2019 01:46:30

1 hour 46 mins 3 secs

2,064

48

69.6%
(DNS: 2.8%, Conn: 0.7%
T-out: 2.9%, 404s: 15.1%
Robots: 3.4%, Other: 5.5%)

130,508
(4,590)

31,319,557
(1,025,172)

1,016,542,859
(31,992,576)

v1.7.19   Linux

mj12-kan-27-01

23/08/2019 01:46:30

1 hour 46 mins 3 secs

2,372

59

70.1%
(DNS: 1.0%, Conn: 1.1%
T-out: 2.8%, 404s: 15.4%
Robots: 3.0%, Other: 6.7%)

151,983
(6,132)

30,700,445
(1,004,429)

811,299,448
(25,079,555)

v1.7.19   Linux

mj12-kan-26-02

23/08/2019 01:46:30

1 hour 46 mins 3 secs

1,915

38

68.7%
(DNS: 2.7%, Conn: 1.4%
T-out: 5.7%, 404s: 14.0%
Robots: 3.5%, Other: 4.0%)

135,810
(5,002)

31,341,721
(1,017,615)

824,794,428
(25,696,134)

v1.7.19   Linux

mj12-kan-24-03

23/08/2019 01:46:30

1 hour 46 mins 3 secs

2,799

46

70.8%
(DNS: 2.2%, Conn: 0.6%
T-out: 6.9%, 404s: 10.0%
Robots: 3.3%, Other: 6.2%)

144,194
(5,367)

30,130,068
(994,688)

1,017,795,405
(32,043,800)

v1.7.19   Linux

mj12-kan-27-02

23/08/2019 01:46:30

1 hour 46 mins 3 secs

2,734

33

67.1%
(DNS: 2.9%, Conn: 1.3%
T-out: 5.4%, 404s: 15.1%
Robots: 3.4%, Other: 4.8%)

133,524
(4,826)

30,671,610
(994,602)

813,447,256
(25,075,131)

v1.7.19   Linux

mj12-kan-26-01

23/08/2019 01:46:31

1 hour 46 mins 3 secs

2,708

43

68.4%
(DNS: 3.4%, Conn: 1.0%
T-out: 5.3%, 404s: 14.4%
Robots: 3.2%, Other: 4.2%)

138,194
(5,387)

31,332,298
(1,020,152)

829,519,983
(25,749,585)

v1.7.19   Linux

mj12-kan-23-02

23/08/2019 01:46:31

1 hour 46 mins 3 secs

2,274

45

69.0%
(DNS: 2.3%, Conn: 1.3%
T-out: 3.0%, 404s: 16.4%
Robots: 2.6%, Other: 5.4%)

122,788
(4,410)

31,552,464
(1,024,302)

1,020,202,578
(32,083,219)

v1.7.19   Linux

mj12-kan-25-01

23/08/2019 01:46:31

1 hour 46 mins 4 secs

2,494

44

69.0%
(DNS: 1.5%, Conn: 1.8%
T-out: 4.6%, 404s: 14.7%
Robots: 2.8%, Other: 5.7%)

154,561
(5,747)

31,402,576
(1,020,443)

1,012,773,358
(31,833,681)

v1.7.19   Linux

mj12-kan-21-03

23/08/2019 01:46:31

1 hour 46 mins 2 secs

2,055

40

69.3%
(DNS: 1.6%, Conn: 1.3%
T-out: 3.2%, 404s: 14.8%
Robots: 3.6%, Other: 6.2%)

135,703
(4,632)

30,730,985
(1,003,027)

997,101,533
(31,255,203)

v1.7.19   Linux

mj12-kan-28-02

23/08/2019 01:46:31

1 hour 46 mins 4 secs

2,087

40

63.9%
(DNS: 2.5%, Conn: 1.2%
T-out: 4.4%, 404s: 16.9%
Robots: 4.8%, Other: 6.3%)

136,141
(4,738)

31,644,442
(1,020,979)

835,268,284
(25,911,333)

v1.7.19   Linux

mj12-kan-23-03

23/08/2019 01:46:31

1 hour 46 mins 3 secs

2,397

58

70.6%
(DNS: 2.5%, Conn: 1.1%
T-out: 4.0%, 404s: 11.6%
Robots: 4.4%, Other: 5.8%)

144,219
(6,412)

30,975,012
(1,004,791)

1,016,413,430
(31,898,629)

v1.7.19   Linux

mj12-kan-21-01

23/08/2019 01:46:31

1 hour 46 mins 2 secs

2,304

41

69.4%
(DNS: 1.8%, Conn: 1.5%
T-out: 3.0%, 404s: 14.1%
Robots: 3.8%, Other: 6.4%)

142,377
(5,500)

31,540,173
(1,034,188)

997,125,154
(31,149,065)

v1.7.19   Linux

mj12-nyc-01-01

23/08/2019 01:46:31

46 mins 0 sec

2,301

34

87.8%
(DNS: 0.0%, Conn: 0.2%
T-out: 0.5%, 404s: 6.2%
Robots: 2.6%, Other: 2.7%)

29,575
(1,560)

1,105,277
(45,895)

1,105,277
(45,895)

v1.7.19   Linux

mj12-kan-28-03

23/08/2019 01:46:31

1 hour 46 mins 4 secs

2,577

44

70.1%
(DNS: 2.7%, Conn: 1.6%
T-out: 2.1%, 404s: 14.8%
Robots: 3.2%, Other: 5.6%)

139,547
(5,451)

30,336,505
(980,186)

835,042,937
(25,900,955)

v1.7.19   Linux

mj12-nyc-01-03

23/08/2019 01:46:32

46 mins 1 sec

773

76

80.9%
(DNS: 0.1%, Conn: 0.1%
T-out: 5.3%, 404s: 9.3%
Robots: 0.8%, Other: 3.4%)

109,234
(4,929)

609,188
(24,925)

609,188
(24,925)

v1.7.19   Linux

mj12-nyc-01-02

23/08/2019 01:46:32

46 mins 1 sec

541

55

77.9%
(DNS: 1.9%, Conn: 0.2%
T-out: 2.8%, 404s: 7.7%
Robots: 5.3%, Other: 4.2%)

82,754
(3,785)

1,066,471
(41,047)

1,066,471
(41,047)

v1.7.19   Linux

mj12-kan-21-02

23/08/2019 01:46:33

1 hour 46 mins 4 secs

2,038

59

71.4%
(DNS: 2.4%, Conn: 1.8%
T-out: 5.1%, 404s: 11.0%
Robots: 2.7%, Other: 5.6%)

133,744
(4,913)

31,363,045
(1,025,920)

1,006,694,072
(31,484,659)

Total (30 nodes)

62,729

1,304

-

3,576,377
(135,730)

747,056,443
(24,369,955)

22,607,989,865
(707,083,181)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 23 Aug 2019 02:00:38:613 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12