Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://patdavies.net/

Joined:

18/10/2005 21:15:00

URLs crawled:

96,251,711,702

Data (MB)*:

2,945,997,458

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.20   Linux

mj12-kan-23-01

18/10/2019 00:46:28

46 mins 0 sec

3,044

24

58.0%
(DNS: 2.4%, Conn: 1.8%
T-out: 3.2%, 404s: 24.2%
Robots: 3.4%, Other: 7.0%)

85,874
(2,004)

18,625,746
(638,422)

1,052,773,289
(33,260,542)

v1.7.20   Linux

mj12-kan-22-01

18/10/2019 00:46:29

46 mins 1 sec

2,590

27

54.7%
(DNS: 4.9%, Conn: 1.6%
T-out: 2.9%, 404s: 27.5%
Robots: 1.6%, Other: 6.9%)

91,280
(1,808)

18,529,626
(644,555)

1,062,047,571
(33,520,730)

v1.7.20   Linux

mj12-kan-24-03

18/10/2019 00:46:29

46 mins 1 sec

3,425

16

57.7%
(DNS: 2.4%, Conn: 1.7%
T-out: 2.0%, 404s: 24.7%
Robots: 2.3%, Other: 9.2%)

63,155
(1,820)

18,761,627
(647,173)

1,056,555,660
(33,446,806)

v1.7.20   Linux

mj12-kan-23-03

18/10/2019 00:46:29

46 mins 1 sec

3,268

24

57.4%
(DNS: 4.4%, Conn: 1.2%
T-out: 2.8%, 404s: 25.7%
Robots: 4.0%, Other: 4.4%)

82,984
(2,210)

18,725,104
(649,201)

1,055,290,627
(33,304,799)

v1.7.20   Linux

mj12-kan-25-03

18/10/2019 00:46:30

46 mins 2 secs

3,236

26

56.9%
(DNS: 3.6%, Conn: 0.9%
T-out: 1.9%, 404s: 28.1%
Robots: 3.3%, Other: 5.4%)

85,000
(2,303)

18,669,983
(642,072)

1,050,666,833
(33,303,661)

v1.7.19   Linux

mj12-sf-01-01

18/10/2019 00:46:30

5 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,865,336
(77,144)

v1.7.19   Linux

mj12-sf-01-02

18/10/2019 00:46:30

5 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,451,555
(64,172)

v1.7.19   Linux

mj12-sf-01-03

18/10/2019 00:46:30

5 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

714,519
(28,617)

v1.7.19   Linux

mj12-nyc-01-03

18/10/2019 00:46:31

5 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

936,660
(36,821)

v1.7.19   Linux

mj12-nyc-01-02

18/10/2019 00:46:31

5 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,433,338
(55,391)

v1.7.19   Linux

mj12-nyc-01-01

18/10/2019 00:46:31

5 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,740,326
(70,473)

v1.7.20   Linux

mj12-kan-28-01

18/10/2019 00:57:42

46 mins 1 sec

2,570

28

62.2%
(DNS: 3.4%, Conn: 1.0%
T-out: 3.3%, 404s: 21.9%
Robots: 3.6%, Other: 4.7%)

79,725
(2,002)

18,351,891
(634,057)

868,345,842
(27,159,093)

v1.7.20   Linux

mj12-kan-23-02

18/10/2019 00:57:48

46 mins 1 sec

3,380

19

54.5%
(DNS: 4.7%, Conn: 1.4%
T-out: 2.9%, 404s: 26.7%
Robots: 3.1%, Other: 6.6%)

89,631
(2,201)

18,594,837
(644,160)

1,058,496,517
(33,471,667)

v1.7.20   Linux

mj12-kan-25-02

18/10/2019 00:58:20

46 mins 1 sec

3,891

18

58.9%
(DNS: 1.7%, Conn: 1.2%
T-out: 2.0%, 404s: 27.2%
Robots: 2.6%, Other: 6.5%)

81,533
(1,957)

18,637,689
(635,979)

1,049,649,119
(33,199,640)

v1.7.20   Linux

mj12-kan-26-01

18/10/2019 00:58:21

46 mins 0 sec

2,726

22

57.1%
(DNS: 5.0%, Conn: 1.7%
T-out: 1.5%, 404s: 24.5%
Robots: 2.6%, Other: 7.6%)

87,340
(1,816)

18,631,351
(634,798)

868,602,423
(27,152,914)

v1.7.20   Linux

mj12-kan-21-02

18/10/2019 00:58:21

46 mins 2 secs

5,062

16

60.4%
(DNS: 4.7%, Conn: 1.1%
T-out: 2.6%, 404s: 21.9%
Robots: 3.1%, Other: 6.1%)

72,809
(2,146)

18,856,143
(654,808)

1,045,408,460
(32,888,244)

v1.7.20   Linux

mj12-kan-27-01

18/10/2019 00:58:22

46 mins 2 secs

2,987

17

57.5%
(DNS: 1.7%, Conn: 1.2%
T-out: 1.5%, 404s: 28.6%
Robots: 2.4%, Other: 7.1%)

81,372
(2,195)

18,833,590
(652,188)

849,941,858
(26,484,773)

v1.7.20   Linux

mj12-kan-24-01

18/10/2019 00:58:28

46 mins 1 sec

2,695

17

55.3%
(DNS: 5.0%, Conn: 1.3%
T-out: 2.9%, 404s: 26.8%
Robots: 1.8%, Other: 6.9%)

80,909
(1,572)

18,588,408
(641,419)

1,055,044,564
(33,380,582)

v1.7.20   Linux

mj12-kan-21-03

18/10/2019 00:58:28

46 mins 1 sec

2,704

29

57.0%
(DNS: 5.9%, Conn: 2.0%
T-out: 2.7%, 404s: 22.3%
Robots: 2.3%, Other: 7.8%)

81,396
(2,195)

18,605,991
(640,564)

1,035,723,199
(32,649,980)

v1.7.20   Linux

mj12-kan-28-03

18/10/2019 00:58:30

46 mins 1 sec

4,479

12

64.3%
(DNS: 2.6%, Conn: 1.2%
T-out: 2.2%, 404s: 20.9%
Robots: 2.0%, Other: 6.8%)

57,858
(2,133)

18,496,819
(629,082)

873,596,239
(27,286,502)

v1.7.20   Linux

mj12-kan-26-02

18/10/2019 00:58:31

46 mins 2 secs

3,255

21

56.3%
(DNS: 3.9%, Conn: 2.1%
T-out: 4.6%, 404s: 24.7%
Robots: 3.3%, Other: 5.1%)

81,672
(2,266)

18,657,328
(646,758)

863,714,338
(27,089,616)

v1.7.20   Linux

mj12-kan-27-02

18/10/2019 00:58:31

46 mins 2 secs

2,629

21

59.3%
(DNS: 2.8%, Conn: 1.2%
T-out: 1.9%, 404s: 24.7%
Robots: 3.2%, Other: 7.0%)

81,875
(2,002)

18,722,374
(648,836)

852,294,299
(26,479,493)

v1.7.20   Linux

mj12-kan-22-02

18/10/2019 00:58:32

46 mins 1 sec

3,203

22

54.0%
(DNS: 7.9%, Conn: 1.0%
T-out: 2.8%, 404s: 22.6%
Robots: 4.1%, Other: 7.6%)

84,891
(2,139)

18,745,576
(648,123)

1,057,179,728
(33,429,953)

v1.7.20   Linux

mj12-kan-28-02

18/10/2019 00:58:34

46 mins 2 secs

3,607

21

59.8%
(DNS: 2.0%, Conn: 0.9%
T-out: 3.4%, 404s: 24.9%
Robots: 2.2%, Other: 6.7%)

79,351
(1,841)

18,754,742
(641,341)

873,882,140
(27,299,906)

v1.7.20   Linux

mj12-kan-27-03

18/10/2019 00:58:35

46 mins 1 sec

3,273

16

55.8%
(DNS: 5.2%, Conn: 0.9%
T-out: 3.0%, 404s: 24.6%
Robots: 2.4%, Other: 8.2%)

70,097
(2,029)

18,863,923
(653,401)

848,572,702
(26,388,586)

v1.7.20   Linux

mj12-kan-26-03

18/10/2019 00:58:35

46 mins 2 secs

2,882

22

52.0%
(DNS: 6.4%, Conn: 1.0%
T-out: 2.8%, 404s: 25.9%
Robots: 3.2%, Other: 8.8%)

85,709
(2,299)

18,765,079
(644,254)

864,444,548
(27,029,614)

v1.7.20   Linux

mj12-kan-22-03

18/10/2019 00:58:36

46 mins 1 sec

3,069

21

59.5%
(DNS: 2.5%, Conn: 1.0%
T-out: 3.0%, 404s: 25.2%
Robots: 2.8%, Other: 6.1%)

78,802
(1,843)

18,534,178
(645,711)

1,044,368,677
(32,978,192)

v1.7.20   Linux

mj12-kan-21-01

18/10/2019 00:58:36

46 mins 1 sec

2,917

15

57.0%
(DNS: 3.0%, Conn: 4.5%
T-out: 2.7%, 404s: 24.5%
Robots: 2.1%, Other: 6.3%)

73,859
(2,099)

18,500,652
(642,007)

1,035,614,737
(32,537,494)

v1.7.20   Linux

mj12-kan-25-01

18/10/2019 00:58:37

46 mins 2 secs

3,643

20

60.2%
(DNS: 3.5%, Conn: 1.4%
T-out: 2.2%, 404s: 23.6%
Robots: 3.6%, Other: 5.6%)

76,296
(2,521)

18,652,069
(642,930)

1,051,391,042
(33,225,642)

v1.7.20   Linux

mj12-kan-24-02

18/10/2019 00:58:37

46 mins 2 secs

3,765

21

58.3%
(DNS: 4.2%, Conn: 1.5%
T-out: 3.2%, 404s: 23.0%
Robots: 3.8%, Other: 5.9%)

59,614
(1,973)

18,614,762
(643,918)

1,058,191,386
(33,454,026)

Total (30 nodes)

78,300

495

-

1,893,032
(49,374)

447,719,488
(15,445,757)

23,539,937,532
(740,755,073)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 18 Oct 2019 00:59:17:640 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12