Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://patdavies.net/

Joined:

18/10/2005 21:15:00

URLs crawled:

96,809,614,583

Data (MB)*:

2,966,452,198

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.19   Linux

mj12-sf-01-03

14/11/2019 17:46:28

5 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

714,519
(28,617)

v1.7.19   Linux

mj12-sf-01-01

14/11/2019 17:46:28

5 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,865,336
(77,144)

v1.7.19   Linux

mj12-sf-01-02

14/11/2019 17:46:29

5 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,451,555
(64,172)

v1.7.19   Linux

mj12-nyc-01-01

14/11/2019 17:46:30

5 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,740,326
(70,473)

v1.7.20   Linux

mj12-kan-24-03

14/11/2019 17:46:30

5 hours 46 mins 5 secs

1,455

28

67.3%
(DNS: 6.3%, Conn: 2.3%
T-out: 2.4%, 404s: 14.5%
Robots: 2.3%, Other: 4.9%)

1,280,439
(44,253)

25,016,072
(906,533)

1,079,850,468
(34,292,884)

v1.7.19   Linux

mj12-nyc-01-02

14/11/2019 17:46:30

5 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,433,338
(55,391)

v1.7.19   Linux

mj12-nyc-01-03

14/11/2019 17:46:30

5 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

936,660
(36,821)

v1.7.20   Linux

mj12-kan-25-03

14/11/2019 17:46:31

5 hours 46 mins 5 secs

1,475

28

69.7%
(DNS: 7.5%, Conn: 1.7%
T-out: 3.6%, 404s: 11.4%
Robots: 2.2%, Other: 3.8%)

1,278,473
(44,387)

25,069,247
(913,167)

1,074,004,075
(34,156,170)

v1.7.20   Linux

mj12-kan-24-02

14/11/2019 17:46:31

5 hours 46 mins 6 secs

1,442

31

67.6%
(DNS: 7.8%, Conn: 2.1%
T-out: 3.0%, 404s: 10.9%
Robots: 2.9%, Other: 5.7%)

1,244,625
(45,805)

24,683,645
(906,091)

1,081,242,095
(34,299,345)

v1.7.20   Linux

mj12-kan-23-01

14/11/2019 17:46:32

5 hours 46 mins 5 secs

1,375

24

67.6%
(DNS: 6.7%, Conn: 2.3%
T-out: 2.9%, 404s: 12.3%
Robots: 2.3%, Other: 5.9%)

1,253,971
(42,087)

25,036,062
(912,878)

1,076,133,419
(34,114,935)

v1.7.20   Linux

mj12-kan-22-01

14/11/2019 17:46:33

5 hours 46 mins 7 secs

1,629

33

66.5%
(DNS: 6.4%, Conn: 3.5%
T-out: 2.6%, 404s: 11.4%
Robots: 2.5%, Other: 7.1%)

1,269,075
(44,246)

25,098,095
(929,568)

1,085,477,748
(34,389,329)

v1.7.20   Linux

mj12-kan-23-03

14/11/2019 17:46:33

5 hours 46 mins 6 secs

1,552

28

66.7%
(DNS: 6.6%, Conn: 2.2%
T-out: 3.5%, 404s: 12.4%
Robots: 3.1%, Other: 5.5%)

1,271,193
(46,478)

24,771,709
(915,450)

1,078,395,616
(34,161,326)

v1.7.20   Linux

mj12-kan-21-01

14/11/2019 17:55:31

5 hours 46 mins 6 secs

1,454

27

69.5%
(DNS: 5.2%, Conn: 1.0%
T-out: 3.2%, 404s: 12.1%
Robots: 2.6%, Other: 6.4%)

1,241,153
(42,183)

24,897,429
(910,729)

1,058,851,381
(33,390,005)

v1.7.20   Linux

mj12-kan-23-02

14/11/2019 17:55:33

5 hours 46 mins 7 secs

1,838

29

69.9%
(DNS: 4.6%, Conn: 1.4%
T-out: 1.9%, 404s: 13.3%
Robots: 3.2%, Other: 5.7%)

1,260,413
(44,715)

24,745,502
(903,853)

1,081,561,282
(34,317,078)

v1.7.20   Linux

mj12-kan-26-01

14/11/2019 17:55:34

5 hours 46 mins 6 secs

1,575

29

69.3%
(DNS: 8.1%, Conn: 1.1%
T-out: 3.0%, 404s: 10.8%
Robots: 2.8%, Other: 4.9%)

1,250,183
(43,304)

24,819,018
(912,607)

891,715,592
(28,006,145)

v1.7.20   Linux

mj12-kan-22-02

14/11/2019 17:55:39

5 hours 46 mins 5 secs

1,479

23

70.6%
(DNS: 6.9%, Conn: 1.1%
T-out: 3.0%, 404s: 10.8%
Robots: 2.1%, Other: 5.5%)

1,199,864
(42,581)

24,808,949
(897,319)

1,080,334,617
(34,268,874)

v1.7.20   Linux

mj12-kan-25-02

14/11/2019 17:55:50

5 hours 46 mins 5 secs

1,697

32

69.9%
(DNS: 6.4%, Conn: 1.0%
T-out: 2.0%, 404s: 13.5%
Robots: 2.2%, Other: 5.0%)

1,259,249
(43,366)

24,794,459
(906,555)

1,072,702,192
(34,044,644)

v1.7.20   Linux

mj12-kan-25-01

14/11/2019 17:55:51

5 hours 46 mins 4 secs

1,572

25

71.1%
(DNS: 5.6%, Conn: 1.8%
T-out: 2.4%, 404s: 10.9%
Robots: 3.6%, Other: 4.7%)

1,220,616
(41,019)

24,944,901
(917,900)

1,074,663,654
(34,085,012)

v1.7.20   Linux

mj12-kan-26-02

14/11/2019 17:55:54

5 hours 46 mins 7 secs

1,463

31

68.0%
(DNS: 7.3%, Conn: 1.6%
T-out: 3.0%, 404s: 13.3%
Robots: 2.0%, Other: 4.7%)

1,232,745
(43,246)

25,018,893
(915,428)

887,038,522
(27,944,616)

v1.7.20   Linux

mj12-kan-28-02

14/11/2019 17:55:56

5 hours 46 mins 5 secs

1,351

27

66.5%
(DNS: 6.1%, Conn: 3.4%
T-out: 4.0%, 404s: 12.4%
Robots: 2.4%, Other: 5.3%)

1,221,149
(41,120)

24,852,694
(911,763)

897,022,326
(28,150,364)

v1.7.20   Linux

mj12-kan-24-01

14/11/2019 17:55:58

5 hours 46 mins 6 secs

1,476

28

66.7%
(DNS: 7.3%, Conn: 1.9%
T-out: 3.5%, 404s: 12.2%
Robots: 2.9%, Other: 5.3%)

1,273,044
(43,978)

24,949,941
(913,460)

1,078,300,011
(34,231,401)

v1.7.20   Linux

mj12-kan-27-02

14/11/2019 17:56:08

5 hours 46 mins 6 secs

1,831

37

68.8%
(DNS: 5.1%, Conn: 3.4%
T-out: 2.2%, 404s: 12.3%
Robots: 3.0%, Other: 5.2%)

1,287,453
(45,713)

25,045,984
(906,639)

875,639,776
(27,323,967)

v1.7.20   Linux

mj12-kan-21-03

14/11/2019 17:56:20

5 hours 46 mins 6 secs

1,401

30

70.2%
(DNS: 6.2%, Conn: 1.9%
T-out: 2.6%, 404s: 10.2%
Robots: 3.3%, Other: 5.7%)

1,248,731
(44,128)

24,699,910
(906,331)

1,058,757,403
(33,495,412)

v1.7.20   Linux

mj12-kan-27-01

14/11/2019 17:56:22

5 hours 46 mins 7 secs

1,783

27

66.5%
(DNS: 7.4%, Conn: 1.7%
T-out: 3.4%, 404s: 12.8%
Robots: 2.2%, Other: 5.9%)

1,255,982
(44,879)

25,001,178
(915,563)

873,271,158
(27,339,962)

v1.7.20   Linux

mj12-kan-28-03

14/11/2019 17:56:28

5 hours 46 mins 6 secs

1,585

28

66.5%
(DNS: 8.3%, Conn: 2.2%
T-out: 3.6%, 404s: 13.6%
Robots: 1.8%, Other: 4.0%)

1,255,493
(43,535)

24,880,786
(908,445)

896,841,979
(28,134,273)

v1.7.20   Linux

mj12-kan-27-03

14/11/2019 17:56:31

5 hours 46 mins 6 secs

1,522

33

69.5%
(DNS: 6.2%, Conn: 1.4%
T-out: 2.5%, 404s: 12.2%
Robots: 3.0%, Other: 5.1%)

1,247,185
(43,565)

25,006,862
(915,738)

871,905,473
(27,245,643)

v1.7.20   Linux

mj12-kan-21-02

14/11/2019 17:56:33

5 hours 46 mins 6 secs

1,375

29

68.7%
(DNS: 7.5%, Conn: 0.8%
T-out: 2.3%, 404s: 12.0%
Robots: 2.6%, Other: 6.2%)

1,279,407
(43,565)

25,115,620
(918,310)

1,068,830,623
(33,744,791)

v1.7.20   Linux

mj12-kan-26-03

14/11/2019 17:56:33

5 hours 46 mins 7 secs

1,687

28

68.4%
(DNS: 6.5%, Conn: 1.7%
T-out: 2.9%, 404s: 11.5%
Robots: 3.7%, Other: 5.3%)

1,271,339
(44,471)

25,040,595
(918,374)

887,762,957
(27,886,926)

v1.7.20   Linux

mj12-kan-28-01

14/11/2019 17:56:34

5 hours 46 mins 5 secs

1,579

27

67.6%
(DNS: 8.2%, Conn: 2.1%
T-out: 3.3%, 404s: 11.5%
Robots: 2.1%, Other: 5.3%)

1,226,547
(45,205)

24,787,655
(911,054)

891,532,143
(28,012,288)

v1.7.20   Linux

mj12-kan-22-03

14/11/2019 17:56:35

5 hours 46 mins 8 secs

1,580

36

68.7%
(DNS: 7.3%, Conn: 1.2%
T-out: 2.4%, 404s: 13.1%
Robots: 2.7%, Other: 4.5%)

1,286,155
(46,378)

25,154,784
(924,259)

1,067,864,169
(33,841,805)

Total (30 nodes)

37,176

698

-

30,114,484
(1,054,207)

598,239,990
(21,898,014)

24,097,840,413
(761,209,813)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 14 Nov 2019 17:57:17:160 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12