Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | About

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://patdavies.net/

Joined:

18/10/2005 21:15:00

URLs crawled:

102,121,870,808

Data (MB)*:

3,159,198,364

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.20   Linux

mj12-kan-24-03

04/07/2020 11:46:28

5 hours 46 mins 7 secs

1,647

38

63.9%
(DNS: 2.4%, Conn: 2.0%
T-out: 3.6%, 404s: 15.5%
Robots: 3.4%, Other: 9.3%)

597,143
(20,969)

27,341,221
(925,778)

1,300,849,700
(42,271,630)

v1.7.20   Linux

mj12-kan-27-03

04/07/2020 11:46:29

5 hours 46 mins 8 secs

1,673

43

65.7%
(DNS: 4.0%, Conn: 2.5%
T-out: 3.5%, 404s: 13.6%
Robots: 3.4%, Other: 7.4%)

646,039
(22,868)

27,103,491
(929,228)

1,092,928,420
(35,271,528)

v1.7.20   Linux

mj12-kan-24-01

04/07/2020 11:46:29

5 hours 46 mins 8 secs

1,809

40

66.5%
(DNS: 2.6%, Conn: 2.2%
T-out: 2.3%, 404s: 14.5%
Robots: 2.9%, Other: 8.9%)

617,486
(21,369)

27,647,920
(938,999)

1,299,659,513
(42,242,145)

v1.7.20   Linux

mj12-kan-28-03

04/07/2020 11:46:29

5 hours 46 mins 8 secs

1,939

40

65.8%
(DNS: 4.4%, Conn: 2.4%
T-out: 2.7%, 404s: 14.7%
Robots: 2.2%, Other: 7.8%)

674,384
(22,476)

27,414,661
(935,528)

1,117,707,142
(36,120,429)

v1.7.20   Linux

mj12-kan-27-01

04/07/2020 11:46:30

5 hours 46 mins 9 secs

1,727

40

63.8%
(DNS: 3.2%, Conn: 2.4%
T-out: 2.5%, 404s: 15.9%
Robots: 2.9%, Other: 9.2%)

644,824
(20,481)

26,663,686
(915,822)

1,093,624,959
(35,337,033)

v1.7.20   Linux

mj12-kan-23-03

04/07/2020 11:46:30

5 hours 46 mins 9 secs

1,636

40

65.4%
(DNS: 2.3%, Conn: 1.7%
T-out: 2.6%, 404s: 14.3%
Robots: 3.5%, Other: 10.1%)

619,635
(21,223)

27,606,099
(939,059)

1,299,866,969
(42,163,167)

v1.7.20   Linux

mj12-kan-28-01

04/07/2020 11:46:30

5 hours 46 mins 8 secs

1,779

38

64.0%
(DNS: 3.1%, Conn: 2.3%
T-out: 3.5%, 404s: 15.2%
Robots: 3.2%, Other: 8.7%)

619,978
(21,132)

27,354,955
(928,997)

1,112,855,349
(36,065,210)

v1.7.20   Linux

mj12-kan-26-03

04/07/2020 11:46:30

5 hours 46 mins 9 secs

1,777

41

64.4%
(DNS: 2.8%, Conn: 2.0%
T-out: 4.1%, 404s: 15.6%
Robots: 2.9%, Other: 8.1%)

605,201
(20,563)

27,584,876
(945,147)

1,109,330,950
(35,951,980)

v1.7.20   Linux

mj12-kan-22-02

04/07/2020 11:46:31

5 hours 46 mins 9 secs

1,725

40

64.4%
(DNS: 2.7%, Conn: 2.1%
T-out: 3.3%, 404s: 16.3%
Robots: 2.6%, Other: 8.6%)

646,933
(21,013)

27,350,190
(943,515)

1,301,971,764
(42,329,081)

v1.7.20   Linux

mj12-kan-22-03

04/07/2020 11:46:31

5 hours 46 mins 10 secs

1,687

54

63.7%
(DNS: 3.4%, Conn: 2.4%
T-out: 3.7%, 404s: 14.8%
Robots: 3.1%, Other: 8.9%)

596,201
(20,039)

27,528,871
(947,426)

1,289,624,009
(41,909,000)

v1.7.20   Linux

mj12-kan-23-01

04/07/2020 11:46:32

5 hours 46 mins 11 secs

1,705

59

64.4%
(DNS: 2.0%, Conn: 1.7%
T-out: 2.3%, 404s: 16.8%
Robots: 3.8%, Other: 9.0%)

606,861
(20,682)

27,352,679
(945,519)

1,298,127,473
(42,216,525)

v1.7.20   Linux

mj12-kan-22-01

04/07/2020 11:46:32

5 hours 46 mins 11 secs

1,667

37

63.2%
(DNS: 2.5%, Conn: 2.7%
T-out: 2.8%, 404s: 16.8%
Robots: 3.3%, Other: 8.7%)

613,141
(19,940)

26,903,309
(925,899)

1,307,333,805
(42,448,914)

v1.7.20   Linux

mj12-kan-26-01

04/07/2020 11:46:33

5 hours 46 mins 11 secs

1,779

39

64.5%
(DNS: 3.0%, Conn: 2.2%
T-out: 3.8%, 404s: 14.2%
Robots: 3.3%, Other: 9.1%)

650,095
(22,749)

26,963,915
(925,434)

1,113,284,140
(36,046,994)

v1.7.20   Linux

mj12-kan-24-02

04/07/2020 11:57:34

5 hours 46 mins 9 secs

1,853

38

63.4%
(DNS: 3.3%, Conn: 1.9%
T-out: 3.0%, 404s: 15.0%
Robots: 2.7%, Other: 10.8%)

618,890
(20,312)

27,351,388
(930,715)

1,302,840,262
(42,347,557)

v1.7.20   Linux

mj12-kan-27-02

04/07/2020 11:57:43

5 hours 46 mins 10 secs

1,807

37

63.6%
(DNS: 2.6%, Conn: 1.8%
T-out: 4.1%, 404s: 14.7%
Robots: 3.5%, Other: 9.6%)

589,656
(20,597)

27,789,741
(960,094)

1,097,446,902
(35,389,588)

v1.7.20   Linux

mj12-kan-21-03

04/07/2020 11:57:51

5 hours 46 mins 9 secs

1,717

39

64.4%
(DNS: 3.4%, Conn: 1.9%
T-out: 2.8%, 404s: 14.8%
Robots: 2.7%, Other: 10.0%)

614,148
(20,263)

27,224,258
(936,565)

1,280,328,947
(41,540,259)

v1.7.20   Linux

mj12-kan-21-01

04/07/2020 11:58:17

5 hours 46 mins 7 secs

1,623

40

63.3%
(DNS: 2.5%, Conn: 2.6%
T-out: 3.5%, 404s: 15.0%
Robots: 3.1%, Other: 10.1%)

621,169
(20,294)

27,706,420
(953,966)

1,280,950,589
(41,443,600)

v1.7.20   Linux

mj12-kan-26-02

04/07/2020 11:58:26

5 hours 46 mins 9 secs

1,598

35

67.9%
(DNS: 2.8%, Conn: 1.7%
T-out: 3.3%, 404s: 14.1%
Robots: 2.8%, Other: 7.3%)

581,361
(19,383)

27,361,412
(945,245)

1,108,582,241
(35,983,978)

v1.7.20   Linux

mj12-kan-25-01

04/07/2020 11:58:26

5 hours 31 mins 8 secs

1,709

41

63.6%
(DNS: 3.8%, Conn: 2.2%
T-out: 3.1%, 404s: 16.5%
Robots: 1.8%, Other: 9.0%)

609,774
(19,305)

27,347,246
(939,058)

1,295,542,300
(42,084,909)

v1.7.20   Linux

mj12-kan-25-02

04/07/2020 11:58:27

5 hours 46 mins 8 secs

1,805

39

63.9%
(DNS: 3.9%, Conn: 1.7%
T-out: 2.9%, 404s: 15.6%
Robots: 3.0%, Other: 9.0%)

594,753
(20,939)

27,313,860
(937,263)

1,293,946,127
(42,100,064)

v1.7.20   Linux

mj12-kan-23-02

04/07/2020 11:58:28

5 hours 46 mins 9 secs

1,664

40

67.2%
(DNS: 2.8%, Conn: 1.6%
T-out: 2.9%, 404s: 14.3%
Robots: 3.0%, Other: 8.1%)

596,656
(20,749)

27,530,460
(941,873)

1,302,900,278
(42,342,775)

v1.7.20   Linux

mj12-kan-21-02

04/07/2020 11:58:33

5 hours 46 mins 10 secs

1,705

47

64.1%
(DNS: 4.0%, Conn: 2.9%
T-out: 2.4%, 404s: 16.1%
Robots: 1.9%, Other: 8.5%)

623,033
(21,848)

27,596,158
(945,030)

1,291,199,507
(41,766,670)

v1.7.20   Linux

mj12-kan-25-03

04/07/2020 11:58:34

5 hours 46 mins 9 secs

1,580

42

63.4%
(DNS: 4.0%, Conn: 2.2%
T-out: 3.1%, 404s: 16.2%
Robots: 2.3%, Other: 8.8%)

626,826
(20,740)

27,317,145
(927,043)

1,293,509,251
(42,101,271)

v1.7.20   Linux

mj12-kan-28-02

04/07/2020 11:58:35

5 hours 46 mins 8 secs

1,812

51

64.0%
(DNS: 3.7%, Conn: 1.9%
T-out: 2.9%, 404s: 16.0%
Robots: 3.3%, Other: 8.3%)

566,044
(20,106)

26,957,390
(926,727)

1,117,544,307
(36,149,054)

Total (24 nodes)

41,423

998

-

14,780,231
(500,040)

656,311,351
(22,489,930)

29,401,954,904
(953,623,361)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 04 Jul 2020 12:00:01:043 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12