Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | About

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://patdavies.net/

Joined:

18/10/2005 21:15:00

URLs crawled:

100,303,208,841

Data (MB)*:

3,094,393,268

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.19   Linux

mj12-nyc-01-01

06/04/2020 21:46:12

2 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,740,326
(70,473)

v1.7.19   Linux

mj12-sf-01-01

06/04/2020 21:46:13

2 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,865,336
(77,144)

v1.7.20   Linux

mj12-kan-24-02

06/04/2020 21:46:14

3 hours 46 mins 2 secs

592

14

71.3%
(DNS: 1.5%, Conn: 0.8%
T-out: 3.5%, 404s: 12.1%
Robots: 2.5%, Other: 8.4%)

802,814
(29,035)

31,710,455
(1,157,811)

1,226,838,158
(39,644,211)

v1.7.20   Linux

mj12-kan-26-03

06/04/2020 21:46:15

3 hours 46 mins 2 secs

718

26

72.2%
(DNS: 0.4%, Conn: 0.8%
T-out: 4.5%, 404s: 13.4%
Robots: 2.2%, Other: 6.5%)

809,855
(28,644)

31,906,163
(1,166,277)

1,033,860,820
(33,250,515)

v1.7.20   Linux

mj12-kan-23-01

06/04/2020 21:46:15

3 hours 46 mins 2 secs

665

16

75.8%
(DNS: 1.1%, Conn: 1.0%
T-out: 3.1%, 404s: 9.3%
Robots: 3.2%, Other: 6.5%)

818,184
(31,594)

32,473,590
(1,194,319)

1,222,340,989
(39,499,652)

v1.7.20   Linux

mj12-kan-23-03

06/04/2020 21:46:15

3 hours 46 mins 2 secs

481

13

75.2%
(DNS: 0.9%, Conn: 1.5%
T-out: 3.7%, 404s: 9.4%
Robots: 4.0%, Other: 5.3%)

787,698
(28,784)

32,044,641
(1,169,023)

1,223,812,063
(39,462,402)

v1.7.20   Linux

mj12-kan-25-03

06/04/2020 21:46:15

3 hours 46 mins 2 secs

1,067

25

74.3%
(DNS: 1.2%, Conn: 2.1%
T-out: 2.4%, 404s: 13.2%
Robots: 2.9%, Other: 3.9%)

799,121
(28,200)

31,303,674
(1,146,956)

1,218,146,603
(39,426,129)

v1.7.20   Linux

mj12-kan-24-03

06/04/2020 21:46:15

3 hours 46 mins 2 secs

628

17

68.0%
(DNS: 0.9%, Conn: 1.4%
T-out: 3.5%, 404s: 14.2%
Robots: 4.4%, Other: 7.6%)

793,524
(29,355)

31,981,737
(1,164,662)

1,225,547,020
(39,613,834)

v1.7.20   Linux

mj12-kan-26-02

06/04/2020 21:46:15

3 hours 46 mins 2 secs

583

15

74.4%
(DNS: 1.0%, Conn: 0.3%
T-out: 2.7%, 404s: 14.2%
Robots: 3.4%, Other: 4.0%)

821,862
(29,909)

32,014,792
(1,160,874)

1,032,905,166
(33,282,985)

v1.7.20   Linux

mj12-kan-24-01

06/04/2020 21:46:15

3 hours 46 mins 3 secs

514

18

75.5%
(DNS: 1.1%, Conn: 1.7%
T-out: 3.5%, 404s: 10.6%
Robots: 2.8%, Other: 4.8%)

811,484
(29,553)

31,784,254
(1,155,620)

1,223,527,438
(39,528,497)

v1.7.20   Linux

mj12-kan-21-02

06/04/2020 21:46:16

3 hours 46 mins 2 secs

675

27

73.0%
(DNS: 0.9%, Conn: 0.7%
T-out: 2.4%, 404s: 17.9%
Robots: 1.3%, Other: 3.9%)

797,035
(28,147)

31,990,364
(1,167,552)

1,214,731,782
(39,061,125)

v1.7.20   Linux

mj12-kan-23-02

06/04/2020 21:46:16

3 hours 46 mins 3 secs

552

19

70.9%
(DNS: 1.8%, Conn: 0.9%
T-out: 2.3%, 404s: 14.2%
Robots: 2.0%, Other: 7.9%)

766,948
(29,068)

31,966,200
(1,169,947)

1,227,012,389
(39,646,472)

v1.7.20   Linux

mj12-kan-28-01

06/04/2020 21:46:16

3 hours 46 mins 3 secs

627

18

78.8%
(DNS: 0.9%, Conn: 0.4%
T-out: 1.8%, 404s: 10.0%
Robots: 1.7%, Other: 6.5%)

823,787
(30,924)

31,808,358
(1,171,247)

1,036,680,772
(33,362,466)

v1.7.20   Linux

mj12-kan-28-03

06/04/2020 21:46:16

3 hours 46 mins 3 secs

759

19

72.7%
(DNS: 2.2%, Conn: 2.1%
T-out: 2.6%, 404s: 13.0%
Robots: 2.1%, Other: 5.2%)

855,714
(28,274)

31,746,507
(1,149,852)

1,041,709,730
(33,427,940)

v1.7.20   Linux

mj12-kan-22-02

06/04/2020 21:46:16

3 hours 46 mins 3 secs

743

20

73.5%
(DNS: 0.9%, Conn: 1.0%
T-out: 4.2%, 404s: 12.4%
Robots: 2.1%, Other: 5.9%)

795,743
(27,856)

31,963,827
(1,175,169)

1,226,196,398
(39,617,754)

v1.7.20   Linux

mj12-kan-27-03

06/04/2020 21:46:16

3 hours 46 mins 2 secs

759

18

73.1%
(DNS: 2.2%, Conn: 0.8%
T-out: 4.2%, 404s: 11.0%
Robots: 2.9%, Other: 5.8%)

790,104
(30,535)

32,008,306
(1,171,305)

1,017,642,490
(32,579,830)

v1.7.20   Linux

mj12-kan-21-03

06/04/2020 21:46:16

3 hours 46 mins 3 secs

698

20

70.6%
(DNS: 2.7%, Conn: 1.5%
T-out: 3.8%, 404s: 12.5%
Robots: 3.8%, Other: 5.0%)

800,623
(28,646)

32,057,898
(1,172,840)

1,204,633,766
(38,840,162)

v1.7.20   Linux

mj12-kan-26-01

06/04/2020 21:46:16

3 hours 46 mins 3 secs

560

13

71.8%
(DNS: 0.8%, Conn: 1.2%
T-out: 3.2%, 404s: 13.1%
Robots: 2.5%, Other: 7.3%)

867,324
(32,458)

31,969,044
(1,166,417)

1,037,945,268
(33,377,813)

v1.7.20   Linux

mj12-kan-22-03

06/04/2020 21:46:16

3 hours 46 mins 3 secs

561

25

67.5%
(DNS: 1.8%, Conn: 0.7%
T-out: 5.6%, 404s: 10.6%
Robots: 4.0%, Other: 9.8%)

826,101
(28,499)

31,966,806
(1,182,675)

1,213,532,980
(39,181,057)

v1.7.20   Linux

mj12-kan-25-02

06/04/2020 21:46:16

3 hours 46 mins 3 secs

454

16

74.7%
(DNS: 1.3%, Conn: 1.1%
T-out: 3.0%, 404s: 13.8%
Robots: 1.6%, Other: 4.5%)

803,237
(30,831)

32,118,906
(1,166,705)

1,218,297,087
(39,400,655)

v1.7.20   Linux

mj12-kan-27-02

06/04/2020 21:46:16

3 hours 46 mins 3 secs

844

32

76.3%
(DNS: 1.2%, Conn: 1.6%
T-out: 1.8%, 404s: 12.9%
Robots: 2.4%, Other: 3.8%)

810,157
(30,133)

31,926,032
(1,168,607)

1,021,159,130
(32,659,221)

v1.7.20   Linux

mj12-kan-25-01

06/04/2020 21:46:16

3 hours 46 mins 3 secs

568

18

71.8%
(DNS: 0.7%, Conn: 1.6%
T-out: 5.0%, 404s: 11.0%
Robots: 3.2%, Other: 6.7%)

855,295
(28,146)

32,098,233
(1,169,413)

1,219,907,509
(39,382,714)

v1.7.20   Linux

mj12-kan-28-02

06/04/2020 21:46:16

3 hours 46 mins 4 secs

845

15

77.0%
(DNS: 1.3%, Conn: 1.4%
T-out: 1.5%, 404s: 10.7%
Robots: 2.8%, Other: 5.3%)

831,562
(30,390)

31,919,167
(1,175,229)

1,042,259,558
(33,468,386)

v1.7.20   Linux

mj12-kan-27-01

06/04/2020 21:46:16

3 hours 46 mins 3 secs

564

16

73.3%
(DNS: 0.6%, Conn: 1.0%
T-out: 2.8%, 404s: 11.9%
Robots: 3.8%, Other: 6.5%)

827,300
(28,402)

31,872,616
(1,154,504)

1,018,686,984
(32,657,639)

v1.7.20   Linux

mj12-kan-22-01

06/04/2020 21:46:17

3 hours 46 mins 3 secs

789

20

70.6%
(DNS: 1.7%, Conn: 0.7%
T-out: 2.1%, 404s: 13.9%
Robots: 1.9%, Other: 9.1%)

843,644
(29,451)

32,194,771
(1,182,627)

1,231,843,941
(39,742,453)

v1.7.20   Linux

mj12-kan-21-01

06/04/2020 21:46:17

3 hours 46 mins 3 secs

731

33

72.7%
(DNS: 1.3%, Conn: 1.1%
T-out: 3.2%, 404s: 9.8%
Robots: 3.9%, Other: 7.9%)

828,437
(30,097)

31,723,323
(1,158,893)

1,204,074,896
(38,704,353)

Total (26 nodes)

15,977

473

-

19,567,553
(706,931)

766,549,664
(28,018,524)

27,586,898,599
(888,965,882)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 06 Apr 2020 21:53:42:873 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12