Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | About

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://patdavies.net/

Joined:

18/10/2005 21:15:00

URLs crawled:

98,432,743,999

Data (MB)*:

3,026,395,684

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.20   Linux

mj12-kan-24-01

19/01/2020 14:46:13

2 hours 46 mins 1 sec

671

32

77.1%
(DNS: 2.8%, Conn: 0.1%
T-out: 1.3%, 404s: 11.9%
Robots: 1.8%, Other: 5.0%)

591,138
(21,091)

27,277,825
(987,104)

1,145,947,448
(36,722,859)

v1.7.20   Linux

mj12-kan-26-02

19/01/2020 14:46:13

2 hours 46 mins 1 sec

585

11

78.5%
(DNS: 3.6%, Conn: 0.4%
T-out: 1.2%, 404s: 10.5%
Robots: 0.9%, Other: 4.8%)

639,447
(22,957)

27,327,276
(996,738)

954,858,289
(30,456,172)

v1.7.20   Linux

mj12-kan-22-03

19/01/2020 14:46:13

2 hours 46 mins 1 sec

610

12

81.5%
(DNS: 0.6%, Conn: 1.1%
T-out: 1.0%, 404s: 7.3%
Robots: 1.9%, Other: 6.6%)

634,783
(23,693)

27,187,573
(978,009)

1,135,457,579
(36,328,753)

v1.7.19   Linux

mj12-sf-01-01

19/01/2020 14:46:14

2 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,865,336
(77,144)

v1.7.19   Linux

mj12-sf-01-02

19/01/2020 14:46:14

2 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,451,555
(64,172)

v1.7.19   Linux

mj12-sf-01-03

19/01/2020 14:46:14

2 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

714,519
(28,617)

v1.7.19   Linux

mj12-nyc-01-03

19/01/2020 14:46:15

2 hours 46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

936,660
(36,821)

v1.7.19   Linux

mj12-nyc-01-02

19/01/2020 14:46:15

2 hours 46 mins 1 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,433,338
(55,391)

v1.7.19   Linux

mj12-nyc-01-01

19/01/2020 14:46:15

2 hours 46 mins 1 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,740,326
(70,473)

v1.7.20   Linux

mj12-kan-22-01

19/01/2020 14:57:41

2 hours 46 mins 1 sec

927

16

79.9%
(DNS: 1.8%, Conn: 0.9%
T-out: 1.6%, 404s: 5.8%
Robots: 2.9%, Other: 7.0%)

627,840
(22,891)

27,344,294
(997,005)

1,153,320,795
(36,892,032)

v1.7.20   Linux

mj12-kan-27-02

19/01/2020 14:57:57

2 hours 46 mins 1 sec

340

11

67.9%
(DNS: 9.3%, Conn: 2.1%
T-out: 0.3%, 404s: 8.6%
Robots: 2.5%, Other: 9.4%)

554,640
(21,178)

26,969,235
(986,248)

943,191,487
(29,822,343)

v1.7.20   Linux

mj12-kan-23-02

19/01/2020 14:57:58

2 hours 46 mins 1 sec

544

10

83.7%
(DNS: 1.0%, Conn: 0.4%
T-out: 2.8%, 404s: 6.7%
Robots: 1.6%, Other: 3.8%)

615,828
(22,942)

27,061,908
(973,767)

1,149,209,511
(36,814,440)

v1.7.20   Linux

mj12-kan-23-01

19/01/2020 14:58:09

2 hours 46 mins 1 sec

659

12

83.9%
(DNS: 1.7%, Conn: 0.4%
T-out: 0.4%, 404s: 7.6%
Robots: 2.3%, Other: 3.6%)

618,357
(24,105)

26,920,606
(983,071)

1,143,638,099
(36,613,523)

v1.7.20   Linux

mj12-kan-25-02

19/01/2020 14:58:10

2 hours 46 mins 1 sec

512

13

73.3%
(DNS: 2.5%, Conn: 1.4%
T-out: 3.2%, 404s: 12.5%
Robots: 1.6%, Other: 5.4%)

623,851
(22,001)

27,155,406
(988,882)

1,140,355,358
(36,553,598)

v1.7.20   Linux

mj12-kan-24-02

19/01/2020 14:58:13

2 hours 46 mins 1 sec

207

6

76.5%
(DNS: 2.9%, Conn: 0.4%
T-out: 3.2%, 404s: 9.0%
Robots: 2.4%, Other: 5.5%)

612,479
(21,519)

27,172,617
(985,158)

1,148,838,069
(36,803,405)

v1.7.20   Linux

mj12-kan-25-01

19/01/2020 14:58:14

2 hours 46 mins 1 sec

474

9

76.8%
(DNS: 1.1%, Conn: 1.6%
T-out: 1.2%, 404s: 11.8%
Robots: 2.3%, Other: 5.2%)

572,518
(19,721)

27,094,505
(984,178)

1,142,036,923
(36,565,774)

v1.7.20   Linux

mj12-kan-22-02

19/01/2020 14:58:15

2 hours 46 mins 2 secs

362

11

74.0%
(DNS: 2.0%, Conn: 1.1%
T-out: 1.6%, 404s: 11.1%
Robots: 4.6%, Other: 5.7%)

602,273
(22,973)

27,325,525
(986,973)

1,148,087,604
(36,769,677)

v1.7.20   Linux

mj12-kan-27-03

19/01/2020 14:58:18

2 hours 46 mins 1 sec

696

10

72.3%
(DNS: 3.3%, Conn: 0.3%
T-out: 2.1%, 404s: 13.4%
Robots: 2.9%, Other: 5.7%)

601,526
(22,417)

27,214,487
(981,367)

939,552,491
(29,734,686)

v1.7.20   Linux

mj12-kan-28-01

19/01/2020 14:58:21

2 hours 46 mins 1 sec

647

9

79.2%
(DNS: 1.0%, Conn: 0.3%
T-out: 1.9%, 404s: 9.3%
Robots: 2.3%, Other: 6.1%)

627,651
(21,781)

27,206,786
(994,573)

959,057,541
(30,527,012)

v1.7.20   Linux

mj12-kan-21-01

19/01/2020 14:58:22

2 hours 46 mins 1 sec

427

7

78.0%
(DNS: 4.2%, Conn: 0.3%
T-out: 3.5%, 404s: 6.6%
Robots: 1.9%, Other: 5.6%)

583,941
(22,541)

26,902,852
(991,873)

1,126,373,931
(35,886,427)

v1.7.20   Linux

mj12-kan-25-03

19/01/2020 14:58:25

2 hours 46 mins 1 sec

591

11

79.2%
(DNS: 1.3%, Conn: 1.3%
T-out: 1.5%, 404s: 9.9%
Robots: 1.3%, Other: 5.4%)

617,254
(20,830)

27,176,649
(993,660)

1,141,028,391
(36,625,156)

v1.7.20   Linux

mj12-kan-23-03

19/01/2020 14:58:29

2 hours 46 mins 0 sec

581

6

79.7%
(DNS: 1.0%, Conn: 0.9%
T-out: 1.4%, 404s: 10.4%
Robots: 1.1%, Other: 5.4%)

594,118
(21,146)

27,090,676
(979,038)

1,145,753,172
(36,635,266)

v1.7.20   Linux

mj12-kan-28-02

19/01/2020 14:58:31

2 hours 46 mins 1 sec

555

12

77.6%
(DNS: 1.2%, Conn: 0.5%
T-out: 1.9%, 404s: 9.2%
Robots: 4.1%, Other: 5.4%)

631,159
(22,774)

27,116,189
(979,624)

964,477,486
(30,643,108)

v1.7.20   Linux

mj12-kan-21-02

19/01/2020 14:58:31

2 hours 46 mins 1 sec

673

12

76.5%
(DNS: 2.8%, Conn: 1.3%
T-out: 2.2%, 404s: 9.1%
Robots: 1.9%, Other: 6.2%)

604,899
(21,843)

27,334,236
(991,815)

1,136,753,489
(36,233,893)

v1.7.20   Linux

mj12-kan-26-03

19/01/2020 14:58:34

2 hours 46 mins 1 sec

660

13

77.7%
(DNS: 1.9%, Conn: 1.3%
T-out: 2.4%, 404s: 11.5%
Robots: 2.1%, Other: 3.1%)

629,322
(23,403)

27,317,392
(985,245)

955,765,397
(30,402,851)

v1.7.20   Linux

mj12-kan-21-03

19/01/2020 14:58:35

2 hours 46 mins 2 secs

694

16

79.8%
(DNS: 0.9%, Conn: 0.8%
T-out: 2.0%, 404s: 8.3%
Robots: 2.2%, Other: 6.1%)

605,838
(23,530)

27,331,079
(1,001,597)

1,126,622,614
(36,007,773)

v1.7.20   Linux

mj12-kan-27-01

19/01/2020 14:58:35

2 hours 46 mins 1 sec

588

20

80.9%
(DNS: 1.6%, Conn: 0.3%
T-out: 1.5%, 404s: 6.0%
Robots: 1.5%, Other: 8.1%)

637,022
(23,246)

27,079,871
(996,800)

940,916,799
(29,830,865)

v1.7.20   Linux

mj12-kan-24-03

19/01/2020 14:58:37

2 hours 46 mins 1 sec

579

31

75.6%
(DNS: 2.3%, Conn: 0.8%
T-out: 2.6%, 404s: 10.1%
Robots: 3.9%, Other: 4.6%)

646,701
(23,039)

27,082,488
(984,079)

1,147,386,085
(36,782,587)

v1.7.20   Linux

mj12-kan-28-03

19/01/2020 14:58:38

2 hours 46 mins 2 secs

647

12

80.0%
(DNS: 1.4%, Conn: 1.6%
T-out: 3.2%, 404s: 7.8%
Robots: 2.8%, Other: 3.3%)

586,070
(22,587)

27,055,636
(989,198)

964,263,719
(30,628,343)

v1.7.20   Linux

mj12-kan-26-01

19/01/2020 14:58:40

2 hours 46 mins 1 sec

614

14

81.4%
(DNS: 1.3%, Conn: 1.0%
T-out: 1.2%, 404s: 6.7%
Robots: 3.3%, Other: 5.0%)

617,494
(23,647)

27,392,797
(999,784)

959,935,818
(30,540,138)

Total (30 nodes)

13,843

316

-

14,676,149
(537,855)

652,137,908
(23,715,786)

25,720,969,829
(821,153,299)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 19 Jan 2020 14:59:24:923 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12