Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://patdavies.net/

Joined:

18/10/2005 21:15:00

URLs crawled:

80,942,331,523

Data (MB)*:

2,470,307,972

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

mj12-kan-11-01

23/09/2018 18:01:12

1 min 0 sec

1,261

n/a

65.8%
(DNS: 0.0%, Conn: 0.2%
T-out: 0.2%, 404s: 27.8%
Robots: 0.0%, Other: 5.9%)

798,388
(24,926)

32,545,794
(1,038,458)

954,985,284
(29,607,899)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-19-02

23/09/2018 21:46:15

3 hours 46 mins 3 secs

1,528

15

72.5%
(DNS: 2.4%, Conn: 1.4%
T-out: 2.8%, 404s: 13.0%
Robots: 3.5%, Other: 4.4%)

1,379,154
(43,660)

35,964,838
(1,153,096)

723,457,526
(23,619,878)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-13-02

23/09/2018 21:46:15

3 hours 46 mins 3 secs

1,909

16

74.3%
(DNS: 2.5%, Conn: 1.2%
T-out: 2.9%, 404s: 11.8%
Robots: 3.7%, Other: 3.8%)

1,319,553
(41,577)

35,588,798
(1,125,875)

811,386,809
(26,485,058)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-13-03

23/09/2018 21:46:15

3 hours 46 mins 4 secs

1,193

18

74.5%
(DNS: 1.8%, Conn: 1.6%
T-out: 3.0%, 404s: 10.1%
Robots: 3.8%, Other: 5.2%)

1,247,058
(38,267)

35,851,000
(1,150,268)

796,593,923
(25,994,282)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-21-03

23/09/2018 21:46:15

3 hours 46 mins 3 secs

1,484

13

66.0%
(DNS: 2.7%, Conn: 1.5%
T-out: 2.2%, 404s: 12.2%
Robots: 2.8%, Other: 12.6%)

1,310,272
(38,898)

37,251,466
(1,136,804)

657,153,909
(20,949,307)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-13-01

23/09/2018 21:46:16

3 hours 46 mins 4 secs

1,287

12

68.7%
(DNS: 2.4%, Conn: 1.5%
T-out: 3.4%, 404s: 14.7%
Robots: 4.7%, Other: 4.6%)

1,267,054
(38,507)

36,635,003
(1,175,143)

816,593,103
(26,643,945)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-21-01

23/09/2018 21:46:16

3 hours 46 mins 3 secs

1,518

16

71.6%
(DNS: 2.3%, Conn: 0.9%
T-out: 3.0%, 404s: 9.8%
Robots: 4.7%, Other: 7.8%)

1,314,405
(39,270)

34,795,448
(1,064,672)

653,590,552
(20,778,612)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-26-02

23/09/2018 21:46:16

3 hours 46 mins 3 secs

1,624

14

69.6%
(DNS: 2.2%, Conn: 1.5%
T-out: 3.7%, 404s: 11.5%
Robots: 3.2%, Other: 8.3%)

1,327,448
(39,437)

36,525,365
(1,111,176)

481,394,327
(15,302,555)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-19-01

23/09/2018 21:46:16

3 hours 46 mins 4 secs

1,387

14

70.4%
(DNS: 2.0%, Conn: 1.3%
T-out: 2.7%, 404s: 14.7%
Robots: 5.0%, Other: 4.0%)

1,420,130
(44,923)

35,396,712
(1,129,988)

722,201,909
(23,583,200)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-12-02

23/09/2018 21:46:16

3 hours 46 mins 3 secs

446

5

76.5%
(DNS: 3.2%, Conn: 0.3%
T-out: 2.1%, 404s: 8.8%
Robots: 2.1%, Other: 7.0%)

296,837
(9,759)

9,818,037
(335,700)

176,062,682
(5,358,476)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-11-03

23/09/2018 21:46:16

3 hours 46 mins 3 secs

1,002

11

59.6%
(DNS: 2.2%, Conn: 1.4%
T-out: 11.3%, 404s: 15.0%
Robots: 4.4%, Other: 6.1%)

906,355
(26,225)

30,988,204
(999,139)

958,921,330
(29,539,229)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-12-03

23/09/2018 21:46:16

3 hours 46 mins 3 secs

1,485

16

69.7%
(DNS: 2.6%, Conn: 1.0%
T-out: 5.0%, 404s: 11.4%
Robots: 3.0%, Other: 7.4%)

1,435,468
(44,512)

39,944,142
(1,274,207)

980,377,643
(31,357,539)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-25-01

23/09/2018 21:46:16

3 hours 46 mins 3 secs

1,334

12

68.3%
(DNS: 3.0%, Conn: 1.2%
T-out: 3.8%, 404s: 10.8%
Robots: 2.8%, Other: 10.1%)

1,337,054
(38,565)

35,907,254
(1,088,906)

671,880,631
(21,515,807)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-12-01

23/09/2018 21:46:16

3 hours 46 mins 3 secs

1,585

15

68.8%
(DNS: 2.4%, Conn: 1.6%
T-out: 3.4%, 404s: 15.3%
Robots: 3.2%, Other: 5.4%)

1,445,251
(44,503)

40,148,930
(1,278,771)

974,411,376
(31,224,836)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-25-03

23/09/2018 21:46:16

3 hours 46 mins 3 secs

1,310

12

65.9%
(DNS: 3.0%, Conn: 0.9%
T-out: 4.0%, 404s: 13.9%
Robots: 3.7%, Other: 8.5%)

1,326,064
(38,362)

35,833,058
(1,081,482)

669,122,585
(21,506,201)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-18-03

23/09/2018 21:46:16

3 hours 46 mins 4 secs

n/a

n/a

0.0%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.0%, 404s: 0.0%
Robots: 0.0%, Other: 100.0%)

0
(0)

0
(0)

601,248,481
(19,643,777)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-26-01

23/09/2018 21:46:16

3 hours 46 mins 4 secs

1,396

12

65.8%
(DNS: 1.7%, Conn: 0.6%
T-out: 7.2%, 404s: 12.4%
Robots: 3.5%, Other: 8.7%)

1,325,648
(40,097)

35,245,474
(1,073,535)

487,970,894
(15,416,682)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-16-01

23/09/2018 21:46:16

3 hours 46 mins 4 secs

1,414

15

71.2%
(DNS: 1.1%, Conn: 1.6%
T-out: 2.4%, 404s: 14.4%
Robots: 4.6%, Other: 4.7%)

1,424,330
(43,208)

35,806,150
(1,146,944)

624,958,535
(20,422,232)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-18-02

23/09/2018 21:46:16

3 hours 46 mins 4 secs

1,745

17

72.8%
(DNS: 2.8%, Conn: 1.0%
T-out: 3.3%, 404s: 10.0%
Robots: 5.1%, Other: 4.9%)

1,556,419
(50,807)

39,019,366
(1,251,031)

728,709,090
(23,769,237)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-15-03

23/09/2018 21:46:16

3 hours 46 mins 4 secs

1,320

11

69.7%
(DNS: 1.9%, Conn: 2.2%
T-out: 2.5%, 404s: 13.7%
Robots: 4.2%, Other: 5.8%)

1,136,665
(36,191)

34,208,716
(1,098,706)

797,694,806
(26,032,996)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-15-02

23/09/2018 21:46:16

3 hours 46 mins 4 secs

1,092

12

72.3%
(DNS: 3.0%, Conn: 2.0%
T-out: 2.9%, 404s: 11.3%
Robots: 4.5%, Other: 4.0%)

1,108,625
(34,162)

36,330,865
(1,164,245)

795,800,127
(26,031,240)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-26-03

23/09/2018 21:46:16

3 hours 46 mins 4 secs

1,369

15

67.9%
(DNS: 2.2%, Conn: 1.3%
T-out: 3.7%, 404s: 13.0%
Robots: 3.2%, Other: 8.7%)

1,275,822
(38,378)

36,527,984
(1,105,527)

479,191,236
(15,182,423)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-19-03

23/09/2018 21:46:16

3 hours 46 mins 5 secs

1,481

16

68.8%
(DNS: 1.7%, Conn: 2.2%
T-out: 4.2%, 404s: 12.1%
Robots: 4.3%, Other: 6.7%)

1,154,552
(35,783)

35,902,031
(1,157,511)

712,202,324
(23,276,612)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-21-02

23/09/2018 21:46:16

3 hours 46 mins 4 secs

1,456

13

67.8%
(DNS: 2.7%, Conn: 0.6%
T-out: 3.9%, 404s: 13.2%
Robots: 2.1%, Other: 9.7%)

1,326,102
(38,707)

37,470,481
(1,137,892)

660,634,861
(21,008,096)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-24-01

23/09/2018 21:46:17

3 hours 46 mins 4 secs

1,502

14

63.9%
(DNS: 2.9%, Conn: 0.7%
T-out: 3.9%, 404s: 13.0%
Robots: 3.8%, Other: 11.8%)

1,290,324
(38,447)

36,181,031
(1,099,962)

673,671,627
(21,615,581)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-11-02

23/09/2018 21:46:17

3 hours 46 mins 4 secs

1,259

13

66.1%
(DNS: 1.8%, Conn: 1.3%
T-out: 9.4%, 404s: 10.4%
Robots: 5.1%, Other: 5.9%)

1,234,892
(36,949)

33,566,633
(1,082,540)

936,146,399
(29,136,369)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-16-02

23/09/2018 21:46:17

3 hours 46 mins 4 secs

1,335

13

71.7%
(DNS: 2.6%, Conn: 2.4%
T-out: 3.7%, 404s: 9.1%
Robots: 3.9%, Other: 6.6%)

1,142,068
(35,020)

36,425,056
(1,173,979)

626,309,562
(20,512,157)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-18-01

23/09/2018 21:46:17

3 hours 46 mins 4 secs

1,414

14

69.6%
(DNS: 3.0%, Conn: 2.1%
T-out: 2.7%, 404s: 13.9%
Robots: 4.0%, Other: 4.6%)

1,541,139
(47,183)

38,734,140
(1,246,296)

721,150,763
(23,527,158)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-24-02

23/09/2018 21:46:17

3 hours 46 mins 4 secs

1,436

12

72.2%
(DNS: 1.9%, Conn: 1.0%
T-out: 2.4%, 404s: 10.9%
Robots: 1.9%, Other: 9.6%)

1,333,086
(39,132)

37,568,633
(1,128,787)

675,008,369
(21,625,424)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-15-01

23/09/2018 21:46:17

3 hours 46 mins 4 secs

1,390

11

71.5%
(DNS: 3.3%, Conn: 1.8%
T-out: 4.3%, 404s: 11.2%
Robots: 3.5%, Other: 4.4%)

1,140,149
(35,045)

35,651,524
(1,141,327)

794,773,731
(25,918,865)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-23-01

23/09/2018 21:46:17

3 hours 46 mins 5 secs

1,362

11

64.5%
(DNS: 2.3%, Conn: 0.9%
T-out: 3.8%, 404s: 14.6%
Robots: 3.2%, Other: 10.6%)

1,287,317
(37,948)

36,138,356
(1,096,279)

673,310,605
(21,568,424)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-22-01

23/09/2018 21:46:17

3 hours 46 mins 4 secs

1,200

10

65.9%
(DNS: 1.7%, Conn: 0.9%
T-out: 3.7%, 404s: 15.0%
Robots: 3.3%, Other: 9.5%)

1,297,527
(38,612)

37,028,449
(1,116,557)

678,034,399
(21,714,243)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-14-02

23/09/2018 21:46:17

3 hours 46 mins 4 secs

1,451

14

71.8%
(DNS: 2.0%, Conn: 2.5%
T-out: 2.2%, 404s: 13.3%
Robots: 4.0%, Other: 4.2%)

1,249,315
(37,674)

36,098,457
(1,155,351)

804,230,233
(26,278,489)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-17-03

23/09/2018 21:46:17

3 hours 46 mins 4 secs

1,510

16

70.3%
(DNS: 2.5%, Conn: 1.6%
T-out: 3.1%, 404s: 13.4%
Robots: 3.0%, Other: 6.1%)

1,417,932
(45,917)

35,690,698
(1,144,780)

716,059,225
(23,361,158)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-24-03

23/09/2018 21:46:17

3 hours 46 mins 4 secs

1,341

14

67.8%
(DNS: 2.6%, Conn: 1.3%
T-out: 5.2%, 404s: 12.3%
Robots: 3.0%, Other: 7.9%)

1,300,601
(37,824)

36,943,340
(1,117,161)

676,109,112
(21,708,250)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-22-03

23/09/2018 21:46:17

3 hours 46 mins 4 secs

1,464

12

67.4%
(DNS: 2.1%, Conn: 1.2%
T-out: 4.2%, 404s: 11.3%
Robots: 4.3%, Other: 9.5%)

1,284,960
(38,909)

35,968,041
(1,084,768)

664,265,993
(21,261,947)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-22-02

23/09/2018 21:46:17

3 hours 46 mins 5 secs

1,174

12

66.8%
(DNS: 2.3%, Conn: 1.2%
T-out: 4.4%, 404s: 13.5%
Robots: 2.6%, Other: 9.2%)

1,285,461
(39,724)

37,198,513
(1,117,449)

675,297,817
(21,637,983)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-17-02

23/09/2018 21:46:17

3 hours 46 mins 4 secs

1,219

13

71.2%
(DNS: 1.7%, Conn: 1.1%
T-out: 2.8%, 404s: 14.5%
Robots: 3.3%, Other: 5.4%)

1,147,111
(35,222)

34,404,925
(1,109,194)

706,882,890
(23,093,013)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-14-01

23/09/2018 21:46:17

3 hours 46 mins 4 secs

1,307

10

72.3%
(DNS: 2.9%, Conn: 1.6%
T-out: 3.4%, 404s: 12.0%
Robots: 3.4%, Other: 4.5%)

1,184,242
(37,591)

36,895,572
(1,178,601)

799,087,740
(26,146,374)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-28-01

23/09/2018 21:46:17

3 hours 46 mins 5 secs

1,524

16

67.7%
(DNS: 3.2%, Conn: 1.0%
T-out: 3.7%, 404s: 11.8%
Robots: 3.7%, Other: 9.1%)

1,381,399
(40,273)

37,988,909
(1,150,156)

485,017,679
(15,356,437)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-14-03

23/09/2018 21:46:17

3 hours 46 mins 5 secs

1,369

14

71.1%
(DNS: 2.2%, Conn: 2.0%
T-out: 2.2%, 404s: 12.9%
Robots: 3.9%, Other: 5.6%)

1,446,306
(47,204)

35,953,098
(1,164,776)

799,690,751
(26,167,540)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-17-01

23/09/2018 21:46:17

3 hours 46 mins 5 secs

1,423

14

68.5%
(DNS: 2.2%, Conn: 0.9%
T-out: 3.8%, 404s: 13.7%
Robots: 4.0%, Other: 7.0%)

1,392,759
(42,968)

35,588,492
(1,142,538)

714,602,004
(23,313,721)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-23-02

23/09/2018 21:46:17

3 hours 46 mins 5 secs

1,392

14

69.3%
(DNS: 2.7%, Conn: 0.7%
T-out: 4.3%, 404s: 12.0%
Robots: 3.4%, Other: 7.7%)

1,322,914
(39,227)

37,086,857
(1,117,913)

675,287,011
(21,662,473)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-28-02

23/09/2018 21:46:18

3 hours 46 mins 5 secs

1,338

12

65.8%
(DNS: 3.6%, Conn: 1.1%
T-out: 4.0%, 404s: 12.1%
Robots: 3.2%, Other: 10.1%)

1,285,232
(38,583)

35,980,611
(1,092,558)

488,303,364
(15,445,612)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-27-03

23/09/2018 21:46:18

3 hours 46 mins 5 secs

1,475

13

66.8%
(DNS: 2.7%, Conn: 1.4%
T-out: 3.5%, 404s: 11.6%
Robots: 4.7%, Other: 9.3%)

1,359,819
(39,705)

36,891,391
(1,118,559)

467,613,852
(14,653,345)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-28-03

23/09/2018 21:46:18

3 hours 46 mins 6 secs

1,306

12

67.5%
(DNS: 2.3%, Conn: 1.2%
T-out: 2.7%, 404s: 13.2%
Robots: 3.7%, Other: 9.4%)

1,339,699
(37,690)

36,626,040
(1,103,884)

492,113,052
(15,564,174)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-27-01

23/09/2018 21:46:18

3 hours 46 mins 5 secs

1,347

12

64.8%
(DNS: 3.7%, Conn: 1.4%
T-out: 3.3%, 404s: 12.9%
Robots: 4.0%, Other: 10.0%)

1,298,593
(40,056)

36,515,404
(1,102,423)

468,946,000
(14,713,964)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-25-02

23/09/2018 21:46:18

3 hours 46 mins 5 secs

1,362

10

66.3%
(DNS: 2.9%, Conn: 1.0%
T-out: 3.7%, 404s: 12.2%
Robots: 4.2%, Other: 9.8%)

1,356,383
(39,903)

37,270,076
(1,131,969)

671,313,896
(21,528,560)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-27-02

23/09/2018 21:46:19

3 hours 46 mins 6 secs

1,415

11

68.7%
(DNS: 1.7%, Conn: 1.3%
T-out: 4.7%, 404s: 11.0%
Robots: 3.6%, Other: 9.1%)

1,268,184
(37,899)

37,200,321
(1,131,112)

470,371,034
(14,701,319)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-23-03

23/09/2018 21:46:19

3 hours 46 mins 4 secs

1,406

14

67.7%
(DNS: 3.4%, Conn: 0.9%
T-out: 2.6%, 404s: 12.6%
Robots: 4.2%, Other: 8.5%)

1,346,962
(39,702)

36,704,121
(1,114,363)

674,735,505
(21,578,402)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-16-03

23/09/2018 21:46:20

3 hours 46 mins 8 secs

1,230

11

72.4%
(DNS: 2.8%, Conn: 2.3%
T-out: 4.0%, 404s: 9.6%
Robots: 4.4%, Other: 4.5%)

1,366,115
(43,111)

35,548,671
(1,141,506)

636,068,636
(20,807,910)

Total (51 nodes)

68,577

642

-

63,739,143
(1,936,242)

1,787,552,475
(55,783,864)

34,800,945,192
(1,118,849,011)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 23 Sep 2018 21:53:35:363 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12