Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://patdavies.net/

Joined:

18/10/2005 21:15:00

URLs crawled:

87,420,497,651

Data (MB)*:

2,670,355,023

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

mj12-kan-19-02

16/01/2019 20:46:23

2 hours 46 mins 2 secs

1,142

11

78.5%
(DNS: 1.9%, Conn: 0.5%
T-out: 4.1%, 404s: 6.6%
Robots: 5.8%, Other: 2.6%)

1,261,416
(37,781)

33,552,524
(1,066,909)

840,984,031
(27,352,447)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-13-01

16/01/2019 20:46:23

2 hours 46 mins 2 secs

1,246

10

80.3%
(DNS: 0.4%, Conn: 1.8%
T-out: 3.4%, 404s: 7.2%
Robots: 3.4%, Other: 3.5%)

1,145,291
(37,015)

34,029,848
(1,081,701)

937,556,240
(30,468,335)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-19-01

16/01/2019 20:46:23

2 hours 46 mins 2 secs

1,465

15

83.0%
(DNS: 1.2%, Conn: 1.3%
T-out: 1.6%, 404s: 5.4%
Robots: 3.6%, Other: 3.9%)

1,275,127
(39,666)

34,182,114
(1,098,187)

842,177,806
(27,392,109)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-15-03

16/01/2019 20:46:23

2 hours 46 mins 2 secs

1,414

13

75.7%
(DNS: 1.0%, Conn: 0.5%
T-out: 3.9%, 404s: 12.9%
Robots: 2.4%, Other: 3.6%)

693,147
(22,995)

34,042,656
(1,088,814)

919,369,677
(29,878,140)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-26-02

16/01/2019 20:46:24

2 hours 46 mins 2 secs

1,164

9

74.8%
(DNS: 1.4%, Conn: 0.7%
T-out: 3.5%, 404s: 7.5%
Robots: 2.7%, Other: 9.4%)

1,250,790
(37,600)

35,274,865
(1,083,403)

606,348,754
(19,093,799)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-21-02

16/01/2019 20:46:24

2 hours 46 mins 2 secs

1,434

15

74.4%
(DNS: 1.6%, Conn: 1.6%
T-out: 2.8%, 404s: 5.4%
Robots: 2.7%, Other: 11.4%)

1,400,622
(42,253)

36,233,394
(1,107,522)

789,754,394
(24,890,748)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-21-01

16/01/2019 20:46:24

2 hours 46 mins 2 secs

1,274

10

76.9%
(DNS: 0.7%, Conn: 0.3%
T-out: 3.6%, 404s: 5.1%
Robots: 3.5%, Other: 9.7%)

788,081
(24,910)

34,922,129
(1,061,703)

782,177,494
(24,631,437)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-13-02

16/01/2019 20:46:24

2 hours 46 mins 3 secs

1,165

15

81.5%
(DNS: 1.9%, Conn: 0.7%
T-out: 2.9%, 404s: 5.2%
Robots: 3.3%, Other: 4.5%)

1,226,810
(39,440)

34,539,893
(1,103,063)

934,130,957
(30,349,296)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-26-01

16/01/2019 20:46:24

2 hours 46 mins 2 secs

1,262

12

74.4%
(DNS: 0.7%, Conn: 1.0%
T-out: 2.1%, 404s: 5.3%
Robots: 5.7%, Other: 10.7%)

1,288,739
(39,674)

35,468,633
(1,083,440)

614,034,026
(19,214,223)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-11-02

16/01/2019 20:46:24

2 hours 46 mins 2 secs

1,302

15

81.2%
(DNS: 0.9%, Conn: 1.4%
T-out: 2.7%, 404s: 6.1%
Robots: 3.6%, Other: 4.0%)

448,563
(14,334)

28,706,648
(915,848)

1,038,509,077
(32,391,378)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-18-03

16/01/2019 20:46:24

2 hours 46 mins 2 secs

n/a

n/a

0.0%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.0%, 404s: 0.0%
Robots: 0.0%, Other: 100.0%)

0
(0)

0
(0)

601,248,481
(19,643,777)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-26-03

16/01/2019 20:46:24

2 hours 46 mins 3 secs

1,533

12

76.3%
(DNS: 1.3%, Conn: 0.6%
T-out: 2.1%, 404s: 8.6%
Robots: 2.0%, Other: 9.1%)

838,679
(26,444)

35,200,580
(1,077,320)

608,674,823
(19,059,351)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-12-02

16/01/2019 20:46:24

2 hours 46 mins 2 secs

476

7

82.6%
(DNS: 1.4%, Conn: 0.2%
T-out: 3.9%, 404s: 8.8%
Robots: 1.5%, Other: 1.6%)

309,876
(9,381)

9,803,423
(329,472)

209,538,500
(6,479,071)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-13-03

16/01/2019 20:46:24

2 hours 46 mins 3 secs

1,310

13

80.5%
(DNS: 1.4%, Conn: 0.4%
T-out: 1.5%, 404s: 8.8%
Robots: 3.0%, Other: 4.3%)

1,102,921
(37,225)

35,584,257
(1,141,578)

918,590,720
(29,874,719)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-12-01

16/01/2019 20:46:24

2 hours 46 mins 2 secs

1,085

7

78.1%
(DNS: 1.0%, Conn: 1.3%
T-out: 3.3%, 404s: 7.3%
Robots: 5.4%, Other: 3.7%)

1,284,883
(40,133)

41,106,288
(1,295,741)

1,109,577,808
(35,492,216)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-19-03

16/01/2019 20:46:24

2 hours 46 mins 3 secs

1,306

11

76.5%
(DNS: 1.2%, Conn: 1.4%
T-out: 5.4%, 404s: 10.5%
Robots: 2.0%, Other: 2.9%)

827,447
(27,430)

32,055,198
(1,032,054)

828,955,213
(26,980,219)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-22-02

16/01/2019 20:46:24

2 hours 46 mins 2 secs

1,510

13

74.5%
(DNS: 1.5%, Conn: 0.9%
T-out: 1.5%, 404s: 10.6%
Robots: 3.6%, Other: 7.4%)

1,122,898
(33,991)

35,725,046
(1,089,652)

801,703,836
(25,450,618)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-28-02

16/01/2019 20:46:24

2 hours 46 mins 2 secs

1,279

11

76.8%
(DNS: 1.9%, Conn: 0.4%
T-out: 3.3%, 404s: 5.2%
Robots: 4.9%, Other: 7.4%)

1,227,778
(38,389)

36,720,069
(1,123,854)

618,257,368
(19,352,489)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-12-03

16/01/2019 20:46:24

2 hours 46 mins 2 secs

1,238

11

76.3%
(DNS: 1.4%, Conn: 0.6%
T-out: 2.3%, 404s: 8.0%
Robots: 6.4%, Other: 4.9%)

1,229,617
(40,205)

39,709,819
(1,258,789)

1,118,266,330
(35,697,132)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-21-03

16/01/2019 20:46:24

2 hours 46 mins 3 secs

1,155

10

78.3%
(DNS: 1.9%, Conn: 0.5%
T-out: 1.8%, 404s: 5.0%
Robots: 2.2%, Other: 10.3%)

822,212
(25,687)

35,618,107
(1,092,518)

783,188,739
(24,766,578)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-17-01

16/01/2019 20:46:24

2 hours 46 mins 2 secs

1,405

8

81.4%
(DNS: 0.5%, Conn: 0.4%
T-out: 2.4%, 404s: 8.7%
Robots: 2.4%, Other: 4.1%)

1,030,994
(34,002)

33,926,071
(1,095,624)

827,992,572
(26,946,035)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-14-02

16/01/2019 20:46:24

2 hours 46 mins 2 secs

1,329

14

79.5%
(DNS: 2.0%, Conn: 0.6%
T-out: 1.6%, 404s: 7.6%
Robots: 3.7%, Other: 5.1%)

1,343,971
(43,021)

35,938,514
(1,144,553)

922,158,672
(30,029,051)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-15-02

16/01/2019 20:46:24

2 hours 46 mins 2 secs

1,284

11

79.5%
(DNS: 1.8%, Conn: 0.7%
T-out: 2.9%, 404s: 8.0%
Robots: 3.7%, Other: 3.4%)

1,309,373
(41,815)

37,067,281
(1,184,666)

922,493,950
(30,047,836)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-18-01

16/01/2019 20:46:25

2 hours 46 mins 2 secs

1,470

12

81.5%
(DNS: 1.3%, Conn: 0.9%
T-out: 2.8%, 404s: 5.9%
Robots: 3.8%, Other: 3.8%)

1,266,288
(40,225)

39,909,003
(1,268,583)

857,799,167
(27,836,229)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-28-01

16/01/2019 20:46:25

2 hours 46 mins 3 secs

1,430

13

75.1%
(DNS: 0.8%, Conn: 0.7%
T-out: 1.8%, 404s: 6.2%
Robots: 5.1%, Other: 10.3%)

1,289,638
(39,052)

34,804,830
(1,065,637)

612,398,383
(19,182,588)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-14-03

16/01/2019 20:46:25

2 hours 46 mins 3 secs

1,351

15

78.0%
(DNS: 1.6%, Conn: 1.1%
T-out: 3.6%, 404s: 7.2%
Robots: 4.7%, Other: 3.8%)

391,600
(12,757)

34,218,392
(1,091,107)

922,172,603
(30,057,667)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-16-03

16/01/2019 20:46:25

2 hours 46 mins 3 secs

1,350

13

81.3%
(DNS: 1.6%, Conn: 1.4%
T-out: 3.1%, 404s: 4.9%
Robots: 3.9%, Other: 3.8%)

1,248,333
(41,190)

34,210,800
(1,094,779)

753,390,264
(24,532,296)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-16-01

16/01/2019 20:46:25

2 hours 46 mins 3 secs

1,522

17

80.1%
(DNS: 0.4%, Conn: 1.0%
T-out: 1.5%, 404s: 6.6%
Robots: 6.0%, Other: 4.3%)

997,272
(31,498)

33,535,828
(1,075,945)

739,865,418
(24,082,527)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-15-01

16/01/2019 20:46:25

2 hours 46 mins 3 secs

1,469

14

82.7%
(DNS: 1.6%, Conn: 0.6%
T-out: 2.7%, 404s: 6.2%
Robots: 2.6%, Other: 3.5%)

1,181,533
(38,858)

35,262,412
(1,126,438)

916,467,648
(29,778,933)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-28-03

16/01/2019 20:46:25

2 hours 46 mins 3 secs

1,355

12

78.5%
(DNS: 1.4%, Conn: 0.3%
T-out: 1.4%, 404s: 6.8%
Robots: 2.9%, Other: 8.6%)

828,793
(25,357)

34,895,371
(1,067,806)

619,065,235
(19,377,674)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-17-02

16/01/2019 20:46:25

2 hours 46 mins 3 secs

1,102

17

78.7%
(DNS: 1.3%, Conn: 1.0%
T-out: 2.6%, 404s: 7.3%
Robots: 4.3%, Other: 4.8%)

1,183,359
(37,459)

33,278,118
(1,062,286)

823,018,441
(26,784,468)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-14-01

16/01/2019 20:46:25

2 hours 46 mins 3 secs

1,038

13

81.7%
(DNS: 0.9%, Conn: 0.4%
T-out: 2.7%, 404s: 6.3%
Robots: 2.9%, Other: 5.2%)

1,211,144
(38,339)

35,118,319
(1,120,012)

921,539,818
(30,012,496)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-23-02

16/01/2019 20:46:25

2 hours 46 mins 3 secs

1,338

12

72.6%
(DNS: 2.7%, Conn: 0.8%
T-out: 4.0%, 404s: 8.0%
Robots: 4.0%, Other: 8.1%)

1,149,942
(36,262)

35,434,637
(1,090,382)

803,553,261
(25,534,349)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-11-03

16/01/2019 20:46:25

2 hours 46 mins 3 secs

1,481

13

82.4%
(DNS: 1.3%, Conn: 0.5%
T-out: 2.2%, 404s: 7.2%
Robots: 2.0%, Other: 4.4%)

1,266,528
(38,699)

30,797,990
(991,385)

1,068,160,719
(33,019,705)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-22-01

16/01/2019 20:46:25

2 hours 46 mins 3 secs

1,466

13

78.4%
(DNS: 1.3%, Conn: 0.5%
T-out: 2.5%, 404s: 5.3%
Robots: 3.5%, Other: 8.5%)

1,122,272
(32,853)

35,666,574
(1,085,142)

805,449,112
(25,536,652)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-22-03

16/01/2019 20:46:25

2 hours 46 mins 3 secs

1,366

11

77.6%
(DNS: 1.5%, Conn: 0.9%
T-out: 3.5%, 404s: 6.6%
Robots: 3.1%, Other: 6.8%)

1,071,945
(34,132)

34,992,597
(1,077,178)

791,222,073
(25,096,723)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-24-03

16/01/2019 20:46:25

2 hours 46 mins 3 secs

1,288

11

70.8%
(DNS: 1.9%, Conn: 1.4%
T-out: 3.6%, 404s: 8.4%
Robots: 4.9%, Other: 9.0%)

1,188,880
(36,534)

35,021,672
(1,075,356)

804,042,042
(25,574,463)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-18-02

16/01/2019 20:46:25

2 hours 46 mins 3 secs

1,451

13

80.4%
(DNS: 1.9%, Conn: 0.8%
T-out: 2.1%, 404s: 5.6%
Robots: 4.2%, Other: 5.0%)

1,277,163
(40,494)

39,949,778
(1,260,990)

859,813,269
(27,907,532)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-17-03

16/01/2019 20:46:25

2 hours 46 mins 3 secs

1,289

11

82.1%
(DNS: 1.2%, Conn: 1.0%
T-out: 3.1%, 404s: 6.8%
Robots: 1.7%, Other: 4.1%)

1,034,058
(33,344)

33,449,290
(1,072,577)

832,925,085
(27,073,046)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-23-01

16/01/2019 20:46:26

2 hours 46 mins 4 secs

1,508

15

76.6%
(DNS: 1.7%, Conn: 0.7%
T-out: 3.7%, 404s: 6.6%
Robots: 3.2%, Other: 7.5%)

1,152,291
(37,274)

35,602,941
(1,094,998)

800,205,613
(25,392,075)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-16-02

16/01/2019 20:46:26

2 hours 46 mins 4 secs

1,079

10

77.3%
(DNS: 1.6%, Conn: 1.6%
T-out: 2.7%, 404s: 10.5%
Robots: 2.9%, Other: 3.4%)

1,131,804
(35,486)

33,601,214
(1,072,796)

744,642,786
(24,265,001)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-24-02

16/01/2019 20:46:26

2 hours 46 mins 4 secs

1,321

13

76.3%
(DNS: 1.6%, Conn: 1.2%
T-out: 3.2%, 404s: 5.8%
Robots: 3.2%, Other: 8.7%)

1,214,116
(36,353)

35,207,025
(1,069,317)

802,627,549
(25,462,150)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-24-01

16/01/2019 20:46:26

2 hours 46 mins 4 secs

1,858

17

76.6%
(DNS: 1.4%, Conn: 0.7%
T-out: 3.5%, 404s: 6.6%
Robots: 3.0%, Other: 8.2%)

1,202,149
(38,927)

34,902,901
(1,075,043)

799,808,296
(25,424,653)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-27-03

16/01/2019 20:46:26

2 hours 46 mins 4 secs

1,450

11

74.4%
(DNS: 1.9%, Conn: 0.6%
T-out: 3.0%, 404s: 8.7%
Robots: 2.2%, Other: 9.3%)

1,217,360
(37,364)

35,880,985
(1,098,060)

595,594,443
(18,506,348)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-27-02

16/01/2019 20:46:26

2 hours 46 mins 4 secs

1,441

13

77.2%
(DNS: 1.8%, Conn: 0.8%
T-out: 2.6%, 404s: 7.8%
Robots: 1.4%, Other: 8.4%)

1,211,503
(37,981)

35,728,033
(1,098,097)

597,897,065
(18,553,199)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-23-03

16/01/2019 20:46:26

2 hours 46 mins 4 secs

1,519

13

77.3%
(DNS: 0.6%, Conn: 0.4%
T-out: 2.7%, 404s: 7.3%
Robots: 3.3%, Other: 8.3%)

1,139,769
(36,671)

34,777,485
(1,072,559)

801,586,256
(25,407,889)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-25-01

16/01/2019 20:46:26

2 hours 46 mins 3 secs

1,098

15

75.2%
(DNS: 2.5%, Conn: 0.5%
T-out: 3.7%, 404s: 6.6%
Robots: 4.0%, Other: 7.5%)

1,186,401
(37,685)

36,009,428
(1,104,683)

798,839,592
(25,348,097)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-11-01

16/01/2019 20:46:26

2 hours 46 mins 4 secs

1,320

12

79.3%
(DNS: 1.3%, Conn: 1.5%
T-out: 2.2%, 404s: 9.9%
Robots: 2.3%, Other: 3.5%)

1,252,516
(39,674)

31,262,373
(999,252)

1,059,943,700
(32,933,487)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-25-03

16/01/2019 20:46:26

2 hours 46 mins 3 secs

1,133

12

72.4%
(DNS: 1.3%, Conn: 0.9%
T-out: 2.3%, 404s: 8.6%
Robots: 4.7%, Other: 9.7%)

820,622
(26,527)

34,590,257
(1,071,159)

794,607,374
(25,315,885)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-25-02

16/01/2019 20:46:27

2 hours 46 mins 3 secs

1,335

9

78.7%
(DNS: 1.0%, Conn: 0.5%
T-out: 1.8%, 404s: 5.4%
Robots: 2.7%, Other: 10.0%)

1,192,097
(35,826)

34,690,066
(1,064,035)

798,322,002
(25,361,235)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-27-01

16/01/2019 20:46:27

2 hours 46 mins 5 secs

1,546

16

77.4%
(DNS: 1.6%, Conn: 0.8%
T-out: 2.9%, 404s: 7.4%
Robots: 2.6%, Other: 7.3%)

851,214
(26,522)

34,681,966
(1,066,458)

595,654,700
(18,531,180)

Total (51 nodes)

66,152

619

-

54,509,825
(1,716,734)

1,726,887,642
(54,068,471)

40,896,301,382
(1,307,369,551)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 16 Jan 2019 20:57:02:667 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12