Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://www.patdavies.net

Joined:

18/10/2005 21:15:00

URLs crawled:

43,528,919,419

Data (MB)*:

1,263,011,815

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-03-02

19/06/2017 21:01:22

3 hours 1 min 2 secs

439

3

77.8%
(DNS: 1.6%, Conn: 4.4%
T-out: 2.4%, 404s: 8.1%
Robots: 3.5%, Other: 2.1%)

0
(0)

7,480,681
(241,472)

682,855,693
(17,693,926)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-02-01

19/06/2017 21:12:59

3 hours 1 min 7 secs

3,967

60

66.4%
(DNS: 8.0%, Conn: 3.3%
T-out: 3.2%, 404s: 8.3%
Robots: 6.4%, Other: 4.5%)

0
(0)

57,000,115
(1,832,583)

1,210,282,694
(34,816,879)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-02-02

19/06/2017 21:13:14

3 hours 1 min 4 secs

5,231

58

75.7%
(DNS: 1.3%, Conn: 3.4%
T-out: 3.0%, 404s: 6.9%
Robots: 5.7%, Other: 3.9%)

0
(0)

56,819,085
(1,824,140)

1,114,825,769
(32,255,665)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-05-02

19/06/2017 21:13:22

3 hours 1 min 7 secs

4,377

59

78.2%
(DNS: 1.3%, Conn: 2.9%
T-out: 2.6%, 404s: 6.2%
Robots: 5.4%, Other: 3.5%)

0
(0)

56,982,117
(1,829,584)

1,226,181,022
(35,613,465)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-01-03

19/06/2017 21:13:24

3 hours 1 min 5 secs

4,563

60

79.0%
(DNS: 1.4%, Conn: 1.1%
T-out: 3.5%, 404s: 7.9%
Robots: 3.0%, Other: 4.1%)

0
(0)

61,221,641
(2,006,828)

953,632,805
(28,870,820)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-05-03

19/06/2017 21:14:01

3 hours 1 min 5 secs

4,344

53

77.3%
(DNS: 2.0%, Conn: 2.8%
T-out: 2.9%, 404s: 7.2%
Robots: 3.6%, Other: 4.2%)

0
(0)

58,250,922
(1,855,404)

941,541,811
(28,546,377)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-05-01

19/06/2017 21:35:18

3 hours 34 mins 57 secs

4,132

50

75.4%
(DNS: 1.0%, Conn: 2.8%
T-out: 3.3%, 404s: 8.1%
Robots: 5.7%, Other: 3.7%)

0
(0)

57,942,913
(1,856,205)

1,169,622,931
(34,275,318)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-01-02

19/06/2017 21:53:32

3 hours 53 mins 12 secs

3,929

45

76.1%
(DNS: 2.3%, Conn: 2.1%
T-out: 3.1%, 404s: 7.8%
Robots: 4.6%, Other: 4.0%)

0
(0)

61,503,792
(2,018,220)

1,218,755,648
(35,469,177)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-01-01

19/06/2017 22:53:22

4 hours 53 mins 2 secs

4,359

40

78.1%
(DNS: 1.3%, Conn: 1.3%
T-out: 3.3%, 404s: 8.0%
Robots: 4.0%, Other: 4.0%)

0
(0)

61,703,446
(2,018,388)

1,188,368,459
(34,709,931)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-02-03

19/06/2017 23:41:38

5 hours 37 mins 16 secs

4,172

47

78.4%
(DNS: 1.0%, Conn: 2.9%
T-out: 4.5%, 404s: 6.7%
Robots: 3.0%, Other: 3.5%)

0
(0)

57,558,253
(1,843,867)

886,162,593
(26,579,491)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-03-01

20/06/2017 00:35:33

6 hours 31 mins 11 secs

2,420

28

76.9%
(DNS: 0.9%, Conn: 2.3%
T-out: 4.7%, 404s: 7.6%
Robots: 3.5%, Other: 4.1%)

0
(0)

63,687,564
(2,048,464)

1,023,378,185
(29,194,836)

v1.7.15 Update 2 (.NET 4.5)   Linux

MJ12-KAN-03-03

20/06/2017 01:48:19

7 hours 43 mins 58 secs

2,370

28

76.7%
(DNS: 1.3%, Conn: 2.1%
T-out: 5.2%, 404s: 7.3%
Robots: 2.7%, Other: 4.8%)

0
(0)

64,528,135
(2,078,547)

770,411,382
(22,961,266)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-17-01

25/06/2017 00:31:12

31 mins 1 sec

136

14

87.3%
(DNS: 0.0%, Conn: 0.0%
T-out: 9.8%, 404s: 2.9%
Robots: 0.0%, Other: 0.0%)

24,641
(900)

48,283,983
(1,560,901)

87,169,968
(2,844,932)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-07-02

25/06/2017 00:46:10

46 mins 0 sec

433

13

86.4%
(DNS: 0.1%, Conn: 0.0%
T-out: 2.6%, 404s: 5.2%
Robots: 0.5%, Other: 5.1%)

29,616
(1,016)

62,526,005
(2,028,608)

1,209,726,352
(35,547,580)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-07-03

25/06/2017 00:46:10

46 mins 0 sec

910

1

93.3%
(DNS: 2.2%, Conn: 0.1%
T-out: 0.0%, 404s: 2.0%
Robots: 2.3%, Other: 0.2%)

4,994
(237)

66,838,610
(2,195,617)

652,606,261
(19,866,455)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-08-03

25/06/2017 00:46:10

46 mins 0 sec

127

n/a

78.9%
(DNS: 0.2%, Conn: 0.6%
T-out: 0.0%, 404s: 8.9%
Robots: 3.9%, Other: 7.4%)

0
(0)

67,549,325
(2,197,266)

972,080,352
(29,571,876)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-07-01

25/06/2017 00:46:10

46 mins 0 sec

138

n/a

91.8%
(DNS: 0.0%, Conn: 0.1%
T-out: 0.1%, 404s: 7.1%
Robots: 0.0%, Other: 0.9%)

0
(0)

58,349,906
(1,899,978)

1,170,722,871
(34,660,912)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-08-02

25/06/2017 00:46:10

46 mins 0 sec

609

5

81.6%
(DNS: 3.2%, Conn: 0.1%
T-out: 4.3%, 404s: 2.8%
Robots: 4.1%, Other: 4.0%)

19,954
(655)

69,410,351
(2,258,794)

1,187,855,373
(35,051,615)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-08-01

25/06/2017 00:46:10

46 mins 0 sec

116

1

77.7%
(DNS: 0.3%, Conn: 0.2%
T-out: 0.2%, 404s: 17.0%
Robots: 1.7%, Other: 3.0%)

4,833
(127)

60,216,040
(1,954,462)

1,193,016,498
(34,964,057)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-14-02

25/06/2017 00:46:10

46 mins 0 sec

551

26

72.1%
(DNS: 1.8%, Conn: 0.1%
T-out: 3.4%, 404s: 11.7%
Robots: 7.8%, Other: 3.0%)

34,250
(1,347)

60,711,397
(1,982,093)

130,193,762
(4,307,774)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-09-01

25/06/2017 00:46:10

46 mins 0 sec

168

9

75.4%
(DNS: 0.0%, Conn: 0.0%
T-out: 3.2%, 404s: 0.1%
Robots: 10.0%, Other: 11.4%)

29,847
(1,143)

72,433,073
(2,360,483)

1,209,253,486
(35,395,747)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-14-01

25/06/2017 00:46:10

46 mins 0 sec

1,056

3

72.6%
(DNS: 1.6%, Conn: 1.2%
T-out: 3.5%, 404s: 9.5%
Robots: 3.5%, Other: 8.1%)

9,994
(507)

59,020,057
(1,929,918)

128,436,345
(4,257,415)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-14-03

25/06/2017 00:46:10

46 mins 0 sec

409

11

76.5%
(DNS: 0.1%, Conn: 0.2%
T-out: 5.1%, 404s: 5.4%
Robots: 8.2%, Other: 4.4%)

34,425
(958)

61,465,384
(1,996,377)

129,911,727
(4,284,468)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-23-01

25/06/2017 00:46:10

46 mins 0 sec

395

5

95.9%
(DNS: 0.2%, Conn: 0.1%
T-out: 0.8%, 404s: 2.4%
Robots: 0.3%, Other: 0.4%)

14,939
(469)

65,944,380
(2,151,193)

103,739,271
(3,412,747)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

lxapp-kan-02-01

25/06/2017 00:46:10

46 mins 0 sec

456

23

52.6%
(DNS: 0.0%, Conn: 0.0%
T-out: 3.4%, 404s: 2.3%
Robots: 39.0%, Other: 2.6%)

58,822
(1,973)

64,698,031
(2,129,582)

308,810,481
(10,279,131)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-23-02

25/06/2017 00:46:10

46 mins 0 sec

275

8

83.8%
(DNS: 0.0%, Conn: 0.0%
T-out: 5.9%, 404s: 3.6%
Robots: 0.0%, Other: 6.7%)

24,676
(598)

66,429,119
(2,168,584)

105,772,959
(3,490,999)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

lxapp-kan-02-02

25/06/2017 00:46:10

46 mins 0 sec

427

12

86.0%
(DNS: 2.8%, Conn: 0.3%
T-out: 0.3%, 404s: 1.3%
Robots: 5.8%, Other: 3.6%)

24,854
(1,014)

65,271,022
(2,144,313)

305,885,714
(10,156,896)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-23-03

25/06/2017 00:46:10

46 mins 0 sec

373

10

92.6%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.9%, 404s: 3.9%
Robots: 1.5%, Other: 1.0%)

19,928
(685)

64,851,267
(2,118,446)

103,441,615
(3,419,423)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-09-03

25/06/2017 00:46:11

46 mins 0 sec

805

13

82.3%
(DNS: 2.1%, Conn: 0.2%
T-out: 3.6%, 404s: 6.0%
Robots: 2.0%, Other: 3.9%)

24,617
(792)

72,404,584
(2,360,240)

947,207,751
(28,848,420)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-17-02

25/06/2017 00:46:11

46 mins 0 sec

859

30

76.6%
(DNS: 0.8%, Conn: 1.0%
T-out: 10.9%, 404s: 2.5%
Robots: 2.9%, Other: 5.3%)

59,054
(2,243)

46,808,925
(1,525,125)

86,398,780
(2,832,784)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

lxapp-kan-02-03

25/06/2017 00:46:11

46 mins 0 sec

55

17

69.6%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.5%, 404s: 20.4%
Robots: 0.1%, Other: 9.4%)

39,529
(1,478)

62,139,871
(2,047,381)

302,668,905
(10,052,454)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-16-03

25/06/2017 00:46:11

46 mins 0 sec

1,015

14

85.0%
(DNS: 3.3%, Conn: 0.1%
T-out: 1.2%, 404s: 6.3%
Robots: 0.7%, Other: 3.4%)

24,664
(636)

44,957,032
(1,455,264)

84,799,466
(2,776,476)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-22-02

25/06/2017 00:46:11

46 mins 1 sec

214

22

86.2%
(DNS: 0.1%, Conn: 0.0%
T-out: 1.3%, 404s: 9.3%
Robots: 2.4%, Other: 0.8%)

38,948
(1,253)

67,394,258
(2,192,900)

106,207,511
(3,493,838)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-11-03

25/06/2017 00:46:11

46 mins 0 sec

108

20

81.1%
(DNS: 0.7%, Conn: 0.0%
T-out: 3.6%, 404s: 6.4%
Robots: 0.0%, Other: 8.2%)

49,011
(1,319)

59,392,047
(1,937,487)

338,230,570
(9,324,826)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-16-02

25/06/2017 00:46:11

46 mins 0 sec

874

2

75.6%
(DNS: 2.0%, Conn: 0.2%
T-out: 4.9%, 404s: 7.6%
Robots: 2.0%, Other: 7.8%)

9,764
(434)

46,204,661
(1,498,423)

84,591,185
(2,783,560)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-11-02

25/06/2017 00:46:11

46 mins 0 sec

120

20

61.1%
(DNS: 0.0%, Conn: 0.0%
T-out: 34.5%, 404s: 1.4%
Robots: 0.0%, Other: 2.9%)

49,124
(1,649)

59,833,835
(1,956,111)

312,721,333
(8,842,698)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-11-01

25/06/2017 00:46:11

46 mins 0 sec

10

9

64.3%
(DNS: 0.0%, Conn: 0.0%
T-out: 12.7%, 404s: 0.0%
Robots: 0.0%, Other: 23.0%)

24,446
(1,019)

60,562,744
(1,974,889)

317,039,069
(8,842,173)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-16-01

25/06/2017 00:46:11

46 mins 0 sec

51

25

64.6%
(DNS: 0.0%, Conn: 0.0%
T-out: 26.8%, 404s: 0.2%
Robots: 7.8%, Other: 0.6%)

53,991
(2,174)

45,344,021
(1,466,280)

82,420,817
(2,700,576)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-22-03

25/06/2017 00:46:11

46 mins 1 sec

31

20

62.4%
(DNS: 0.0%, Conn: 0.0%
T-out: 22.0%, 404s: 0.6%
Robots: 0.0%, Other: 15.0%)

29,356
(985)

65,061,275
(2,116,676)

102,436,896
(3,378,116)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-06-01

25/06/2017 00:46:11

46 mins 0 sec

95

1

80.1%
(DNS: 0.0%, Conn: 1.5%
T-out: 1.8%, 404s: 8.8%
Robots: 1.2%, Other: 6.6%)

2,898
(54)

51,258,847
(1,665,113)

1,172,925,649
(34,232,198)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-19-02

25/06/2017 00:46:11

46 mins 0 sec

28

18

50.3%
(DNS: 0.0%, Conn: 9.9%
T-out: 18.8%, 404s: 8.8%
Robots: 0.0%, Other: 12.3%)

29,228
(821)

46,507,082
(1,518,728)

83,963,797
(2,761,962)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-19-01

25/06/2017 00:46:11

46 mins 0 sec

102

12

86.0%
(DNS: 0.0%, Conn: 0.0%
T-out: 1.6%, 404s: 2.0%
Robots: 1.3%, Other: 9.2%)

24,492
(623)

46,216,572
(1,514,474)

86,030,744
(2,839,979)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-19-03

25/06/2017 00:46:11

46 mins 0 sec

575

12

69.1%
(DNS: 0.9%, Conn: 0.3%
T-out: 10.1%, 404s: 11.0%
Robots: 3.8%, Other: 4.8%)

34,670
(1,065)

46,404,863
(1,510,543)

83,783,562
(2,745,902)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-13-01

25/06/2017 00:46:11

46 mins 0 sec

341

28

64.8%
(DNS: 4.3%, Conn: 0.1%
T-out: 6.1%, 404s: 9.0%
Robots: 6.3%, Other: 9.5%)

54,255
(2,108)

61,380,282
(1,996,819)

131,375,100
(4,333,556)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-13-03

25/06/2017 00:46:11

46 mins 0 sec

620

23

83.1%
(DNS: 0.3%, Conn: 0.8%
T-out: 2.5%, 404s: 7.5%
Robots: 2.0%, Other: 3.7%)

59,111
(2,169)

58,658,938
(1,909,837)

124,345,316
(4,106,233)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-13-02

25/06/2017 00:46:11

46 mins 0 sec

161

15

66.5%
(DNS: 0.0%, Conn: 0.0%
T-out: 4.6%, 404s: 3.3%
Robots: 1.5%, Other: 24.1%)

24,545
(805)

63,504,680
(2,066,013)

132,744,427
(4,386,128)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-25-03

25/06/2017 00:46:11

46 mins 0 sec

186

11

75.1%
(DNS: 0.3%, Conn: 0.1%
T-out: 5.3%, 404s: 12.2%
Robots: 0.2%, Other: 6.7%)

24,206
(825)

64,256,729
(2,104,854)

101,730,256
(3,370,519)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-21-01

25/06/2017 00:46:11

46 mins 0 sec

338

9

74.8%
(DNS: 3.0%, Conn: 0.0%
T-out: 2.6%, 404s: 11.1%
Robots: 0.0%, Other: 8.3%)

29,676
(830)

64,661,314
(2,115,597)

102,284,153
(3,395,588)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-21-02

25/06/2017 00:46:11

46 mins 0 sec

534

10

78.5%
(DNS: 0.0%, Conn: 0.0%
T-out: 15.2%, 404s: 0.2%
Robots: 2.8%, Other: 3.2%)

43,321
(1,329)

66,587,613
(2,164,818)

105,900,976
(3,489,511)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-24-01

25/06/2017 00:46:11

46 mins 1 sec

427

15

84.7%
(DNS: 1.7%, Conn: 0.5%
T-out: 0.3%, 404s: 2.5%
Robots: 0.3%, Other: 10.0%)

39,746
(1,464)

64,207,244
(2,109,582)

102,399,175
(3,400,993)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-15-01

25/06/2017 00:46:11

46 mins 1 sec

616

9

76.8%
(DNS: 3.9%, Conn: 0.1%
T-out: 5.6%, 404s: 11.6%
Robots: 0.2%, Other: 1.8%)

24,772
(861)

58,689,308
(1,910,588)

119,165,800
(3,939,941)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-12-03

25/06/2017 00:46:11

46 mins 1 sec

313

18

72.3%
(DNS: 0.3%, Conn: 2.6%
T-out: 1.4%, 404s: 12.8%
Robots: 4.9%, Other: 5.7%)

53,979
(1,709)

66,693,363
(2,176,197)

225,228,504
(6,685,176)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-12-01

25/06/2017 00:46:11

46 mins 1 sec

526

36

80.4%
(DNS: 0.0%, Conn: 0.2%
T-out: 6.9%, 404s: 5.9%
Robots: 0.0%, Other: 6.7%)

73,977
(2,275)

67,282,175
(2,194,902)

212,523,520
(6,408,626)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-15-02

25/06/2017 00:46:11

46 mins 0 sec

520

5

79.7%
(DNS: 5.2%, Conn: 0.0%
T-out: 5.9%, 404s: 0.5%
Robots: 0.0%, Other: 8.6%)

24,589
(970)

57,685,855
(1,890,989)

126,801,898
(4,209,231)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-09-02

25/06/2017 00:46:12

46 mins 1 sec

109

1

86.2%
(DNS: 0.0%, Conn: 0.3%
T-out: 0.1%, 404s: 10.9%
Robots: 0.0%, Other: 2.5%)

3,990
(115)

67,352,734
(2,192,721)

1,137,189,764
(33,449,140)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-25-01

25/06/2017 00:46:12

46 mins 0 sec

1,387

16

79.5%
(DNS: 1.3%, Conn: 0.6%
T-out: 0.8%, 404s: 10.4%
Robots: 4.3%, Other: 3.0%)

39,284
(1,401)

65,518,528
(2,140,473)

104,241,584
(3,448,163)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-06-03

25/06/2017 00:46:12

46 mins 0 sec

375

6

74.3%
(DNS: 0.1%, Conn: 0.6%
T-out: 3.9%, 404s: 9.9%
Robots: 4.8%, Other: 6.2%)

29,583
(1,016)

67,618,643
(2,203,421)

976,920,363
(29,594,157)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-15-03

25/06/2017 00:46:12

46 mins 0 sec

188

15

67.9%
(DNS: 0.5%, Conn: 0.5%
T-out: 1.3%, 404s: 12.9%
Robots: 10.4%, Other: 6.5%)

39,062
(1,251)

60,061,115
(1,953,178)

129,170,109
(4,273,355)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-18-02

25/06/2017 00:46:12

46 mins 1 sec

367

22

86.8%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.3%, 404s: 11.8%
Robots: 0.0%, Other: 1.1%)

49,564
(1,629)

47,983,847
(1,560,462)

87,438,874
(2,870,431)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-18-03

25/06/2017 00:46:12

46 mins 1 sec

387

6

86.4%
(DNS: 0.4%, Conn: 0.0%
T-out: 4.7%, 404s: 2.0%
Robots: 0.7%, Other: 5.8%)

14,516
(498)

46,090,358
(1,494,860)

84,787,453
(2,785,540)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-12-02

25/06/2017 00:46:12

46 mins 1 sec

442

1

84.3%
(DNS: 1.1%, Conn: 0.2%
T-out: 1.3%, 404s: 8.9%
Robots: 1.7%, Other: 2.4%)

4,998
(211)

6,418,646
(211,949)

62,028,632
(1,641,360)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-22-01

25/06/2017 00:46:12

46 mins 1 sec

598

24

84.1%
(DNS: 0.0%, Conn: 0.1%
T-out: 0.8%, 404s: 4.3%
Robots: 5.3%, Other: 5.3%)

34,518
(1,178)

65,333,002
(2,135,828)

105,444,179
(3,482,294)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-24-03

25/06/2017 00:46:12

46 mins 1 sec

225

17

92.0%
(DNS: 0.8%, Conn: 0.1%
T-out: 1.6%, 404s: 2.8%
Robots: 2.3%, Other: 0.6%)

49,556
(1,775)

67,701,154
(2,210,327)

107,047,185
(3,541,794)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-18-01

25/06/2017 00:46:12

46 mins 1 sec

120

29

83.8%
(DNS: 0.0%, Conn: 0.0%
T-out: 8.8%, 404s: 0.7%
Robots: 0.0%, Other: 6.7%)

49,451
(1,918)

47,586,283
(1,548,274)

85,817,215
(2,819,026)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-10-01

25/06/2017 00:46:12

46 mins 0 sec

437

10

73.5%
(DNS: 0.2%, Conn: 0.0%
T-out: 11.6%, 404s: 5.8%
Robots: 3.5%, Other: 5.3%)

24,312
(1,192)

75,097,637
(2,452,971)

90,023,106
(2,946,721)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-10-02

25/06/2017 00:46:12

46 mins 1 sec

82

n/a

83.5%
(DNS: 0.0%, Conn: 1.4%
T-out: 0.3%, 404s: 9.0%
Robots: 1.6%, Other: 4.2%)

1,039
(13)

59,116,645
(1,931,706)

73,685,760
(2,413,977)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-17-03

25/06/2017 00:46:12

46 mins 1 sec

993

19

77.7%
(DNS: 1.8%, Conn: 0.1%
T-out: 3.7%, 404s: 4.3%
Robots: 8.9%, Other: 3.5%)

29,390
(945)

45,923,163
(1,488,664)

85,762,576
(2,815,188)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-24-02

25/06/2017 00:46:12

46 mins 1 sec

409

10

84.0%
(DNS: 2.7%, Conn: 3.2%
T-out: 0.8%, 404s: 3.6%
Robots: 5.1%, Other: 0.7%)

38,954
(1,312)

65,409,561
(2,145,244)

100,804,533
(3,339,042)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-06-02

25/06/2017 00:46:12

46 mins 0 sec

322

16

84.1%
(DNS: 0.0%, Conn: 0.6%
T-out: 4.1%, 404s: 10.8%
Robots: 0.3%, Other: 0.1%)

34,868
(1,317)

66,126,139
(2,170,365)

1,196,598,329
(35,232,114)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-10-03

25/06/2017 00:46:12

46 mins 0 sec

115

1

81.0%
(DNS: 0.1%, Conn: 1.2%
T-out: 4.8%, 404s: 11.7%
Robots: 0.0%, Other: 1.1%)

5,082
(171)

66,299,541
(2,165,335)

80,865,295
(2,648,938)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-25-02

25/06/2017 00:46:12

46 mins 1 sec

573

10

91.9%
(DNS: 0.2%, Conn: 0.1%
T-out: 1.6%, 404s: 3.5%
Robots: 0.0%, Other: 2.8%)

39,125
(1,312)

64,887,726
(2,110,201)

101,973,481
(3,355,367)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

mj12-kan-21-03

25/06/2017 00:59:31

46 mins 0 sec

679

20

83.0%
(DNS: 2.5%, Conn: 0.3%
T-out: 4.0%, 404s: 3.1%
Robots: 3.3%, Other: 3.7%)

49,125
(1,613)

66,969,024
(2,191,763)

106,453,223
(3,520,723)

Total (72 nodes)

68,214

1,309

-

1,818,159
(62,386)

4,244,268,478
(138,217,889)

31,776,818,848
(950,857,972)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 25 Jun 2017 01:00:20:220 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12