Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Joined:

18/10/2005 21:15:00

URLs crawled:

62,808,494,224

Data (MB)*:

1,900,078,113

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

mj12-kan-10-03

17/01/2018 06:00:54

1 min 0 sec

457

n/a

70.3%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.6%, 404s: 18.0%
Robots: 0.0%, Other: 11.0%)

0
(0)

29,594,221
(975,889)

309,290,874
(10,189,912)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-06-03

17/01/2018 06:00:56

1 min 0 sec

847

n/a

78.6%
(DNS: 0.0%, Conn: 0.5%
T-out: 1.0%, 404s: 14.4%
Robots: 0.0%, Other: 5.5%)

0
(0)

25,311,696
(838,853)

1,185,110,355
(36,460,623)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-09-03

17/01/2018 06:41:34

31 mins 1 sec

6,878

29

80.6%
(DNS: 3.9%, Conn: 0.9%
T-out: 3.4%, 404s: 5.9%
Robots: 1.3%, Other: 4.0%)

0
(0)

30,417,315
(1,015,510)

1,177,501,015
(36,453,786)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-09-01

17/01/2018 07:45:55

1 hour 46 mins 2 secs

8,392

54

80.9%
(DNS: 2.7%, Conn: 2.1%
T-out: 4.3%, 404s: 5.3%
Robots: 1.8%, Other: 2.9%)

0
(0)

27,291,734
(908,726)

1,442,163,067
(43,074,932)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-10-01

17/01/2018 07:45:56

1 hour 46 mins 3 secs

9,211

52

82.6%
(DNS: 1.2%, Conn: 1.1%
T-out: 3.6%, 404s: 6.8%
Robots: 1.4%, Other: 3.3%)

0
(0)

27,910,003
(923,159)

316,718,399
(10,413,759)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-09-02

17/01/2018 07:45:56

1 hour 46 mins 3 secs

8,695

59

82.3%
(DNS: 1.4%, Conn: 0.9%
T-out: 3.0%, 404s: 7.1%
Robots: 1.9%, Other: 3.4%)

0
(0)

31,096,892
(1,040,268)

1,369,770,002
(41,148,214)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-08-01

17/01/2018 07:45:56

1 hour 46 mins 2 secs

7,476

40

83.8%
(DNS: 1.7%, Conn: 1.2%
T-out: 2.4%, 404s: 5.8%
Robots: 1.4%, Other: 3.6%)

0
(0)

27,320,262
(896,099)

1,423,241,239
(42,607,659)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-06-02

17/01/2018 07:45:58

1 hour 46 mins 3 secs

8,107

51

81.2%
(DNS: 1.9%, Conn: 1.1%
T-out: 2.8%, 404s: 6.8%
Robots: 3.1%, Other: 3.0%)

0
(0)

26,300,787
(867,029)

1,410,975,915
(42,286,709)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-06-01

17/01/2018 07:45:59

1 hour 46 mins 3 secs

8,778

62

79.9%
(DNS: 2.2%, Conn: 1.3%
T-out: 4.5%, 404s: 7.0%
Robots: 2.0%, Other: 3.2%)

0
(0)

27,470,695
(911,250)

1,385,928,466
(41,297,506)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-08-02

17/01/2018 07:46:00

1 hour 46 mins 4 secs

8,249

44

82.9%
(DNS: 1.3%, Conn: 1.2%
T-out: 4.0%, 404s: 5.6%
Robots: 2.0%, Other: 3.0%)

0
(0)

31,635,834
(1,047,861)

1,421,701,409
(42,815,488)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-08-03

17/01/2018 07:46:09

1 hour 46 mins 5 secs

7,668

38

84.0%
(DNS: 1.4%, Conn: 0.9%
T-out: 3.1%, 404s: 5.8%
Robots: 1.8%, Other: 3.0%)

0
(0)

27,366,785
(913,864)

1,193,366,521
(36,901,408)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-07-02

17/01/2018 07:46:20

1 hour 46 mins 10 secs

6,560

35

81.4%
(DNS: 1.8%, Conn: 1.1%
T-out: 3.6%, 404s: 6.9%
Robots: 1.4%, Other: 3.9%)

0
(0)

26,915,409
(902,045)

1,426,079,577
(42,712,414)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-07-03

17/01/2018 07:46:21

1 hour 46 mins 10 secs

7,071

28

81.7%
(DNS: 1.2%, Conn: 0.7%
T-out: 3.8%, 404s: 7.5%
Robots: 1.6%, Other: 3.5%)

0
(0)

28,315,619
(932,137)

874,304,914
(27,207,221)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-07-01

17/01/2018 07:46:21

1 hour 46 mins 11 secs

6,287

38

81.0%
(DNS: 1.7%, Conn: 1.3%
T-out: 3.7%, 404s: 7.1%
Robots: 1.9%, Other: 3.5%)

0
(0)

25,268,523
(828,736)

1,381,214,696
(41,597,024)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-10-02

17/01/2018 07:54:59

1 hour 46 mins 4 secs

8,566

52

83.2%
(DNS: 0.8%, Conn: 0.8%
T-out: 2.9%, 404s: 6.1%
Robots: 3.3%, Other: 3.0%)

0
(0)

29,929,406
(1,000,807)

302,807,934
(10,000,671)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-11-03

19/01/2018 06:00:50

1 min 0 sec

114

64

66.7%
(DNS: 0.0%, Conn: 0.0%
T-out: 3.0%, 404s: 24.2%
Robots: 0.0%, Other: 6.1%)

330,426
(11,517)

23,306,414
(773,084)

633,718,514
(19,038,974)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-18-03

19/01/2018 06:01:01

1 min 0 sec

235

184

87.5%
(DNS: 0.0%, Conn: 1.0%
T-out: 0.0%, 404s: 5.2%
Robots: 2.1%, Other: 4.2%)

435,554
(14,090)

22,519,035
(735,505)

369,783,393
(12,113,384)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-17-03

19/01/2018 06:01:01

1 min 0 sec

177

128

88.7%
(DNS: 0.0%, Conn: 0.0%
T-out: 4.8%, 404s: 3.2%
Robots: 0.0%, Other: 3.2%)

529,192
(16,637)

23,025,931
(752,158)

372,018,426
(12,208,170)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-37-01

19/01/2018 06:15:50

16 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

131,657
(4,518)

40,429,379
(1,355,200)

41,817,367
(1,400,573)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-11-02

19/01/2018 06:30:57

31 mins 7 secs

5,183

27

77.5%
(DNS: 2.5%, Conn: 2.3%
T-out: 3.0%, 404s: 7.1%
Robots: 3.0%, Other: 4.6%)

376,885
(13,007)

21,321,666
(709,560)

609,944,415
(18,593,265)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-13-01

19/01/2018 07:15:59

1 hour 16 mins 8 secs

4,894

46

77.6%
(DNS: 2.0%, Conn: 3.0%
T-out: 2.0%, 404s: 9.1%
Robots: 1.7%, Other: 4.6%)

555,147
(17,617)

25,447,113
(843,146)

433,709,391
(14,263,224)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-19-01

19/01/2018 07:16:05

1 hour 16 mins 3 secs

5,225

39

75.0%
(DNS: 2.2%, Conn: 2.0%
T-out: 2.4%, 404s: 9.0%
Robots: 2.2%, Other: 7.2%)

610,301
(20,654)

24,533,124
(815,166)

377,914,361
(12,409,217)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-16-03

19/01/2018 07:16:11

1 hour 16 mins 6 secs

4,073

31

79.3%
(DNS: 1.2%, Conn: 2.3%
T-out: 4.0%, 404s: 7.9%
Robots: 1.7%, Other: 3.6%)

514,252
(18,013)

22,936,344
(766,459)

367,890,518
(12,099,352)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-27-03

19/01/2018 07:45:55

1 hour 46 mins 3 secs

3,687

40

78.3%
(DNS: 1.4%, Conn: 2.0%
T-out: 1.7%, 404s: 9.0%
Robots: 1.5%, Other: 6.1%)

787,257
(27,526)

30,517,161
(1,025,476)

219,769,841
(7,284,061)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-18-02

19/01/2018 10:16:09

4 hours 16 mins 9 secs

4,296

62

80.0%
(DNS: 1.8%, Conn: 1.5%
T-out: 2.4%, 404s: 7.8%
Robots: 2.7%, Other: 3.8%)

1,046,096
(32,880)

23,573,519
(779,446)

373,607,883
(12,258,986)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-15-03

19/01/2018 10:31:00

4 hours 31 mins 9 secs

4,062

44

82.6%
(DNS: 1.6%, Conn: 1.6%
T-out: 2.1%, 404s: 6.6%
Robots: 2.0%, Other: 3.6%)

1,071,335
(35,539)

25,781,501
(854,519)

427,804,823
(14,054,770)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-14-02

19/01/2018 10:31:01

4 hours 31 mins 9 secs

3,689

48

79.5%
(DNS: 1.6%, Conn: 1.4%
T-out: 2.4%, 404s: 8.1%
Robots: 2.8%, Other: 4.4%)

1,040,495
(34,565)

25,203,478
(839,423)

427,817,843
(14,111,014)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-12-03

19/01/2018 10:31:01

4 hours 31 mins 9 secs

4,676

71

80.2%
(DNS: 1.9%, Conn: 1.2%
T-out: 1.6%, 404s: 7.6%
Robots: 3.1%, Other: 4.4%)

1,401,976
(47,949)

28,950,462
(961,290)

556,699,628
(17,633,272)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-11-01

19/01/2018 10:31:01

4 hours 31 mins 9 secs

4,964

69

79.2%
(DNS: 1.4%, Conn: 1.2%
T-out: 2.1%, 404s: 8.0%
Robots: 3.3%, Other: 4.7%)

1,333,352
(45,032)

22,717,402
(752,679)

611,120,412
(18,522,663)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-15-01

19/01/2018 10:31:02

4 hours 31 mins 10 secs

3,533

49

78.8%
(DNS: 1.9%, Conn: 1.6%
T-out: 3.0%, 404s: 7.5%
Robots: 2.3%, Other: 4.9%)

1,036,213
(33,858)

26,161,851
(867,492)

421,811,623
(13,868,275)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-24-03

19/01/2018 10:31:03

4 hours 31 mins 9 secs

3,701

44

80.3%
(DNS: 1.1%, Conn: 1.2%
T-out: 1.7%, 404s: 8.4%
Robots: 2.5%, Other: 4.8%)

1,211,487
(40,125)

31,365,811
(1,043,942)

411,047,708
(13,634,471)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-13-02

19/01/2018 10:31:03

4 hours 31 mins 9 secs

3,516

56

79.7%
(DNS: 1.0%, Conn: 1.6%
T-out: 2.4%, 404s: 8.9%
Robots: 2.4%, Other: 4.0%)

1,252,015
(42,282)

26,156,663
(866,624)

437,388,621
(14,386,691)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-36-01

19/01/2018 10:31:03

4 hours 31 mins 11 secs

4,831

54

80.0%
(DNS: 1.6%, Conn: 1.3%
T-out: 3.5%, 404s: 6.6%
Robots: 2.5%, Other: 4.5%)

856,430
(29,713)

41,288,796
(1,397,720)

42,528,378
(1,438,498)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-25-01

19/01/2018 10:31:04

4 hours 31 mins 10 secs

3,380

38

78.5%
(DNS: 2.6%, Conn: 1.2%
T-out: 2.0%, 404s: 8.2%
Robots: 2.9%, Other: 4.6%)

1,194,699
(39,939)

31,618,198
(1,062,260)

405,780,345
(13,456,352)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-27-02

19/01/2018 10:31:04

4 hours 31 mins 10 secs

3,773

50

82.5%
(DNS: 1.7%, Conn: 1.2%
T-out: 1.9%, 404s: 7.0%
Robots: 2.0%, Other: 3.7%)

1,276,956
(43,495)

31,157,961
(1,043,928)

222,522,196
(7,374,637)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-27-01

19/01/2018 10:31:04

4 hours 31 mins 9 secs

3,435

52

81.4%
(DNS: 1.3%, Conn: 1.9%
T-out: 2.0%, 404s: 7.2%
Robots: 2.5%, Other: 3.8%)

1,282,924
(44,205)

30,724,279
(1,036,232)

219,364,003
(7,314,539)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-21-03

19/01/2018 10:31:04

4 hours 31 mins 9 secs

3,406

36

81.9%
(DNS: 1.1%, Conn: 1.2%
T-out: 1.9%, 404s: 7.5%
Robots: 2.6%, Other: 3.7%)

950,769
(33,326)

30,657,754
(1,021,587)

408,187,971
(13,513,959)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-17-01

19/01/2018 10:31:12

4 hours 31 mins 9 secs

4,168

51

79.5%
(DNS: 1.6%, Conn: 1.3%
T-out: 2.2%, 404s: 7.1%
Robots: 3.5%, Other: 4.8%)

1,231,627
(43,005)

22,801,100
(764,800)

364,866,659
(11,987,301)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-36-02

19/01/2018 10:46:00

4 hours 46 mins 8 secs

5,051

50

81.3%
(DNS: 1.7%, Conn: 1.5%
T-out: 2.2%, 404s: 6.8%
Robots: 2.5%, Other: 4.0%)

1,639,084
(56,977)

44,838,548
(1,516,613)

46,164,060
(1,559,697)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-28-03

19/01/2018 10:46:00

4 hours 46 mins 7 secs

3,314

40

81.5%
(DNS: 1.5%, Conn: 0.9%
T-out: 1.9%, 404s: 7.6%
Robots: 2.4%, Other: 4.2%)

983,459
(33,974)

30,353,611
(1,015,483)

224,108,085
(7,423,523)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-26-03

19/01/2018 10:46:00

4 hours 46 mins 6 secs

3,023

40

81.3%
(DNS: 1.4%, Conn: 1.0%
T-out: 1.3%, 404s: 8.2%
Robots: 3.2%, Other: 3.6%)

905,791
(32,172)

31,173,456
(1,045,764)

220,339,593
(7,325,742)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-22-03

19/01/2018 10:46:00

4 hours 46 mins 6 secs

3,762

46

79.8%
(DNS: 1.5%, Conn: 1.9%
T-out: 2.3%, 404s: 6.8%
Robots: 2.5%, Other: 5.2%)

1,196,213
(41,160)

31,125,582
(1,047,886)

400,767,998
(13,284,643)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-23-02

19/01/2018 10:46:01

4 hours 46 mins 8 secs

3,314

41

79.5%
(DNS: 1.4%, Conn: 1.3%
T-out: 2.8%, 404s: 8.5%
Robots: 2.6%, Other: 3.9%)

1,234,252
(42,696)

32,708,658
(1,106,584)

410,761,137
(13,642,568)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-36-03

19/01/2018 10:46:01

4 hours 46 mins 10 secs

4,649

55

80.9%
(DNS: 1.4%, Conn: 1.2%
T-out: 1.7%, 404s: 7.9%
Robots: 2.9%, Other: 3.9%)

1,473,925
(49,576)

39,211,390
(1,316,957)

40,539,995
(1,361,838)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-28-01

19/01/2018 10:46:02

4 hours 46 mins 9 secs

3,498

38

80.6%
(DNS: 1.7%, Conn: 1.3%
T-out: 2.9%, 404s: 7.9%
Robots: 2.1%, Other: 3.5%)

929,253
(31,833)

31,828,658
(1,054,348)

222,532,831
(7,366,453)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-12-02

19/01/2018 10:46:03

4 hours 46 mins 10 secs

416

4

87.2%
(DNS: 1.1%, Conn: 0.4%
T-out: 1.1%, 404s: 6.2%
Robots: 2.0%, Other: 2.0%)

128,253
(4,800)

4,285,469
(144,148)

109,727,219
(3,198,043)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-14-03

19/01/2018 10:46:03

4 hours 46 mins 11 secs

3,061

45

80.2%
(DNS: 1.6%, Conn: 1.7%
T-out: 2.2%, 404s: 8.2%
Robots: 2.1%, Other: 4.0%)

1,235,292
(41,035)

25,665,554
(858,797)

428,690,006
(14,119,624)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-22-02

19/01/2018 10:46:03

4 hours 46 mins 9 secs

2,775

42

80.6%
(DNS: 1.0%, Conn: 1.4%
T-out: 2.2%, 404s: 7.0%
Robots: 2.4%, Other: 5.4%)

1,051,037
(35,571)

30,362,193
(1,011,664)

407,915,592
(13,498,479)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-21-02

19/01/2018 10:46:03

4 hours 46 mins 9 secs

3,208

37

78.4%
(DNS: 1.9%, Conn: 1.5%
T-out: 1.9%, 404s: 9.1%
Robots: 2.6%, Other: 4.6%)

1,191,437
(40,482)

30,775,084
(1,025,567)

408,448,607
(13,532,931)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-15-02

19/01/2018 10:46:03

4 hours 46 mins 11 secs

2,975

45

80.6%
(DNS: 1.8%, Conn: 1.8%
T-out: 1.9%, 404s: 7.4%
Robots: 2.5%, Other: 4.0%)

1,029,626
(34,699)

24,554,928
(817,728)

423,104,264
(13,978,593)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-21-01

19/01/2018 10:46:03

4 hours 46 mins 9 secs

2,951

37

81.2%
(DNS: 1.4%, Conn: 1.1%
T-out: 1.8%, 404s: 8.2%
Robots: 3.8%, Other: 2.6%)

807,861
(28,397)

31,426,833
(1,051,787)

404,697,220
(13,433,534)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-37-02

19/01/2018 10:46:03

4 hours 46 mins 11 secs

4,598

56

76.5%
(DNS: 3.4%, Conn: 1.4%
T-out: 2.4%, 404s: 7.3%
Robots: 3.0%, Other: 6.0%)

1,599,996
(50,518)

40,693,177
(1,361,469)

42,039,050
(1,406,498)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-12-01

19/01/2018 10:46:03

4 hours 46 mins 11 secs

4,252

62

80.0%
(DNS: 1.2%, Conn: 1.6%
T-out: 1.8%, 404s: 7.1%
Robots: 2.9%, Other: 5.4%)

1,322,266
(45,908)

28,286,514
(942,097)

546,464,064
(17,401,377)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-26-02

19/01/2018 10:46:04

4 hours 46 mins 11 secs

3,363

39

81.8%
(DNS: 0.7%, Conn: 1.5%
T-out: 1.5%, 404s: 7.9%
Robots: 2.6%, Other: 4.1%)

1,150,854
(39,675)

31,974,232
(1,059,086)

218,595,718
(7,298,663)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-24-01

19/01/2018 10:46:05

4 hours 46 mins 11 secs

3,734

41

82.7%
(DNS: 1.3%, Conn: 1.9%
T-out: 2.0%, 404s: 7.2%
Robots: 2.2%, Other: 2.6%)

1,024,998
(34,827)

31,730,040
(1,066,257)

406,223,430
(13,464,430)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-28-02

19/01/2018 10:46:05

4 hours 46 mins 12 secs

3,319

48

79.0%
(DNS: 1.2%, Conn: 1.3%
T-out: 1.8%, 404s: 10.0%
Robots: 2.4%, Other: 4.3%)

1,196,345
(39,400)

31,901,090
(1,067,012)

220,747,472
(7,333,093)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-14-01

19/01/2018 10:46:06

4 hours 46 mins 13 secs

3,914

45

79.7%
(DNS: 1.0%, Conn: 2.2%
T-out: 2.1%, 404s: 7.7%
Robots: 2.5%, Other: 4.7%)

1,193,321
(41,709)

25,773,976
(854,459)

426,707,215
(14,064,949)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-13-03

19/01/2018 10:46:06

4 hours 46 mins 13 secs

3,322

53

79.9%
(DNS: 1.4%, Conn: 1.7%
T-out: 3.5%, 404s: 7.3%
Robots: 2.6%, Other: 3.7%)

1,170,595
(39,298)

25,636,104
(853,066)

423,829,407
(13,932,804)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-23-03

19/01/2018 10:46:06

4 hours 46 mins 12 secs

3,952

41

81.5%
(DNS: 1.5%, Conn: 1.3%
T-out: 2.2%, 404s: 7.8%
Robots: 2.1%, Other: 3.5%)

846,920
(29,320)

33,112,224
(1,117,289)

407,079,063
(13,501,445)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-18-01

19/01/2018 10:46:14

4 hours 46 mins 11 secs

3,950

52

79.8%
(DNS: 2.1%, Conn: 1.7%
T-out: 1.9%, 404s: 6.8%
Robots: 3.3%, Other: 4.4%)

1,266,479
(43,191)

23,326,113
(771,050)

367,132,751
(12,045,159)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-19-03

19/01/2018 10:46:14

4 hours 46 mins 10 secs

3,971

53

78.7%
(DNS: 1.3%, Conn: 1.6%
T-out: 2.2%, 404s: 7.5%
Robots: 2.5%, Other: 6.2%)

1,194,175
(38,094)

24,407,836
(810,575)

371,108,059
(12,203,882)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-16-01

19/01/2018 10:46:14

4 hours 46 mins 11 secs

3,651

48

79.1%
(DNS: 1.5%, Conn: 2.0%
T-out: 2.6%, 404s: 7.7%
Robots: 3.4%, Other: 3.7%)

1,029,477
(35,302)

24,267,160
(807,988)

364,214,495
(11,951,985)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-19-02

19/01/2018 10:46:15

4 hours 46 mins 12 secs

4,194

50

81.1%
(DNS: 1.2%, Conn: 1.3%
T-out: 2.5%, 404s: 7.3%
Robots: 3.1%, Other: 3.5%)

1,161,217
(38,440)

24,112,156
(803,557)

378,081,965
(12,408,352)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-17-02

19/01/2018 10:46:17

4 hours 46 mins 15 secs

3,654

42

80.2%
(DNS: 1.3%, Conn: 1.7%
T-out: 2.4%, 404s: 8.0%
Robots: 2.5%, Other: 3.9%)

1,112,880
(39,050)

23,697,012
(791,207)

368,352,210
(12,118,222)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-16-02

19/01/2018 10:46:21

4 hours 46 mins 18 secs

3,695

49

81.6%
(DNS: 1.2%, Conn: 1.3%
T-out: 2.0%, 404s: 7.0%
Robots: 2.5%, Other: 4.3%)

1,073,790
(33,808)

24,366,284
(811,092)

364,197,229
(11,970,060)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-37-03

19/01/2018 10:46:25

4 hours 46 mins 33 secs

4,380

65

80.5%
(DNS: 1.5%, Conn: 1.1%
T-out: 2.5%, 404s: 6.8%
Robots: 2.4%, Other: 5.2%)

1,787,406
(58,890)

41,444,406
(1,382,217)

42,338,379
(1,410,104)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-26-01

19/01/2018 10:59:06

4 hours 46 mins 12 secs

2,674

35

78.0%
(DNS: 1.9%, Conn: 1.7%
T-out: 3.0%, 404s: 7.7%
Robots: 2.8%, Other: 4.9%)

880,954
(31,690)

31,625,461
(1,055,758)

225,220,341
(7,459,317)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-25-03

19/01/2018 10:59:33

4 hours 31 mins 10 secs

3,068

46

78.6%
(DNS: 1.4%, Conn: 1.3%
T-out: 3.8%, 404s: 7.9%
Robots: 2.6%, Other: 4.4%)

969,491
(33,212)

33,081,613
(1,103,371)

406,803,800
(13,494,635)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-24-02

19/01/2018 10:59:51

4 hours 31 mins 9 secs

3,191

41

79.0%
(DNS: 2.5%, Conn: 1.8%
T-out: 2.3%, 404s: 7.9%
Robots: 3.2%, Other: 3.3%)

999,872
(34,802)

32,034,592
(1,067,855)

403,481,414
(13,371,837)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-23-01

19/01/2018 10:59:51

4 hours 46 mins 10 secs

3,618

43

81.2%
(DNS: 1.3%, Conn: 1.2%
T-out: 1.6%, 404s: 7.5%
Robots: 2.5%, Other: 4.8%)

907,923
(31,583)

32,943,399
(1,112,834)

408,622,838
(13,532,113)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-25-02

19/01/2018 10:59:57

4 hours 46 mins 10 secs

3,004

38

82.1%
(DNS: 1.9%, Conn: 1.4%
T-out: 2.0%, 404s: 7.4%
Robots: 2.0%, Other: 3.2%)

918,000
(30,674)

31,881,670
(1,064,592)

406,123,793
(13,450,575)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-22-01

19/01/2018 10:59:58

4 hours 46 mins 11 secs

3,347

53

78.7%
(DNS: 2.1%, Conn: 1.9%
T-out: 3.0%, 404s: 8.0%
Robots: 2.3%, Other: 4.1%)

1,040,692
(34,700)

31,124,067
(1,046,622)

407,864,425
(13,515,867)

Total (72 nodes)

301,108

3,385

-

58,110,179
(1,966,955)

2,070,069,213
(69,032,708)

36,330,312,427
(1,149,194,009)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 19 Jan 2018 11:00:47:973 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12