Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

refic

Country:

Finland Finland

ID:

233

Team:

Team Norway (Join this team)

Joined:

27/09/2005 17:25:00

URLs crawled:

588,427,043,140

Data (MB)*:

15,018,030,429

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.15 Update 2 (.NET 4.5)   Linux

992

14/01/2017 15:31:52

4 hours 31 mins 8 secs

9,946

108

79.1%
(DNS: 1.4%, Conn: 1.1%
T-out: 2.5%, 404s: 8.9%
Robots: 3.1%, Other: 3.9%)

0
(0)

145,749,874
(4,744,837)

414,619,234
(14,037,687)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

19/01/2017 07:48:34

1 hour 46 mins 2 secs

10,392

52

82.0%
(DNS: 1.1%, Conn: 1.4%
T-out: 3.0%, 404s: 7.6%
Robots: 1.6%, Other: 3.3%)

0
(0)

177,753,837
(5,816,282)

447,903,977
(15,142,183)

v1.7.15 Update 2 (.NET 4.5)   Linux

988

20/01/2017 15:47:22

16 mins 0 sec

11,604

6

76.3%
(DNS: 2.4%, Conn: 1.4%
T-out: 3.8%, 404s: 10.4%
Robots: 2.5%, Other: 3.0%)

2,829,110
(93,041)

173,291,453
(5,671,440)

456,299,817
(15,433,976)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/01/2017 15:47:49

4 hours 46 mins 7 secs

7,925

93

80.6%
(DNS: 1.3%, Conn: 1.2%
T-out: 2.4%, 404s: 7.9%
Robots: 3.0%, Other: 3.6%)

3,255,303
(106,953)

173,420,552
(5,679,478)

452,253,534
(15,283,240)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

20/01/2017 15:48:23

1 hour 46 mins 3 secs

10,054

59

78.8%
(DNS: 1.8%, Conn: 0.8%
T-out: 2.1%, 404s: 9.3%
Robots: 3.8%, Other: 3.3%)

3,282,233
(106,745)

183,466,587
(5,988,995)

445,210,751
(15,098,656)

v1.7.15 Update 2 (.NET 4.5)   Linux

996

20/01/2017 15:48:29

1 hour 16 mins 3 secs

14,127

47

77.0%
(DNS: 1.8%, Conn: 3.8%
T-out: 0.4%, 404s: 9.5%
Robots: 3.3%, Other: 4.1%)

3,218,664
(107,017)

172,869,754
(5,626,317)

449,808,290
(15,173,617)

v1.7.15 Update 2 (.NET 4.5)   Linux

992

20/01/2017 15:48:46

4 hours 31 mins 6 secs

8,120

103

80.6%
(DNS: 1.2%, Conn: 0.8%
T-out: 4.0%, 404s: 7.2%
Robots: 3.0%, Other: 3.3%)

3,436,887
(113,099)

174,245,262
(5,705,217)

453,275,377
(15,311,938)

v1.7.15 Update 2 (.NET 4.5)   Linux

983

20/01/2017 15:48:52

5 hours 31 mins 10 secs

9,044

107

80.5%
(DNS: 1.9%, Conn: 1.0%
T-out: 2.6%, 404s: 7.2%
Robots: 3.1%, Other: 3.6%)

3,206,260
(107,782)

179,024,742
(5,845,801)

462,873,710
(15,605,456)

v1.7.15 Update 2 (.NET 4.5)   Linux

983

20/01/2017 15:49:03

4 hours 1 min 6 secs

8,110

100

80.4%
(DNS: 1.2%, Conn: 0.9%
T-out: 3.2%, 404s: 7.4%
Robots: 3.1%, Other: 3.9%)

2,587,004
(85,969)

178,991,075
(5,842,421)

461,540,897
(15,570,072)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/01/2017 15:49:23

1 hour 1 min 2 secs

12,713

48

77.9%
(DNS: 2.1%, Conn: 1.3%
T-out: 2.3%, 404s: 9.8%
Robots: 3.1%, Other: 3.5%)

3,202,429
(106,780)

174,778,199
(5,721,175)

460,561,066
(15,567,513)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

20/01/2017 15:49:29

1 hour 31 mins 2 secs

11,807

58

78.0%
(DNS: 1.8%, Conn: 1.5%
T-out: 3.1%, 404s: 8.6%
Robots: 3.2%, Other: 3.8%)

3,400,657
(111,461)

96,817,387
(3,203,293)

339,614,776
(11,616,342)

v1.7.15 Update 2 (.NET 4.5)   Linux

996

20/01/2017 15:49:29

5 hours 1 min 10 secs

8,700

69

80.2%
(DNS: 1.3%, Conn: 3.9%
T-out: 0.4%, 404s: 7.7%
Robots: 2.7%, Other: 3.9%)

2,993,663
(97,632)

174,708,329
(5,676,249)

449,854,645
(15,194,703)

v1.7.15 Update 2 (.NET 4.5)   Linux

987

20/01/2017 15:49:40

5 hours 31 mins 10 secs

8,074

95

79.7%
(DNS: 1.8%, Conn: 1.0%
T-out: 3.2%, 404s: 8.0%
Robots: 2.8%, Other: 3.6%)

3,250,317
(106,855)

179,321,964
(5,864,764)

459,802,154
(15,544,360)

v1.7.15 Update 2 (.NET 4.5)   Linux

996

20/01/2017 15:49:42

1 hour 16 mins 3 secs

15,155

54

77.2%
(DNS: 2.2%, Conn: 3.5%
T-out: 0.5%, 404s: 8.8%
Robots: 3.6%, Other: 4.3%)

3,024,136
(97,017)

172,999,793
(5,627,376)

449,237,461
(15,186,351)

v1.7.15 Update 2 (.NET 4.5)   Linux

996

20/01/2017 15:49:42

1 hour 16 mins 4 secs

15,647

64

77.9%
(DNS: 1.5%, Conn: 5.1%
T-out: 0.4%, 404s: 8.0%
Robots: 3.3%, Other: 3.7%)

3,218,051
(105,174)

176,067,010
(5,740,317)

455,158,112
(15,387,054)

v1.7.15 Update 2 (.NET 4.5)   Linux

993

20/01/2017 15:49:53

1 hour 1 min 0 sec

14,370

62

77.8%
(DNS: 1.2%, Conn: 5.5%
T-out: 0.3%, 404s: 8.9%
Robots: 2.9%, Other: 3.3%)

3,022,019
(98,492)

173,496,041
(5,663,835)

459,965,838
(15,540,318)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/01/2017 15:50:01

5 hours 31 mins 10 secs

8,542

102

79.0%
(DNS: 1.7%, Conn: 1.0%
T-out: 3.1%, 404s: 7.8%
Robots: 3.0%, Other: 4.4%)

3,226,742
(107,276)

154,053,817
(5,056,573)

436,512,422
(14,750,669)

v1.7.15 Update 2 (.NET 4.5)   Linux

993

20/01/2017 15:50:10

4 hours 1 min 6 secs

8,148

101

79.0%
(DNS: 1.8%, Conn: 4.2%
T-out: 0.2%, 404s: 8.0%
Robots: 3.2%, Other: 3.7%)

3,303,095
(109,254)

170,801,545
(5,557,895)

457,150,887
(15,451,324)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/01/2017 15:50:13

31 mins 2 secs

10,500

79

76.8%
(DNS: 1.1%, Conn: 1.6%
T-out: 3.1%, 404s: 10.5%
Robots: 3.5%, Other: 3.5%)

3,006,724
(98,319)

174,849,351
(5,717,547)

459,579,119
(15,517,582)

v1.7.15 Update 2 (.NET 4.5)   Linux

992

20/01/2017 15:50:14

1 hour 31 mins 2 secs

12,850

43

79.3%
(DNS: 2.4%, Conn: 1.0%
T-out: 3.3%, 404s: 8.3%
Robots: 2.7%, Other: 3.0%)

2,791,522
(90,326)

178,959,376
(5,844,323)

459,104,996
(15,547,229)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

20/01/2017 15:50:28

1 hour 1 min 2 secs

14,673

74

79.5%
(DNS: 1.0%, Conn: 0.7%
T-out: 2.1%, 404s: 9.2%
Robots: 3.9%, Other: 3.7%)

3,278,420
(107,188)

183,335,328
(6,004,359)

446,376,705
(15,159,025)

v1.7.15 Update 2 (.NET 4.5)   Linux

983

20/01/2017 15:50:32

5 hours 46 mins 11 secs

9,085

107

81.0%
(DNS: 1.5%, Conn: 1.0%
T-out: 2.7%, 404s: 7.4%
Robots: 2.6%, Other: 3.8%)

3,282,439
(106,815)

180,702,528
(5,913,567)

466,521,339
(15,768,106)

v1.7.15 Update 2 (.NET 4.5)   Linux

992

20/01/2017 15:50:47

5 hours 16 mins 10 secs

7,868

71

80.5%
(DNS: 2.4%, Conn: 1.1%
T-out: 2.9%, 404s: 7.2%
Robots: 2.5%, Other: 3.5%)

3,069,249
(100,579)

176,176,619
(5,755,549)

451,810,809
(15,315,123)

v1.7.15 Update 2 (.NET 4.5)   Linux

987

20/01/2017 15:51:10

4 hours 46 mins 7 secs

6,961

92

81.0%
(DNS: 2.5%, Conn: 1.4%
T-out: 2.9%, 404s: 6.2%
Robots: 2.8%, Other: 3.2%)

3,309,289
(109,220)

178,844,912
(5,866,862)

464,702,979
(15,712,332)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/01/2017 15:51:10

1 hour 31 mins 4 secs

8,550

48

75.8%
(DNS: 2.6%, Conn: 0.9%
T-out: 2.5%, 404s: 10.3%
Robots: 3.4%, Other: 4.4%)

3,060,038
(102,905)

173,897,149
(5,692,612)

459,721,847
(15,549,906)

v1.7.15 Update 2 (.NET 4.5)   Linux

983

20/01/2017 15:51:18

5 hours 46 mins 9 secs

8,769

107

79.8%
(DNS: 2.3%, Conn: 1.3%
T-out: 2.7%, 404s: 7.0%
Robots: 2.5%, Other: 4.4%)

3,149,712
(104,611)

179,508,877
(5,876,398)

460,243,392
(15,556,280)

v1.7.15 Update 2 (.NET 4.5)   Linux

987

20/01/2017 15:51:33

5 hours 16 mins 9 secs

9,081

118

80.8%
(DNS: 1.9%, Conn: 0.9%
T-out: 2.6%, 404s: 7.5%
Robots: 2.5%, Other: 3.7%)

3,457,108
(116,480)

181,185,787
(5,916,762)

458,223,095
(15,549,145)

v1.7.15 Update 2 (.NET 4.5)   Linux

983

20/01/2017 15:51:35

5 hours 16 mins 9 secs

8,719

94

79.4%
(DNS: 2.4%, Conn: 1.3%
T-out: 2.8%, 404s: 8.0%
Robots: 2.3%, Other: 3.8%)

3,170,802
(104,026)

177,682,205
(5,787,060)

458,549,312
(15,478,890)

v1.7.15 Update 2 (.NET 4.5)   Linux

996

20/01/2017 15:51:40

1 hour 46 mins 3 secs

11,289

63

76.7%
(DNS: 2.0%, Conn: 4.0%
T-out: 0.6%, 404s: 9.6%
Robots: 3.3%, Other: 3.8%)

3,229,284
(105,230)

175,297,911
(5,720,771)

452,595,848
(15,332,680)

v1.7.15 Update 2 (.NET 4.5)   Linux

993

20/01/2017 15:51:51

2 hours 1 min 2 secs

9,924

53

78.9%
(DNS: 1.3%, Conn: 2.9%
T-out: 0.4%, 404s: 9.1%
Robots: 3.1%, Other: 4.3%)

3,225,882
(107,032)

173,917,102
(5,680,106)

454,716,443
(15,366,791)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

20/01/2017 15:51:55

1 min 0 sec

389

161

94.3%
(DNS: 0.0%, Conn: 0.0%
T-out: 1.1%, 404s: 2.3%
Robots: 0.0%, Other: 2.3%)

3,420,756
(111,484)

109,196,002
(3,577,454)

378,163,036
(12,859,040)

v1.7.15 Update 2 (.NET 4.5)   Linux

993

20/01/2017 15:51:59

1 hour 1 min 2 secs

11,904

56

76.4%
(DNS: 1.5%, Conn: 4.5%
T-out: 0.3%, 404s: 10.4%
Robots: 3.1%, Other: 3.8%)

3,017,168
(100,057)

176,079,842
(5,746,871)

459,613,601
(15,557,301)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/01/2017 15:52:10

5 hours 31 mins 9 secs

8,368

100

81.1%
(DNS: 1.7%, Conn: 1.2%
T-out: 2.4%, 404s: 7.2%
Robots: 2.7%, Other: 3.8%)

3,243,413
(108,272)

174,849,156
(5,696,259)

459,807,893
(15,475,691)

v1.7.15 Update 2 (.NET 4.5)   Linux

987

20/01/2017 15:52:16

5 hours 46 mins 9 secs

8,534

112

80.7%
(DNS: 1.8%, Conn: 0.8%
T-out: 3.0%, 404s: 6.9%
Robots: 2.8%, Other: 3.9%)

3,399,196
(111,586)

178,327,075
(5,855,262)

462,735,348
(15,661,984)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/01/2017 15:52:19

46 mins 2 secs

13,531

75

78.4%
(DNS: 1.9%, Conn: 1.4%
T-out: 2.0%, 404s: 8.7%
Robots: 3.0%, Other: 4.5%)

3,163,813
(107,362)

176,883,926
(5,785,079)

464,295,515
(15,721,819)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/01/2017 15:52:21

4 hours 46 mins 7 secs

7,504

102

80.8%
(DNS: 1.3%, Conn: 0.8%
T-out: 2.5%, 404s: 7.9%
Robots: 3.2%, Other: 3.4%)

3,293,882
(107,107)

174,531,867
(5,713,384)

459,961,879
(15,507,048)

v1.7.15 Update 2 (.NET 4.5)   Linux

988

20/01/2017 15:52:24

16 mins 1 sec

10,067

112

78.2%
(DNS: 0.4%, Conn: 1.1%
T-out: 4.0%, 404s: 10.0%
Robots: 2.0%, Other: 4.3%)

2,867,365
(95,694)

173,167,651
(5,681,438)

457,036,151
(15,508,823)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

20/01/2017 15:52:37

1 min 0 sec

393

78

89.6%
(DNS: 0.0%, Conn: 0.0%
T-out: 1.5%, 404s: 7.5%
Robots: 0.0%, Other: 1.5%)

3,176,756
(103,724)

181,079,776
(5,940,429)

441,791,669
(14,985,195)

v1.7.15 Update 2 (.NET 4.5)   Linux

983

20/01/2017 15:52:43

5 hours 46 mins 10 secs

8,402

104

78.6%
(DNS: 2.4%, Conn: 1.3%
T-out: 3.9%, 404s: 7.5%
Robots: 3.0%, Other: 3.2%)

3,239,065
(106,196)

78,140,145
(2,595,318)

347,476,799
(11,875,817)

v1.7.15 Update 2 (.NET 4.5)   Linux

993

20/01/2017 15:52:58

1 hour 31 mins 4 secs

12,950

55

78.9%
(DNS: 1.5%, Conn: 3.3%
T-out: 0.4%, 404s: 9.1%
Robots: 2.8%, Other: 4.0%)

2,970,026
(96,133)

172,737,336
(5,643,325)

454,341,415
(15,358,754)

v1.7.15 Update 2 (.NET 4.5)   Linux

988

20/01/2017 15:53:08

5 hours 46 mins 10 secs

7,719

102

80.0%
(DNS: 1.9%, Conn: 1.6%
T-out: 2.9%, 404s: 7.0%
Robots: 2.4%, Other: 4.1%)

3,269,962
(107,416)

172,703,780
(5,641,854)

455,652,286
(15,398,206)

v1.7.15 Update 2 (.NET 4.5)   Linux

993

20/01/2017 15:53:13

46 mins 2 secs

12,955

78

77.7%
(DNS: 3.0%, Conn: 2.8%
T-out: 0.9%, 404s: 9.0%
Robots: 2.8%, Other: 3.8%)

2,865,961
(97,433)

173,652,326
(5,680,929)

459,874,215
(15,569,509)

v1.7.15 Update 2 (.NET 4.5)   Linux

983

20/01/2017 15:53:15

4 hours 31 mins 7 secs

8,192

103

80.0%
(DNS: 2.2%, Conn: 1.0%
T-out: 3.2%, 404s: 7.8%
Robots: 2.9%, Other: 2.9%)

3,387,965
(110,390)

181,646,234
(5,947,731)

465,818,010
(15,720,569)

v1.7.15 Update 2 (.NET 4.5)   Linux

988

20/01/2017 15:53:16

5 hours 46 mins 10 secs

8,711

74

80.7%
(DNS: 1.4%, Conn: 1.2%
T-out: 3.5%, 404s: 7.2%
Robots: 2.7%, Other: 3.3%)

2,894,548
(93,659)

173,227,668
(5,667,733)

457,699,001
(15,495,449)

v1.7.15 Update 2 (.NET 4.5)   Linux

987

20/01/2017 15:53:19

4 hours 16 mins 9 secs

8,468

104

79.5%
(DNS: 2.1%, Conn: 1.5%
T-out: 3.5%, 404s: 7.2%
Robots: 2.6%, Other: 3.5%)

3,388,144
(114,840)

178,341,265
(5,864,953)

462,371,857
(15,651,840)

v1.7.15 Update 2 (.NET 4.5)   Linux

987

20/01/2017 15:53:29

46 mins 3 secs

13,096

89

77.6%
(DNS: 2.7%, Conn: 1.2%
T-out: 2.5%, 404s: 9.8%
Robots: 2.7%, Other: 3.5%)

3,415,232
(112,566)

178,832,667
(5,851,742)

459,680,369
(15,545,135)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

20/01/2017 15:53:29

1 min 0 sec

212

120

86.7%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.6%, 404s: 5.7%
Robots: 2.5%, Other: 4.4%)

3,405,876
(113,344)

184,385,658
(6,023,483)

447,193,588
(15,138,207)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/01/2017 15:53:54

1 hour 16 mins 3 secs

14,255

61

79.3%
(DNS: 2.0%, Conn: 1.1%
T-out: 3.2%, 404s: 7.6%
Robots: 2.9%, Other: 3.9%)

3,202,395
(108,012)

179,521,149
(5,874,821)

465,256,386
(15,748,447)

v1.7.15 Update 2 (.NET 4.5)   Linux

993

20/01/2017 15:54:29

3 hours 1 min 2 secs

7,443

84

77.8%
(DNS: 2.6%, Conn: 4.1%
T-out: 0.3%, 404s: 9.0%
Robots: 2.9%, Other: 3.4%)

3,252,669
(106,373)

174,945,432
(5,701,167)

459,884,367
(15,553,092)

v1.7.15 Update 2 (.NET 4.5)   Linux

996

20/01/2017 15:54:31

1 hour 31 mins 3 secs

13,272

53

79.0%
(DNS: 1.8%, Conn: 3.2%
T-out: 0.3%, 404s: 8.7%
Robots: 3.6%, Other: 3.4%)

3,236,077
(106,077)

173,860,779
(5,664,634)

450,964,233
(15,281,969)

v1.7.15 Update 2 (.NET 4.5)   Linux

992

20/01/2017 15:54:37

4 hours 46 mins 8 secs

8,477

78

79.8%
(DNS: 2.1%, Conn: 1.1%
T-out: 3.0%, 404s: 7.4%
Robots: 2.3%, Other: 4.3%)

2,719,511
(89,117)

179,211,524
(5,870,382)

455,936,963
(15,448,846)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/01/2017 15:54:56

1 min 0 sec

402

69

93.5%
(DNS: 0.0%, Conn: 0.0%
T-out: 2.2%, 404s: 4.3%
Robots: 0.0%, Other: 0.0%)

3,269,504
(108,300)

175,082,920
(5,738,154)

462,670,252
(15,641,297)

v1.7.15 Update 2 (.NET 4.5)   Linux

996

20/01/2017 15:55:02

1 hour 16 mins 3 secs

15,324

59

77.7%
(DNS: 2.2%, Conn: 4.2%
T-out: 0.3%, 404s: 9.1%
Robots: 2.9%, Other: 3.5%)

3,271,086
(108,221)

172,623,036
(5,619,380)

451,734,020
(15,284,559)

v1.7.15 Update 2 (.NET 4.5)   Linux

987

20/01/2017 15:55:22

16 mins 1 sec

9,522

91

78.7%
(DNS: 1.0%, Conn: 2.2%
T-out: 4.2%, 404s: 6.8%
Robots: 3.2%, Other: 3.9%)

2,958,867
(96,629)

178,535,448
(5,820,477)

464,493,524
(15,650,064)

v1.7.15 Update 2 (.NET 4.5)   Linux

992

20/01/2017 15:55:30

5 hours 31 mins 7 secs

9,201

104

80.5%
(DNS: 1.8%, Conn: 1.1%
T-out: 2.6%, 404s: 7.4%
Robots: 2.8%, Other: 3.8%)

3,525,289
(119,024)

77,678,367
(2,588,688)

342,844,642
(11,820,888)

v1.7.15 Update 2 (.NET 4.5)   Linux

992

20/01/2017 15:55:36

5 hours 46 mins 11 secs

7,833

88

79.1%
(DNS: 2.0%, Conn: 1.2%
T-out: 2.9%, 404s: 7.7%
Robots: 2.9%, Other: 4.2%)

3,335,574
(109,505)

176,429,752
(5,779,994)

455,064,707
(15,402,681)

v1.7.15 Update 2 (.NET 4.5)   Linux

983

20/01/2017 15:55:37

16 mins 1 sec

11,056

90

78.9%
(DNS: 1.4%, Conn: 0.7%
T-out: 3.6%, 404s: 8.8%
Robots: 2.3%, Other: 4.3%)

3,324,715
(108,115)

178,437,823
(5,819,705)

459,889,786
(15,516,577)

v1.7.15 Update 2 (.NET 4.5)   Linux

988

20/01/2017 15:55:43

5 hours 1 min 10 secs

7,929

102

81.4%
(DNS: 1.5%, Conn: 1.3%
T-out: 3.0%, 404s: 6.6%
Robots: 2.9%, Other: 3.4%)

3,403,435
(112,498)

171,765,598
(5,605,792)

455,230,228
(15,404,105)

v1.7.15 Update 2 (.NET 4.5)   Linux

983

20/01/2017 15:56:14

5 hours 46 mins 8 secs

8,198

101

78.6%
(DNS: 1.9%, Conn: 1.2%
T-out: 3.0%, 404s: 8.3%
Robots: 3.3%, Other: 3.7%)

3,247,267
(106,205)

178,851,181
(5,855,138)

462,705,759
(15,623,204)

v1.7.15 Update 2 (.NET 4.5)   Linux

993

20/01/2017 15:57:38

4 hours 16 mins 5 secs

8,361

94

79.9%
(DNS: 1.8%, Conn: 3.1%
T-out: 0.5%, 404s: 7.8%
Robots: 3.1%, Other: 3.7%)

3,175,643
(105,189)

174,005,066
(5,688,856)

453,837,337
(15,358,718)

v1.7.15 Update 2 (.NET 4.5)   Linux

993

20/01/2017 15:57:56

2 hours 16 mins 4 secs

9,647

48

77.5%
(DNS: 2.2%, Conn: 4.2%
T-out: 0.7%, 404s: 9.7%
Robots: 2.3%, Other: 3.5%)

3,237,525
(105,454)

174,707,570
(5,678,481)

461,804,108
(15,592,727)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/01/2017 15:58:13

1 hour 31 mins 3 secs

10,981

146

74.9%
(DNS: 2.7%, Conn: 1.3%
T-out: 3.5%, 404s: 9.4%
Robots: 3.7%, Other: 4.4%)

2,910,275
(96,505)

176,684,762
(5,790,416)

463,683,486
(15,720,051)

v1.7.15 Update 2 (.NET 4.5)   Linux

988

20/01/2017 15:58:15

3 hours 46 mins 5 secs

6,308

84

78.1%
(DNS: 2.5%, Conn: 1.3%
T-out: 3.5%, 404s: 7.8%
Robots: 2.6%, Other: 4.1%)

3,154,029
(105,544)

175,421,052
(5,740,155)

460,655,741
(15,598,514)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/01/2017 15:58:31

5 hours 46 mins 11 secs

8,572

106

79.6%
(DNS: 2.3%, Conn: 1.0%
T-out: 3.4%, 404s: 7.3%
Robots: 2.8%, Other: 3.5%)

3,252,408
(106,566)

172,701,101
(5,664,868)

458,928,604
(15,512,517)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/01/2017 15:58:59

5 hours 31 mins 9 secs

8,356

100

79.9%
(DNS: 1.4%, Conn: 1.2%
T-out: 4.1%, 404s: 7.1%
Robots: 2.6%, Other: 3.7%)

3,235,194
(107,588)

175,060,812
(5,718,339)

457,162,374
(15,465,850)

v1.7.15 Update 2 (.NET 4.5)   Linux

996

20/01/2017 15:59:06

5 hours 31 mins 9 secs

8,628

100

80.7%
(DNS: 1.4%, Conn: 3.6%
T-out: 0.4%, 404s: 7.0%
Robots: 3.2%, Other: 3.8%)

3,330,709
(107,095)

175,135,379
(5,688,596)

448,711,533
(15,165,416)

v1.7.15 Update 2 (.NET 4.5)   Linux

988

20/01/2017 15:59:07

1 hour 31 mins 4 secs

10,896

57

75.5%
(DNS: 1.8%, Conn: 1.5%
T-out: 3.3%, 404s: 9.9%
Robots: 3.3%, Other: 4.6%)

3,327,614
(112,335)

173,693,257
(5,669,979)

448,322,976
(15,152,923)

v1.7.15 Update 2 (.NET 4.5)   Linux

987

20/01/2017 15:59:10

4 hours 31 mins 8 secs

8,048

99

79.5%
(DNS: 1.8%, Conn: 1.4%
T-out: 2.6%, 404s: 7.7%
Robots: 3.3%, Other: 3.8%)

3,420,555
(112,837)

150,305,765
(4,932,221)

432,213,879
(14,681,055)

v1.7.15 Update 2 (.NET 4.5)   Linux

992

20/01/2017 15:59:13

2 hours 1 min 3 secs

10,428

62

78.5%
(DNS: 2.5%, Conn: 0.9%
T-out: 2.9%, 404s: 8.0%
Robots: 3.4%, Other: 3.9%)

3,323,288
(110,589)

177,650,084
(5,823,618)

454,858,303
(15,437,550)

v1.7.15 Update 2 (.NET 4.5)   Linux

992

20/01/2017 15:59:42

5 hours 46 mins 11 secs

9,136

104

80.6%
(DNS: 1.8%, Conn: 1.1%
T-out: 2.3%, 404s: 7.9%
Robots: 2.9%, Other: 3.4%)

3,537,030
(117,729)

178,663,874
(5,843,580)

459,026,243
(15,551,827)

v1.7.15 Update 2 (.NET 4.5)   Linux

993

20/01/2017 15:59:53

1 hour 46 mins 3 secs

11,307

61

77.9%
(DNS: 1.7%, Conn: 4.7%
T-out: 0.7%, 404s: 9.1%
Robots: 2.5%, Other: 3.4%)

3,255,478
(108,406)

173,998,817
(5,685,042)

455,092,328
(15,379,783)

v1.7.15 Update 2 (.NET 4.5)   Linux

983

20/01/2017 15:59:56

1 hour 1 min 1 sec

11,483

20

76.5%
(DNS: 2.3%, Conn: 1.5%
T-out: 4.3%, 404s: 9.0%
Robots: 2.9%, Other: 3.5%)

3,289,545
(108,600)

177,294,609
(5,798,595)

461,554,973
(15,590,317)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

20/01/2017 15:59:59

1 min 0 sec

372

184

53.9%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.0%, 404s: 2.9%
Robots: 0.0%, Other: 43.1%)

3,404,523
(108,668)

184,455,962
(6,032,463)

453,432,818
(15,325,314)

v1.7.15 Update 2 (.NET 4.5)   Linux

992

20/01/2017 16:00:00

4 hours 31 mins 5 secs

8,733

107

80.0%
(DNS: 1.9%, Conn: 0.8%
T-out: 3.2%, 404s: 7.7%
Robots: 3.3%, Other: 3.3%)

3,529,935
(117,430)

175,663,500
(5,750,966)

453,466,910
(15,405,446)

v1.7.15 Update 2 (.NET 4.5)   Linux

988

20/01/2017 16:00:04

1 min 0 sec

1,989

80

68.2%
(DNS: 4.9%, Conn: 0.0%
T-out: 0.0%, 404s: 6.8%
Robots: 14.7%, Other: 5.4%)

3,275,812
(107,016)

175,246,052
(5,717,108)

458,677,382
(15,497,023)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/01/2017 16:00:19

4 hours 31 mins 6 secs

7,080

86

78.2%
(DNS: 2.7%, Conn: 1.3%
T-out: 2.9%, 404s: 8.8%
Robots: 2.8%, Other: 3.1%)

3,101,764
(101,271)

176,936,224
(5,776,986)

464,155,716
(15,642,479)

v1.7.15 Update 2 (.NET 4.5)   Linux

988

20/01/2017 16:00:33

1 min 0 sec

267

161

96.7%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.0%, 404s: 3.3%
Robots: 0.0%, Other: 0.0%)

2,734,994
(91,027)

168,657,447
(5,547,626)

451,300,338
(15,296,087)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/01/2017 16:00:59

1 hour 16 mins 2 secs

11,636

53

77.4%
(DNS: 1.8%, Conn: 1.6%
T-out: 2.8%, 404s: 10.0%
Robots: 2.6%, Other: 3.7%)

3,128,108
(103,843)

176,625,485
(5,743,290)

462,405,111
(15,594,917)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/01/2017 16:00:59

1 hour 16 mins 2 secs

12,975

62

78.5%
(DNS: 1.3%, Conn: 1.9%
T-out: 2.4%, 404s: 8.9%
Robots: 3.5%, Other: 3.5%)

3,009,147
(97,602)

176,840,026
(5,754,425)

453,141,683
(15,276,612)

v1.7.15 Update 2 (.NET 4.5)   Linux

996

20/01/2017 16:01:23

2 hours 16 mins 3 secs

8,047

54

77.4%
(DNS: 1.6%, Conn: 4.6%
T-out: 0.5%, 404s: 9.0%
Robots: 3.5%, Other: 3.5%)

3,295,228
(110,010)

175,276,126
(5,710,606)

449,817,432
(15,230,788)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/01/2017 16:01:31

1 hour 16 mins 3 secs

14,396

47

76.7%
(DNS: 1.8%, Conn: 1.1%
T-out: 2.9%, 404s: 9.4%
Robots: 2.9%, Other: 5.1%)

3,124,217
(106,218)

127,188,992
(4,179,047)

416,458,647
(14,152,848)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/01/2017 16:01:33

1 hour 16 mins 2 secs

13,764

57

77.0%
(DNS: 2.6%, Conn: 2.0%
T-out: 3.0%, 404s: 8.6%
Robots: 3.3%, Other: 3.6%)

3,223,911
(104,408)

177,623,512
(5,816,632)

465,264,816
(15,751,135)

v1.7.15 Update 2 (.NET 4.5)   Linux

987

20/01/2017 16:01:40

5 hours 31 mins 8 secs

8,686

111

79.9%
(DNS: 1.7%, Conn: 1.1%
T-out: 2.4%, 404s: 7.4%
Robots: 3.0%, Other: 4.5%)

3,453,496
(116,729)

125,525,473
(4,102,319)

407,403,346
(13,871,426)

v1.7.15 Update 2 (.NET 4.5)   Linux

988

20/01/2017 16:01:46

16 mins 0 sec

11,629

91

77.6%
(DNS: 2.9%, Conn: 1.1%
T-out: 3.8%, 404s: 9.0%
Robots: 3.7%, Other: 1.9%)

3,022,574
(97,421)

170,920,723
(5,585,693)

455,530,911
(15,449,514)

v1.7.15 Update 2 (.NET 4.5)   Linux

996

20/01/2017 16:01:56

1 hour 16 mins 2 secs

14,540

71

79.4%
(DNS: 1.2%, Conn: 3.1%
T-out: 0.3%, 404s: 9.2%
Robots: 3.1%, Other: 3.5%)

3,214,248
(105,039)

176,581,082
(5,740,459)

452,631,284
(15,291,358)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

20/01/2017 16:02:02

1 hour 31 mins 3 secs

13,292

88

79.0%
(DNS: 1.9%, Conn: 0.8%
T-out: 2.8%, 404s: 9.3%
Robots: 2.9%, Other: 3.3%)

3,557,846
(116,881)

184,090,181
(6,017,172)

453,318,538
(15,349,791)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

20/01/2017 16:02:07

31 mins 1 sec

10,416

81

75.2%
(DNS: 1.1%, Conn: 1.5%
T-out: 3.7%, 404s: 10.8%
Robots: 3.5%, Other: 4.1%)

3,459,750
(116,518)

166,872,992
(5,442,057)

427,785,635
(14,496,341)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/01/2017 16:02:07

1 hour 16 mins 2 secs

14,206

59

78.8%
(DNS: 1.3%, Conn: 1.2%
T-out: 3.3%, 404s: 9.3%
Robots: 2.6%, Other: 3.5%)

3,144,688
(103,579)

178,168,554
(5,822,723)

467,139,719
(15,794,947)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/01/2017 16:02:13

3 hours 46 mins 6 secs

7,731

93

78.4%
(DNS: 1.6%, Conn: 1.0%
T-out: 3.5%, 404s: 8.9%
Robots: 3.2%, Other: 3.4%)

3,252,026
(104,857)

177,850,179
(5,802,168)

465,732,350
(15,724,458)

Total (89 nodes)

846,964

7,448

-

279,034,116
(9,201,571)

15,170,784,407
(495,924,243)

40,057,490,852
(1,355,512,396)

The following chart shows refic's contribution (blue) to overall crawling effort by day.

Last updated: 20 Jan 2017 16:02:31:603 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12