Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

refic

Country:

Finland Finland

ID:

233

Team:

Team Norway (Join this team)

Joined:

27/09/2005 17:25:00

URLs crawled:

599,052,701,614

Data (MB)*:

15,377,606,598

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.15 Update 2 (.NET 4.5)   Linux

963

15/02/2017 05:34:49

1 hour 1 min 2 secs

12,771

26

81.8%
(DNS: 1.2%, Conn: 1.3%
T-out: 2.0%, 404s: 8.2%
Robots: 2.1%, Other: 3.4%)

0
(0)

93,883,040
(3,176,753)

537,197,428
(18,212,280)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

16/02/2017 08:41:38

1 hour 46 mins 2 secs

10,559

76

82.9%
(DNS: 1.4%, Conn: 1.4%
T-out: 2.4%, 404s: 5.9%
Robots: 1.5%, Other: 4.5%)

0
(0)

99,240,514
(3,364,112)

547,141,444
(18,573,612)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

16/02/2017 11:05:54

2 hours 46 mins 6 secs

9,498

56

82.7%
(DNS: 1.2%, Conn: 0.8%
T-out: 2.2%, 404s: 7.3%
Robots: 1.6%, Other: 4.2%)

0
(0)

93,923,292
(3,179,661)

555,179,856
(18,703,245)

v1.7.15 Update 2 (.NET 4.5)   Linux

987

17/02/2017 12:56:15

4 hours 1 min 7 secs

7,551

90

81.1%
(DNS: 2.8%, Conn: 0.8%
T-out: 2.3%, 404s: 7.5%
Robots: 2.3%, Other: 3.2%)

0
(0)

72,124,867
(2,449,022)

538,283,580
(18,208,861)

v1.7.15 Update 2 (.NET 4.5)   Linux

992

18/02/2017 10:32:17

3 hours 46 mins 7 secs

9,940

102

82.9%
(DNS: 1.2%, Conn: 0.8%
T-out: 1.7%, 404s: 7.2%
Robots: 2.2%, Other: 4.1%)

0
(0)

114,883,159
(3,901,448)

575,483,090
(19,504,463)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

19/02/2017 12:53:44

4 hours 46 mins 10 secs

6,238

93

80.6%
(DNS: 2.0%, Conn: 1.2%
T-out: 2.3%, 404s: 7.2%
Robots: 2.3%, Other: 4.5%)

0
(0)

105,825,852
(3,586,686)

570,052,934
(19,280,949)

v1.7.15 Update 2 (.NET 4.5)   Linux

983

20/02/2017 07:45:49

5 days 16 hours 46 mins 53 secs

171

1

81.4%
(DNS: 1.3%, Conn: 0.8%
T-out: 2.6%, 404s: 6.8%
Robots: 3.4%, Other: 3.6%)

0
(0)

93,394,649
(3,166,039)

560,535,280
(18,930,899)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/02/2017 07:47:11

4 hours 31 mins 5 secs

4,177

45

80.1%
(DNS: 1.6%, Conn: 1.4%
T-out: 2.0%, 404s: 8.9%
Robots: 2.2%, Other: 3.8%)

840,681
(27,942)

104,697,502
(3,524,454)

571,357,383
(19,317,870)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/02/2017 07:48:08

4 hours 16 mins 6 secs

3,674

42

80.4%
(DNS: 1.4%, Conn: 1.8%
T-out: 2.7%, 404s: 7.9%
Robots: 2.0%, Other: 3.8%)

730,989
(25,084)

106,716,537
(3,601,208)

572,399,383
(19,294,584)

v1.7.15 Update 2 (.NET 4.5)   Linux

996

20/02/2017 07:50:16

16 mins 0 sec

12,335

4

76.5%
(DNS: 4.7%, Conn: 4.3%
T-out: 0.0%, 404s: 7.7%
Robots: 2.0%, Other: 4.7%)

907,953
(30,425)

121,519,272
(4,106,371)

574,045,461
(19,440,449)

v1.7.15 Update 2 (.NET 4.5)   Linux

987

20/02/2017 07:50:24

4 hours 46 mins 3 secs

5,724

39

80.2%
(DNS: 2.4%, Conn: 1.0%
T-out: 1.5%, 404s: 8.5%
Robots: 2.4%, Other: 3.9%)

723,510
(24,383)

82,619,107
(2,802,326)

516,298,345
(17,532,222)

v1.7.15 Update 2 (.NET 4.5)   Linux

983

20/02/2017 07:50:36

5 hours 46 mins 7 secs

5,702

43

77.2%
(DNS: 4.0%, Conn: 0.8%
T-out: 3.2%, 404s: 8.1%
Robots: 3.1%, Other: 3.6%)

884,733
(28,298)

117,630,558
(3,974,968)

580,524,555
(19,609,387)

v1.7.15 Update 2 (.NET 4.5)   Linux

996

20/02/2017 07:51:09

4 hours 31 mins 3 secs

5,201

57

80.4%
(DNS: 1.9%, Conn: 3.3%
T-out: 0.4%, 404s: 8.0%
Robots: 2.7%, Other: 3.1%)

889,739
(28,682)

120,126,874
(4,054,098)

571,437,554
(19,275,650)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/02/2017 07:51:19

5 hours 1 min 5 secs

5,158

51

79.3%
(DNS: 2.6%, Conn: 1.3%
T-out: 1.9%, 404s: 7.9%
Robots: 3.3%, Other: 3.8%)

831,635
(27,587)

59,908,390
(2,023,035)

63,839,072
(2,102,683)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/02/2017 07:52:32

5 hours 1 min 5 secs

5,377

36

77.9%
(DNS: 3.1%, Conn: 1.4%
T-out: 3.2%, 404s: 8.5%
Robots: 2.3%, Other: 3.6%)

740,319
(22,761)

107,818,776
(3,633,478)

545,831,490
(18,436,799)

v1.7.15 Update 2 (.NET 4.5)   Linux

987

20/02/2017 07:53:47

3 hours 16 mins 2 secs

4,061

33

80.5%
(DNS: 1.8%, Conn: 1.1%
T-out: 2.6%, 404s: 7.8%
Robots: 2.6%, Other: 3.5%)

1,000,086
(32,696)

68,856,706
(2,345,833)

490,708,222
(16,610,301)

v1.7.15 Update 2 (.NET 4.5)   Linux

988

20/02/2017 07:53:48

4 hours 46 mins 4 secs

5,202

50

80.0%
(DNS: 1.5%, Conn: 1.5%
T-out: 2.4%, 404s: 8.5%
Robots: 2.6%, Other: 3.4%)

864,262
(27,945)

104,776,392
(3,547,105)

561,912,625
(18,994,565)

v1.7.15 Update 2 (.NET 4.5)   Linux

987

20/02/2017 07:53:48

5 hours 16 mins 7 secs

6,591

54

80.2%
(DNS: 1.6%, Conn: 0.9%
T-out: 2.4%, 404s: 8.9%
Robots: 2.6%, Other: 3.4%)

867,061
(29,141)

82,203,645
(2,785,899)

546,427,966
(18,497,782)

v1.7.15 Update 2 (.NET 4.5)   Linux

992

20/02/2017 07:54:40

4 hours 1 min 4 secs

4,110

51

82.6%
(DNS: 2.0%, Conn: 0.6%
T-out: 2.5%, 404s: 7.2%
Robots: 1.7%, Other: 3.4%)

910,429
(30,733)

118,629,164
(4,036,381)

576,089,243
(19,536,125)

v1.7.15 Update 2 (.NET 4.5)   Linux

983

20/02/2017 07:55:19

4 hours 46 mins 5 secs

4,771

51

79.5%
(DNS: 2.1%, Conn: 0.8%
T-out: 2.7%, 404s: 8.2%
Robots: 2.9%, Other: 3.8%)

886,266
(28,848)

117,377,383
(3,968,389)

466,244,073
(15,888,232)

v1.7.15 Update 2 (.NET 4.5)   Linux

988

20/02/2017 07:55:56

4 hours 1 min 4 secs

6,660

54

79.3%
(DNS: 1.9%, Conn: 1.1%
T-out: 2.6%, 404s: 8.0%
Robots: 3.2%, Other: 3.9%)

980,469
(32,421)

116,387,918
(3,931,833)

575,595,167
(19,477,111)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/02/2017 07:56:45

1 hour 16 mins 2 secs

9,791

12

81.3%
(DNS: 1.3%, Conn: 1.5%
T-out: 2.9%, 404s: 7.7%
Robots: 1.9%, Other: 3.4%)

817,029
(26,441)

59,346,427
(2,001,403)

62,720,149
(2,068,203)

v1.7.15 Update 2 (.NET 4.5)   Linux

987

20/02/2017 07:57:15

4 hours 31 mins 4 secs

5,216

53

81.4%
(DNS: 2.1%, Conn: 1.0%
T-out: 2.2%, 404s: 7.8%
Robots: 2.1%, Other: 3.3%)

923,113
(31,086)

81,639,282
(2,774,609)

542,817,662
(18,368,151)

v1.7.15 Update 2 (.NET 4.5)   Linux

987

20/02/2017 07:57:18

1 hour 46 mins 3 secs

6,775

28

80.8%
(DNS: 2.4%, Conn: 2.2%
T-out: 1.7%, 404s: 7.2%
Robots: 2.0%, Other: 3.7%)

929,736
(29,621)

81,848,222
(2,784,551)

543,204,629
(18,379,317)

v1.7.15 Update 2 (.NET 4.5)   Linux

983

20/02/2017 07:58:25

4 hours 46 mins 3 secs

6,545

53

80.9%
(DNS: 1.6%, Conn: 0.9%
T-out: 2.4%, 404s: 8.2%
Robots: 2.5%, Other: 3.4%)

822,244
(27,027)

118,850,411
(4,012,309)

580,412,247
(19,611,588)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/02/2017 07:58:43

4 hours 31 mins 5 secs

3,887

39

80.4%
(DNS: 2.4%, Conn: 1.0%
T-out: 2.3%, 404s: 7.8%
Robots: 2.4%, Other: 3.6%)

737,672
(24,644)

58,725,028
(1,993,290)

62,336,448
(2,071,659)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/02/2017 07:58:55

4 hours 46 mins 5 secs

4,877

54

79.8%
(DNS: 1.2%, Conn: 1.1%
T-out: 3.2%, 404s: 8.8%
Robots: 2.1%, Other: 3.8%)

829,513
(26,627)

108,623,827
(3,684,040)

569,078,203
(19,247,813)

v1.7.15 Update 2 (.NET 4.5)   Linux

983

20/02/2017 07:59:02

4 hours 46 mins 6 secs

4,948

35

79.4%
(DNS: 1.7%, Conn: 1.2%
T-out: 2.9%, 404s: 8.1%
Robots: 3.1%, Other: 3.6%)

648,620
(20,822)

116,731,834
(3,936,589)

578,099,523
(19,499,752)

v1.7.15 Update 2 (.NET 4.5)   Linux

983

20/02/2017 07:59:17

5 hours 16 mins 6 secs

5,426

48

79.1%
(DNS: 2.3%, Conn: 1.2%
T-out: 2.6%, 404s: 7.6%
Robots: 3.2%, Other: 3.9%)

771,951
(25,594)

116,929,852
(3,932,379)

581,316,372
(19,588,012)

v1.7.15 Update 2 (.NET 4.5)   Linux

993

20/02/2017 07:59:18

4 hours 31 mins 4 secs

5,278

56

80.9%
(DNS: 1.3%, Conn: 3.3%
T-out: 0.2%, 404s: 8.5%
Robots: 2.0%, Other: 3.8%)

969,988
(33,919)

119,511,422
(4,034,584)

576,125,708
(19,464,333)

v1.7.15 Update 2 (.NET 4.5)   Linux

988

20/02/2017 07:59:22

4 hours 31 mins 3 secs

4,345

53

80.2%
(DNS: 2.5%, Conn: 1.2%
T-out: 2.6%, 404s: 7.5%
Robots: 2.3%, Other: 3.7%)

869,267
(28,834)

117,274,122
(3,960,438)

567,047,514
(19,159,408)

v1.7.15 Update 2 (.NET 4.5)   Linux

996

20/02/2017 07:59:24

4 hours 46 mins 5 secs

5,702

62

82.9%
(DNS: 1.2%, Conn: 2.3%
T-out: 0.3%, 404s: 8.1%
Robots: 1.9%, Other: 3.2%)

958,126
(32,364)

121,652,361
(4,100,640)

574,865,540
(19,433,980)

v1.7.15 Update 2 (.NET 4.5)   Linux

996

20/02/2017 07:59:28

31 mins 1 sec

11,809

41

81.6%
(DNS: 1.5%, Conn: 3.9%
T-out: 0.2%, 404s: 8.6%
Robots: 1.5%, Other: 2.8%)

909,612
(29,503)

122,260,195
(4,133,375)

578,878,949
(19,568,726)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/02/2017 07:59:28

4 hours 46 mins 6 secs

4,845

51

80.5%
(DNS: 1.8%, Conn: 1.3%
T-out: 2.5%, 404s: 7.9%
Robots: 2.2%, Other: 3.8%)

781,690
(26,221)

108,351,763
(3,649,231)

562,992,647
(18,975,240)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/02/2017 07:59:31

5 hours 31 mins 6 secs

6,137

58

79.5%
(DNS: 2.0%, Conn: 1.1%
T-out: 2.1%, 404s: 8.4%
Robots: 2.9%, Other: 4.0%)

852,258
(28,702)

59,173,236
(2,013,403)

63,345,865
(2,089,348)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/02/2017 07:59:31

4 hours 31 mins 3 secs

4,578

52

79.8%
(DNS: 3.5%, Conn: 0.9%
T-out: 2.1%, 404s: 8.0%
Robots: 2.3%, Other: 3.3%)

851,758
(27,385)

59,285,989
(2,009,753)

62,833,972
(2,076,891)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/02/2017 07:59:36

4 hours 16 mins 4 secs

3,805

34

79.2%
(DNS: 2.0%, Conn: 1.8%
T-out: 2.8%, 404s: 7.3%
Robots: 2.7%, Other: 4.2%)

624,410
(21,190)

107,894,341
(3,642,305)

574,592,567
(19,440,753)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/02/2017 07:59:37

4 hours 31 mins 4 secs

4,953

57

80.8%
(DNS: 2.2%, Conn: 1.1%
T-out: 2.0%, 404s: 7.7%
Robots: 2.3%, Other: 3.9%)

879,369
(30,019)

58,854,164
(1,996,185)

63,294,900
(2,075,808)

v1.7.15 Update 2 (.NET 4.5)   Linux

992

20/02/2017 07:59:37

4 hours 1 min 3 secs

4,609

58

82.5%
(DNS: 1.9%, Conn: 0.5%
T-out: 2.2%, 404s: 7.8%
Robots: 2.2%, Other: 2.9%)

982,216
(30,412)

69,403,716
(2,369,432)

484,022,950
(16,407,119)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

20/02/2017 07:59:37

16 mins 0 sec

8,291

61

83.4%
(DNS: 1.5%, Conn: 1.6%
T-out: 2.1%, 404s: 7.9%
Robots: 1.0%, Other: 2.7%)

890,945
(28,664)

114,260,199
(3,862,072)

543,548,461
(18,408,605)

v1.7.15 Update 2 (.NET 4.5)   Linux

993

20/02/2017 07:59:37

4 hours 46 mins 7 secs

5,532

53

81.6%
(DNS: 1.7%, Conn: 3.1%
T-out: 0.5%, 404s: 7.4%
Robots: 2.5%, Other: 3.2%)

901,454
(29,664)

121,337,517
(4,103,874)

576,665,630
(19,513,514)

v1.7.15 Update 2 (.NET 4.5)   Linux

996

20/02/2017 07:59:38

31 mins 1 sec

14,663

40

83.0%
(DNS: 1.4%, Conn: 4.0%
T-out: 0.2%, 404s: 6.4%
Robots: 1.5%, Other: 3.4%)

970,261
(30,827)

122,205,954
(4,131,404)

573,534,574
(19,414,718)

v1.7.15 Update 2 (.NET 4.5)   Linux

988

20/02/2017 07:59:38

4 hours 1 min 3 secs

4,284

49

81.1%
(DNS: 3.2%, Conn: 1.1%
T-out: 2.5%, 404s: 6.8%
Robots: 1.5%, Other: 3.8%)

905,851
(28,610)

117,162,441
(3,984,783)

574,142,912
(19,483,691)

v1.7.15 Update 2 (.NET 4.5)   Linux

992

20/02/2017 07:59:40

4 hours 46 mins 5 secs

5,602

59

80.9%
(DNS: 1.4%, Conn: 0.8%
T-out: 2.0%, 404s: 8.7%
Robots: 2.5%, Other: 3.6%)

951,232
(30,797)

122,319,440
(4,153,037)

577,015,269
(19,510,728)

v1.7.15 Update 2 (.NET 4.5)   Linux

993

20/02/2017 07:59:44

5 hours 31 mins 10 secs

6,805

53

79.2%
(DNS: 2.0%, Conn: 3.7%
T-out: 0.4%, 404s: 7.8%
Robots: 2.6%, Other: 4.3%)

974,070
(31,859)

122,193,119
(4,145,208)

583,313,732
(19,751,027)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/02/2017 07:59:44

16 mins 0 sec

9,650

30

87.0%
(DNS: 0.6%, Conn: 1.3%
T-out: 1.3%, 404s: 6.1%
Robots: 1.0%, Other: 2.5%)

781,595
(24,350)

58,095,100
(1,958,549)

61,043,971
(2,017,109)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

20/02/2017 07:59:46

46 mins 1 sec

14,561

30

81.3%
(DNS: 1.4%, Conn: 0.7%
T-out: 2.4%, 404s: 8.9%
Robots: 1.9%, Other: 3.4%)

855,122
(28,882)

112,471,577
(3,808,180)

492,178,677
(16,718,220)

v1.7.15 Update 2 (.NET 4.5)   Linux

987

20/02/2017 07:59:46

5 hours 46 mins 7 secs

6,781

54

79.9%
(DNS: 2.3%, Conn: 0.9%
T-out: 2.2%, 404s: 7.9%
Robots: 2.8%, Other: 4.0%)

939,974
(30,619)

80,108,530
(2,708,259)

543,989,162
(18,410,068)

v1.7.15 Update 2 (.NET 4.5)   Linux

996

20/02/2017 07:59:46

4 hours 31 mins 3 secs

4,924

53

81.0%
(DNS: 1.7%, Conn: 3.5%
T-out: 0.4%, 404s: 7.7%
Robots: 2.7%, Other: 3.0%)

955,757
(31,353)

121,965,581
(4,119,103)

573,325,025
(19,363,607)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/02/2017 07:59:47

4 hours 31 mins 5 secs

4,529

64

80.6%
(DNS: 1.8%, Conn: 1.3%
T-out: 2.1%, 404s: 8.4%
Robots: 2.2%, Other: 3.5%)

862,334
(26,932)

107,274,006
(3,623,468)

575,783,845
(19,464,856)

v1.7.15 Update 2 (.NET 4.5)   Linux

988

20/02/2017 07:59:47

5 hours 1 min 6 secs

5,757

56

80.1%
(DNS: 1.4%, Conn: 0.8%
T-out: 2.8%, 404s: 7.9%
Robots: 2.8%, Other: 4.2%)

1,005,521
(35,352)

117,549,525
(3,976,053)

570,313,859
(19,320,938)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/02/2017 07:59:48

4 hours 1 min 3 secs

3,913

47

81.3%
(DNS: 2.3%, Conn: 1.2%
T-out: 1.8%, 404s: 6.7%
Robots: 2.2%, Other: 4.5%)

889,185
(29,233)

107,546,862
(3,622,633)

573,311,037
(19,393,771)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/02/2017 07:59:51

3 hours 31 mins 3 secs

4,917

53

82.1%
(DNS: 1.5%, Conn: 0.7%
T-out: 1.9%, 404s: 8.6%
Robots: 1.7%, Other: 3.4%)

896,375
(28,588)

105,789,153
(3,592,163)

567,753,575
(19,203,772)

v1.7.15 Update 2 (.NET 4.5)   Linux

983

20/02/2017 07:59:51

5 hours 16 mins 5 secs

6,688

54

80.8%
(DNS: 1.1%, Conn: 0.9%
T-out: 2.1%, 404s: 8.9%
Robots: 2.8%, Other: 3.5%)

958,959
(31,848)

118,028,721
(4,003,827)

586,007,470
(19,819,534)

v1.7.15 Update 2 (.NET 4.5)   Linux

988

20/02/2017 07:59:52

4 hours 16 mins 4 secs

4,106

51

81.3%
(DNS: 1.6%, Conn: 1.2%
T-out: 2.0%, 404s: 8.0%
Robots: 2.2%, Other: 3.7%)

844,508
(27,331)

117,410,495
(3,990,792)

577,361,389
(19,530,158)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

20/02/2017 07:59:53

16 mins 0 sec

9,776

37

84.6%
(DNS: 0.6%, Conn: 0.7%
T-out: 3.1%, 404s: 6.7%
Robots: 1.4%, Other: 3.0%)

811,258
(25,936)

62,128,807
(2,109,960)

66,775,632
(2,221,892)

v1.7.15 Update 2 (.NET 4.5)   Linux

996

20/02/2017 07:59:53

5 hours 1 min 7 secs

6,028

58

80.8%
(DNS: 1.9%, Conn: 3.0%
T-out: 0.4%, 404s: 8.3%
Robots: 2.6%, Other: 2.9%)

1,028,800
(33,509)

122,183,545
(4,123,115)

576,269,250
(19,504,342)

v1.7.15 Update 2 (.NET 4.5)   Linux

988

20/02/2017 07:59:55

1 hour 31 mins 3 secs

10,243

36

81.6%
(DNS: 1.7%, Conn: 1.2%
T-out: 2.5%, 404s: 8.1%
Robots: 1.4%, Other: 3.5%)

980,811
(32,571)

117,032,492
(3,973,958)

574,684,562
(19,451,424)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

20/02/2017 07:59:56

1 hour 16 mins 2 secs

10,066

33

82.8%
(DNS: 1.8%, Conn: 1.4%
T-out: 2.2%, 404s: 6.7%
Robots: 2.1%, Other: 3.0%)

836,131
(27,231)

114,189,451
(3,850,293)

569,042,322
(19,250,137)

v1.7.15 Update 2 (.NET 4.5)   Linux

996

20/02/2017 07:59:56

4 hours 1 min 3 secs

4,521

57

81.3%
(DNS: 1.4%, Conn: 2.8%
T-out: 0.5%, 404s: 8.3%
Robots: 2.1%, Other: 3.6%)

988,952
(32,331)

121,629,854
(4,124,094)

575,700,354
(19,462,610)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/02/2017 07:59:56

4 hours 46 mins 5 secs

4,811

42

80.6%
(DNS: 1.9%, Conn: 1.1%
T-out: 2.4%, 404s: 7.9%
Robots: 2.5%, Other: 3.5%)

707,325
(22,934)

108,052,481
(3,654,743)

566,720,530
(19,170,107)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

20/02/2017 07:59:57

1 min 0 sec

513

n/a

80.3%
(DNS: 0.0%, Conn: 2.0%
T-out: 0.0%, 404s: 10.6%
Robots: 1.5%, Other: 5.6%)

920,382
(29,993)

62,658,584
(2,116,302)

66,405,123
(2,201,145)

v1.7.15 Update 2 (.NET 4.5)   Linux

987

20/02/2017 07:59:57

16 mins 1 sec

11,613

35

82.0%
(DNS: 2.9%, Conn: 2.9%
T-out: 2.4%, 404s: 6.4%
Robots: 1.0%, Other: 2.3%)

909,880
(31,087)

80,709,141
(2,740,091)

546,688,603
(18,437,125)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

20/02/2017 07:59:57

1 hour 1 min 2 secs

11,624

27

82.2%
(DNS: 1.4%, Conn: 1.5%
T-out: 2.0%, 404s: 8.2%
Robots: 1.3%, Other: 3.5%)

840,760
(27,714)

113,342,979
(3,838,523)

568,243,329
(19,213,163)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/02/2017 07:59:58

46 mins 1 sec

12,122

32

83.1%
(DNS: 1.6%, Conn: 1.4%
T-out: 1.9%, 404s: 6.9%
Robots: 1.8%, Other: 3.3%)

940,141
(29,955)

58,942,957
(2,002,973)

63,397,486
(2,080,265)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/02/2017 07:59:58

5 hours 1 min 6 secs

4,954

43

79.5%
(DNS: 2.0%, Conn: 1.3%
T-out: 2.7%, 404s: 7.9%
Robots: 2.8%, Other: 3.8%)

724,862
(22,884)

107,651,765
(3,635,847)

574,913,079
(19,409,644)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

20/02/2017 07:59:58

1 hour 46 mins 3 secs

7,155

27

83.2%
(DNS: 1.7%, Conn: 1.0%
T-out: 2.1%, 404s: 7.2%
Robots: 1.7%, Other: 3.1%)

916,180
(30,343)

63,240,336
(2,152,197)

67,826,634
(2,257,769)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/02/2017 07:59:58

4 hours 46 mins 3 secs

5,235

54

80.8%
(DNS: 1.5%, Conn: 0.9%
T-out: 2.6%, 404s: 8.4%
Robots: 2.5%, Other: 3.3%)

896,235
(29,570)

53,829,036
(1,823,170)

58,301,084
(1,897,898)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/02/2017 07:59:59

4 hours 31 mins 4 secs

4,308

41

80.1%
(DNS: 1.3%, Conn: 1.3%
T-out: 2.2%, 404s: 8.5%
Robots: 2.4%, Other: 4.2%)

653,112
(23,335)

108,151,442
(3,667,544)

573,297,206
(19,436,830)

v1.7.15 Update 2 (.NET 4.5)   Linux

993

20/02/2017 07:59:59

4 hours 31 mins 4 secs

5,106

61

81.0%
(DNS: 1.3%, Conn: 3.6%
T-out: 0.3%, 404s: 8.5%
Robots: 2.2%, Other: 3.1%)

950,925
(31,847)

121,705,816
(4,121,617)

580,306,450
(19,621,139)

v1.7.15 Update 2 (.NET 4.5)   Linux

992

20/02/2017 07:59:59

5 hours 46 mins 10 secs

6,635

53

78.4%
(DNS: 2.7%, Conn: 1.2%
T-out: 2.0%, 404s: 8.4%
Robots: 3.0%, Other: 4.2%)

1,074,501
(34,919)

119,794,477
(4,086,995)

464,165,695
(15,957,651)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/02/2017 08:00:00

1 min 0 sec

159

134

61.8%
(DNS: 0.0%, Conn: 1.8%
T-out: 0.0%, 404s: 8.2%
Robots: 0.0%, Other: 28.2%)

716,918
(24,338)

108,496,264
(3,671,550)

526,437,417
(17,874,498)

v1.7.15 Update 2 (.NET 4.5)   Linux

993

20/02/2017 08:00:01

4 hours 16 mins 4 secs

4,190

50

82.1%
(DNS: 1.1%, Conn: 3.0%
T-out: 0.3%, 404s: 7.9%
Robots: 2.2%, Other: 3.4%)

912,991
(29,463)

122,676,469
(4,143,009)

584,015,465
(19,762,092)

v1.7.15 Update 2 (.NET 4.5)   Linux

992

20/02/2017 08:00:02

5 hours 46 mins 7 secs

7,261

55

80.7%
(DNS: 1.6%, Conn: 0.9%
T-out: 1.8%, 404s: 7.9%
Robots: 2.9%, Other: 4.1%)

1,019,186
(34,611)

120,257,437
(4,094,029)

576,875,665
(19,547,586)

v1.7.15 Update 2 (.NET 4.5)   Linux

987

20/02/2017 08:00:02

4 hours 1 min 2 secs

4,336

49

81.7%
(DNS: 1.8%, Conn: 0.6%
T-out: 2.1%, 404s: 8.5%
Robots: 1.7%, Other: 3.6%)

989,231
(33,077)

82,200,215
(2,793,806)

491,134,050
(16,714,598)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

981

20/02/2017 08:00:04

4 hours 31 mins 7 secs

4,306

44

79.9%
(DNS: 2.4%, Conn: 1.3%
T-out: 2.5%, 404s: 7.4%
Robots: 2.4%, Other: 4.1%)

742,401
(25,169)

58,319,509
(1,977,254)

62,424,929
(2,057,838)

v1.7.15 Update 2 (.NET 4.5)   Linux

993

20/02/2017 08:00:04

4 hours 46 mins 4 secs

5,721

51

80.7%
(DNS: 1.8%, Conn: 3.3%
T-out: 0.3%, 404s: 7.6%
Robots: 2.5%, Other: 3.9%)

930,837
(29,922)

122,717,544
(4,142,127)

584,111,821
(19,744,517)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

20/02/2017 08:00:05

1 hour 46 mins 2 secs

8,409

33

81.5%
(DNS: 2.9%, Conn: 1.1%
T-out: 2.4%, 404s: 6.8%
Robots: 1.4%, Other: 3.9%)

965,188
(31,027)

113,685,391
(3,842,547)

560,324,144
(18,989,740)

v1.7.15 Update 2 (.NET 4.5)   Linux

993

20/02/2017 08:00:05

16 mins 0 sec

10,239

73

82.2%
(DNS: 1.2%, Conn: 4.3%
T-out: 0.6%, 404s: 6.6%
Robots: 1.8%, Other: 3.2%)

955,019
(31,515)

122,517,786
(4,141,568)

578,342,992
(19,550,516)

v1.7.15 Update 2 (.NET 4.5)   Linux

992

20/02/2017 08:00:06

4 hours 31 mins 4 secs

5,055

52

80.7%
(DNS: 2.4%, Conn: 0.7%
T-out: 1.6%, 404s: 8.8%
Robots: 2.2%, Other: 3.5%)

912,821
(28,585)

118,603,795
(4,021,492)

571,811,831
(19,384,166)

v1.7.15 Update 2 (.NET 4.5)   Linux

993

20/02/2017 08:00:06

3 hours 1 min 4 secs

5,694

30

82.7%
(DNS: 1.5%, Conn: 3.5%
T-out: 0.3%, 404s: 6.9%
Robots: 1.7%, Other: 3.4%)

994,141
(33,654)

122,838,545
(4,155,195)

579,064,267
(19,570,156)

v1.7.15 Update 2 (.NET 4.5)   Linux

992

20/02/2017 08:00:06

3 hours 1 min 2 secs

4,769

25

81.6%
(DNS: 1.4%, Conn: 0.6%
T-out: 2.0%, 404s: 8.1%
Robots: 1.6%, Other: 4.7%)

915,626
(29,340)

120,215,432
(4,071,248)

580,879,402
(19,671,869)

v1.7.15 Update 2 (.NET 4.5)   Linux

987

20/02/2017 08:00:07

5 hours 1 min 7 secs

5,577

51

81.0%
(DNS: 1.8%, Conn: 0.7%
T-out: 2.2%, 404s: 7.5%
Robots: 3.2%, Other: 3.5%)

850,403
(28,620)

81,691,688
(2,755,091)

540,961,154
(18,337,145)

v1.7.15 Update 2 (.NET 4.5)   Linux

988

20/02/2017 08:00:07

5 hours 1 min 5 secs

5,810

56

81.0%
(DNS: 1.6%, Conn: 1.0%
T-out: 2.6%, 404s: 7.8%
Robots: 2.6%, Other: 3.3%)

947,719
(30,646)

117,965,642
(4,002,006)

574,609,007
(19,454,177)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/02/2017 08:00:08

5 hours 46 mins 8 secs

5,458

41

78.8%
(DNS: 3.4%, Conn: 0.7%
T-out: 2.6%, 404s: 8.3%
Robots: 2.7%, Other: 3.5%)

868,125
(28,065)

108,455,788
(3,683,486)

569,473,580
(19,247,306)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

20/02/2017 08:00:08

1 min 0 sec

668

n/a

77.9%
(DNS: 0.0%, Conn: 0.8%
T-out: 2.5%, 404s: 5.7%
Robots: 0.0%, Other: 13.1%)

883,983
(30,998)

72,022,159
(2,410,546)

413,079,291
(14,074,579)

v1.7.15 Update 2 (.NET 4.5)   Linux

996

20/02/2017 08:00:09

4 hours 16 mins 4 secs

4,594

53

82.5%
(DNS: 1.7%, Conn: 2.4%
T-out: 0.5%, 404s: 7.6%
Robots: 2.3%, Other: 3.0%)

918,596
(30,935)

121,298,429
(4,107,625)

571,816,703
(19,336,378)

v1.7.15 Update 2 (.NET 4.5)   Linux

983

20/02/2017 08:00:10

5 hours 46 mins 6 secs

5,195

42

79.5%
(DNS: 2.2%, Conn: 1.1%
T-out: 2.5%, 404s: 8.9%
Robots: 1.9%, Other: 3.8%)

812,229
(25,281)

118,432,709
(4,003,790)

582,522,391
(19,672,754)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

20/02/2017 08:00:10

1 min 0 sec

682

132

81.3%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.7%, 404s: 12.9%
Robots: 0.0%, Other: 5.0%)

869,358
(29,077)

112,847,188
(3,827,252)

561,547,928
(19,013,183)

v1.7.15 Update 2 (.NET 4.5)   Linux

992

20/02/2017 08:00:10

5 hours 16 mins 4 secs

5,979

45

80.5%
(DNS: 1.7%, Conn: 0.7%
T-out: 1.9%, 404s: 8.3%
Robots: 3.2%, Other: 3.8%)

852,674
(26,993)

119,747,065
(4,056,457)

576,021,992
(19,538,737)

v1.7.15 Update 2 (.NET 4.5)   Linux

993

20/02/2017 08:00:11

4 hours 46 mins 3 secs

5,888

54

81.1%
(DNS: 1.6%, Conn: 2.4%
T-out: 0.4%, 404s: 8.1%
Robots: 3.0%, Other: 3.4%)

1,002,558
(33,642)

110,016,992
(3,732,894)

573,310,969
(19,377,637)

v1.7.15 Update 2 (.NET 4.5)   Linux

963

20/02/2017 08:00:11

1 hour 16 mins 3 secs

11,242

28

81.2%
(DNS: 1.3%, Conn: 1.2%
T-out: 2.6%, 404s: 8.2%
Robots: 1.9%, Other: 3.6%)

833,028
(27,255)

61,741,938
(2,086,383)

66,142,397
(2,193,450)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/02/2017 08:00:12

1 hour 1 min 3 secs

12,225

32

83.0%
(DNS: 1.9%, Conn: 1.1%
T-out: 2.4%, 404s: 7.3%
Robots: 1.6%, Other: 2.8%)

860,208
(26,904)

107,711,350
(3,633,096)

568,689,881
(19,222,609)

v1.7.15 Update 2 (.NET 4.5)   Linux

983

20/02/2017 08:00:12

5 hours 1 min 5 secs

5,652

54

78.4%
(DNS: 2.3%, Conn: 1.1%
T-out: 2.6%, 404s: 8.8%
Robots: 3.0%, Other: 3.7%)

959,817
(29,574)

119,215,617
(4,024,699)

579,116,037
(19,549,989)

v1.7.15 Update 2 (.NET 4.5)   Linux

982

20/02/2017 08:00:13

4 hours 31 mins 5 secs

4,356

43

79.9%
(DNS: 1.8%, Conn: 1.1%
T-out: 3.0%, 404s: 8.1%
Robots: 2.5%, Other: 3.7%)

771,370
(24,689)

108,610,865
(3,681,544)

562,338,065
(19,014,838)

v1.7.15 Update 2 (.NET 4.5)   Linux

988

20/02/2017 08:00:13

5 hours 31 mins 6 secs

6,605

48

79.9%
(DNS: 1.8%, Conn: 1.1%
T-out: 2.7%, 404s: 8.0%
Robots: 2.7%, Other: 3.8%)

945,044
(32,094)

117,681,890
(3,975,821)

579,792,583
(19,620,265)

v1.7.15 Update 2 (.NET 4.5)   Linux

988

20/02/2017 08:00:13

5 hours 46 mins 7 secs

6,399

47

80.3%
(DNS: 2.0%, Conn: 1.2%
T-out: 2.3%, 404s: 8.3%
Robots: 2.4%, Other: 3.6%)

943,297
(31,358)

116,526,080
(3,962,400)

574,890,621
(19,514,665)

v1.7.15 Update 2 (.NET 4.5)   Linux

996

20/02/2017 08:00:13

5 hours 31 mins 6 secs

6,844

60

79.3%
(DNS: 1.9%, Conn: 3.4%
T-out: 0.5%, 404s: 7.9%
Robots: 2.9%, Other: 4.1%)

1,064,503
(33,836)

121,618,387
(4,114,898)

571,893,723
(19,332,542)

v1.7.15 Update 2 (.NET 4.5)   Linux

983

20/02/2017 08:00:13

5 hours 31 mins 5 secs

6,539

49

79.1%
(DNS: 2.2%, Conn: 0.9%
T-out: 2.8%, 404s: 8.4%
Robots: 2.6%, Other: 4.0%)

915,967
(29,767)

118,604,905
(4,022,321)

581,578,766
(19,639,656)

v1.7.15 Update 2 (.NET 4.5)   Linux

993

20/02/2017 08:00:13

5 hours 31 mins 6 secs

6,634

55

78.2%
(DNS: 2.5%, Conn: 3.4%
T-out: 0.4%, 404s: 8.1%
Robots: 3.3%, Other: 4.1%)

1,025,689
(30,836)

121,898,022
(4,108,900)

583,375,577
(19,698,955)

Total (100 nodes)

631,196

4,827

-

82,359,029
(2,699,696)

10,258,476,273
(347,235,476)

49,093,178,571
(1,660,558,068)

The following chart shows refic's contribution (blue) to overall crawling effort by day.

Last updated: 20 Feb 2017 08:00:30:600 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12