Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Majestic12

Country:

United Kingdom United Kingdom

ID:

3684

Team:

Not in a team yet. Join one now!

Joined:

01/10/2010 14:16:00

URLs crawled:

569,540,005,542

Data (MB)*:

13,649,163,158

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_1

22/05/2018 23:43:43

1 hour 46 mins 2 secs

2,375

31

79.3%
(DNS: 3.9%, Conn: 0.9%
T-out: 2.8%, 404s: 6.0%
Robots: 2.5%, Other: 4.7%)

2,190,019
(72,856)

71,617,655
(2,181,017)

4,631,662,601
(122,531,576)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_1

22/05/2018 23:47:28

1 hour 31 mins 3 secs

2,922

32

68.0%
(DNS: 5.8%, Conn: 3.1%
T-out: 3.9%, 404s: 5.8%
Robots: 8.1%, Other: 5.3%)

1,561,127
(49,028)

48,926,583
(1,500,097)

4,820,509,995
(119,687,814)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_1

22/05/2018 23:48:11

1 min 0 sec

81

n/a

45.2%
(DNS: 38.4%, Conn: 0.0%
T-out: 0.0%, 404s: 15.1%
Robots: 0.0%, Other: 1.4%)

1,922,482
(58,938)

63,950,960
(1,933,031)

4,349,916,697
(117,533,838)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_1

22/05/2018 23:50:47

31 mins 1 sec

342

28

63.1%
(DNS: 2.5%, Conn: 11.7%
T-out: 12.8%, 404s: 9.4%
Robots: 0.2%, Other: 0.4%)

2,583,357
(81,074)

79,441,141
(2,404,221)

4,114,940,418
(114,690,393)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_1

22/05/2018 23:50:59

2 hours 16 mins 3 secs

2,594

26

76.6%
(DNS: 6.7%, Conn: 1.9%
T-out: 1.3%, 404s: 6.0%
Robots: 3.2%, Other: 4.4%)

2,023,180
(44,681)

65,062,833
(1,478,820)

6,224,458,131
(157,868,477)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_5

22/05/2018 23:51:03

1 hour 31 mins 1 sec

2,577

31

72.3%
(DNS: 7.1%, Conn: 0.7%
T-out: 4.2%, 404s: 8.2%
Robots: 3.0%, Other: 4.5%)

1,750,304
(51,669)

55,511,304
(1,702,110)

6,477,085,926
(164,152,185)

v1.7.16 (.NET 4.5)   Linux

CHDN004_9

22/05/2018 23:51:20

2 hours 16 mins 1 sec

2,566

23

74.6%
(DNS: 8.2%, Conn: 2.0%
T-out: 1.3%, 404s: 6.3%
Robots: 3.1%, Other: 4.5%)

2,255,278
(71,564)

72,238,162
(2,194,458)

1,268,623,633
(39,644,512)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_1

22/05/2018 23:51:56

1 min 0 sec

302

n/a

72.4%
(DNS: 8.1%, Conn: 0.8%
T-out: 0.8%, 404s: 13.8%
Robots: 0.0%, Other: 4.1%)

2,052,697
(63,069)

62,449,973
(1,912,562)

4,242,295,753
(113,431,680)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_5

22/05/2018 23:52:37

1 min 0 sec

211

n/a

73.7%
(DNS: 21.1%, Conn: 2.6%
T-out: 2.6%, 404s: 0.0%
Robots: 0.0%, Other: 0.0%)

2,122,973
(66,606)

68,237,122
(2,090,677)

2,093,035,038
(58,726,797)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_1

22/05/2018 23:53:11

1 min 0 sec

329

n/a

81.1%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.8%, 404s: 7.6%
Robots: 0.0%, Other: 10.6%)

1,847,058
(58,475)

63,062,860
(1,900,923)

4,077,645,995
(109,000,621)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_5

22/05/2018 23:54:32

1 min 0 sec

1,077

n/a

76.7%
(DNS: 12.2%, Conn: 0.3%
T-out: 0.3%, 404s: 4.5%
Robots: 0.0%, Other: 5.9%)

2,196,918
(68,363)

67,466,166
(2,059,503)

4,012,868,819
(107,867,262)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_5

22/05/2018 23:55:04

1 min 0 sec

101

n/a

54.8%
(DNS: 32.3%, Conn: 0.0%
T-out: 6.5%, 404s: 0.0%
Robots: 0.0%, Other: 6.5%)

2,225,713
(68,016)

72,982,503
(2,215,014)

4,667,422,910
(122,693,399)

v1.7.16 (.NET 4.5)   Linux

CHDN004_1

22/05/2018 23:55:21

1 min 0 sec

227

n/a

52.3%
(DNS: 12.9%, Conn: 0.4%
T-out: 0.0%, 404s: 20.7%
Robots: 0.0%, Other: 13.7%)

2,093,082
(63,618)

66,917,870
(2,034,351)

4,987,805,100
(131,847,697)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_5

22/05/2018 23:55:33

16 mins 0 sec

302

10

78.1%
(DNS: 12.9%, Conn: 0.0%
T-out: 4.1%, 404s: 3.3%
Robots: 0.3%, Other: 1.4%)

2,113,994
(66,610)

67,951,840
(2,076,919)

5,075,937,128
(136,781,759)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_5

22/05/2018 23:55:49

46 mins 1 sec

274

10

67.4%
(DNS: 0.1%, Conn: 0.1%
T-out: 7.4%, 404s: 7.1%
Robots: 7.2%, Other: 10.8%)

1,238,875
(39,489)

38,803,116
(1,182,987)

3,729,296,968
(98,143,473)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_5

22/05/2018 23:56:03

2 hours 1 min 2 secs

2,195

26

75.7%
(DNS: 5.6%, Conn: 0.3%
T-out: 2.3%, 404s: 8.8%
Robots: 3.5%, Other: 3.8%)

2,181,697
(48,623)

66,510,289
(1,504,052)

5,659,597,727
(140,605,276)

v1.7.16 (.NET 4.5)   Linux

CHDN003_1

22/05/2018 23:57:27

1 hour 46 mins 2 secs

2,941

29

73.5%
(DNS: 3.7%, Conn: 5.1%
T-out: 2.7%, 404s: 8.4%
Robots: 3.6%, Other: 3.0%)

1,893,801
(53,719)

60,110,608
(1,690,361)

4,659,000,451
(120,913,277)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_5

22/05/2018 23:58:03

1 min 0 sec

83

n/a

37.3%
(DNS: 38.7%, Conn: 0.0%
T-out: 1.3%, 404s: 0.0%
Robots: 20.0%, Other: 2.7%)

2,323,874
(68,995)

78,910,445
(2,157,709)

4,194,850,339
(112,403,953)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_1

22/05/2018 23:58:06

1 hour 1 min 1 sec

1,117

46

72.0%
(DNS: 8.8%, Conn: 0.0%
T-out: 2.0%, 404s: 11.2%
Robots: 0.2%, Other: 5.6%)

2,248,187
(62,231)

71,543,613
(1,973,130)

2,746,804,625
(75,802,251)

Total (19 nodes)

22,616

292

-

38,824,616
(1,157,624)

1,241,695,043
(36,191,942)

82,033,758,254
(2,164,326,240)

The following chart shows Majestic12's contribution (blue) to overall crawling effort by day.

Last updated: 22 May 2018 23:59:01:033 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12