Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Majestic12

Country:

United Kingdom United Kingdom

ID:

3684

Team:

Not in a team yet. Join one now!

Joined:

01/10/2010 14:16:00

URLs crawled:

562,607,311,059

Data (MB)*:

13,426,911,300

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_1

18/12/2017 09:48:40

1 hour 31 mins 2 secs

1,421

47

80.2%
(DNS: 0.6%, Conn: 1.7%
T-out: 3.0%, 404s: 7.6%
Robots: 2.7%, Other: 4.2%)

849,405
(28,990)

64,912,093
(2,178,866)

3,667,277,147
(100,078,550)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_5

18/12/2017 09:48:41

46 mins 1 sec

1,027

36

87.1%
(DNS: 0.1%, Conn: 0.3%
T-out: 1.7%, 404s: 5.9%
Robots: 3.4%, Other: 1.5%)

808,751
(27,100)

56,913,381
(1,915,889)

3,617,714,361
(94,910,183)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_5

18/12/2017 09:50:24

1 min 0 sec

605

104

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

769,029
(25,242)

56,951,728
(1,908,493)

3,793,338,033
(99,620,165)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MJ12-leaseweb4_1

18/12/2017 09:51:40

1 hour 16 mins 2 secs

792

33

77.4%
(DNS: 6.5%, Conn: 1.0%
T-out: 2.5%, 404s: 5.4%
Robots: 2.4%, Other: 4.8%)

752,917
(24,711)

65,233,950
(2,175,505)

5,852,582,870
(147,876,198)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_1

18/12/2017 09:52:43

1 min 0 sec

n/a

111

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

805,487
(25,357)

58,168,680
(1,963,177)

3,968,179,673
(104,990,718)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_5

18/12/2017 09:53:42

1 hour 16 mins 3 secs

1,035

62

84.9%
(DNS: 0.0%, Conn: 1.1%
T-out: 4.3%, 404s: 5.7%
Robots: 1.8%, Other: 2.2%)

958,074
(31,423)

64,408,811
(2,195,645)

4,245,999,504
(108,808,107)

v1.7.16 (.NET 4.5)   Linux

CHDN003_1

18/12/2017 09:54:01

1 hour 16 mins 1 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

4,428,788,542
(113,793,137)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_1

18/12/2017 09:54:32

1 hour 16 mins 2 secs

1,219

64

84.5%
(DNS: 0.7%, Conn: 0.2%
T-out: 2.7%, 404s: 4.0%
Robots: 0.3%, Other: 7.8%)

908,857
(30,419)

65,069,765
(2,204,548)

4,219,250,740
(108,962,954)

v1.7.16 (.NET 4.5)   Linux

CHDN004_9

18/12/2017 09:54:51

46 mins 1 sec

369

39

75.3%
(DNS: 1.7%, Conn: 0.0%
T-out: 12.3%, 404s: 6.8%
Robots: 0.7%, Other: 3.2%)

963,311
(31,656)

62,652,683
(2,108,124)

853,885,834
(25,979,346)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_1

18/12/2017 09:58:46

1 hour 16 mins 2 secs

1,495

34

83.9%
(DNS: 1.3%, Conn: 0.5%
T-out: 3.4%, 404s: 6.9%
Robots: 2.1%, Other: 1.9%)

614,192
(20,994)

40,387,183
(1,360,743)

4,538,355,590
(110,374,840)

v1.7.16 (.NET 4.5)   Linux

CHDN004_1

18/12/2017 09:58:55

1 hour 31 mins 2 secs

1,614

41

81.2%
(DNS: 0.7%, Conn: 0.2%
T-out: 3.7%, 404s: 9.5%
Robots: 0.6%, Other: 4.0%)

802,470
(25,238)

60,536,482
(2,060,318)

4,595,099,438
(118,908,606)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_5

18/12/2017 09:59:07

31 mins 1 sec

673

9

91.5%
(DNS: 1.5%, Conn: 0.1%
T-out: 2.1%, 404s: 0.2%
Robots: 0.8%, Other: 3.9%)

977,439
(31,626)

66,022,884
(2,221,689)

1,754,115,106
(47,581,447)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_1

18/12/2017 09:59:25

1 hour 46 mins 4 secs

1,790

34

81.8%
(DNS: 0.6%, Conn: 0.3%
T-out: 2.1%, 404s: 8.1%
Robots: 2.2%, Other: 4.9%)

694,283
(22,939)

55,474,251
(1,871,818)

3,871,729,185
(101,182,333)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_5

18/12/2017 10:00:39

1 hour 31 mins 2 secs

1,362

51

86.1%
(DNS: 0.1%, Conn: 1.1%
T-out: 2.9%, 404s: 4.0%
Robots: 1.5%, Other: 4.3%)

800,412
(26,041)

60,576,516
(2,032,107)

4,675,824,993
(123,606,015)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_1

18/12/2017 10:01:33

1 hour 46 mins 3 secs

1,879

44

83.7%
(DNS: 0.4%, Conn: 1.3%
T-out: 2.8%, 404s: 5.5%
Robots: 2.7%, Other: 3.5%)

719,564
(25,040)

55,649,588
(1,881,721)

2,366,362,276
(63,631,431)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_5

18/12/2017 10:02:01

1 hour 1 min 3 secs

911

47

76.9%
(DNS: 0.9%, Conn: 1.4%
T-out: 6.0%, 404s: 5.8%
Robots: 0.2%, Other: 8.8%)

741,579
(24,901)

45,082,539
(1,510,658)

6,152,932,422
(153,480,072)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MJ12-leaseweb4_5

18/12/2017 10:02:21

31 mins 1 sec

274

21

61.6%
(DNS: 5.1%, Conn: 4.6%
T-out: 10.9%, 404s: 8.1%
Robots: 2.5%, Other: 7.2%)

808,357
(25,892)

65,564,349
(2,189,195)

5,293,243,703
(130,805,895)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_1

18/12/2017 10:02:34

1 hour 31 mins 2 secs

1,540

40

81.2%
(DNS: 1.1%, Conn: 0.2%
T-out: 4.6%, 404s: 6.4%
Robots: 2.7%, Other: 3.7%)

880,308
(27,696)

6,775,310
(225,614)

3,692,027,451
(96,379,911)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_5

18/12/2017 10:02:34

1 hour 31 mins 2 secs

1,675

20

81.3%
(DNS: 1.0%, Conn: 1.3%
T-out: 3.7%, 404s: 7.5%
Robots: 3.2%, Other: 2.1%)

464,900
(15,358)

34,267,661
(1,149,000)

3,514,356,903
(91,104,474)

Total (19 nodes)

19,681

837

-

14,319,335
(470,623)

984,647,854
(33,153,110)

75,101,063,771
(1,942,074,382)

The following chart shows Majestic12's contribution (blue) to overall crawling effort by day.

Last updated: 18 Dec 2017 10:02:57:900 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12