Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Majestic12

Country:

United Kingdom United Kingdom

ID:

3684

Team:

Not in a team yet. Join one now!

Joined:

01/10/2010 14:16:00

URLs crawled:

560,818,472,673

Data (MB)*:

13,367,091,181

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

CHDN004_9

21/10/2017 15:45:03

3 hours 46 mins 5 secs

1,185

12

80.1%
(DNS: 1.1%, Conn: 2.6%
T-out: 1.9%, 404s: 6.7%
Robots: 3.8%, Other: 3.8%)

1,134,041
(40,710)

46,289,169
(1,542,318)

741,198,757
(22,205,761)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_5

21/10/2017 15:46:23

46 mins 1 sec

51

15

84.2%
(DNS: 0.0%, Conn: 0.0%
T-out: 9.3%, 404s: 0.0%
Robots: 0.0%, Other: 6.5%)

1,160,986
(39,402)

46,400,711
(1,540,761)

4,567,189,646
(119,991,125)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MJ12-leaseweb4_1

21/10/2017 15:49:12

3 hours 46 mins 2 secs

858

14

80.3%
(DNS: 3.9%, Conn: 1.6%
T-out: 1.8%, 404s: 5.5%
Robots: 3.0%, Other: 4.0%)

1,103,765
(39,218)

44,728,487
(1,477,699)

5,736,289,355
(144,005,360)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_1

21/10/2017 15:52:58

16 mins 1 sec

339

21

82.2%
(DNS: 0.0%, Conn: 0.4%
T-out: 1.5%, 404s: 14.1%
Robots: 0.1%, Other: 1.7%)

1,125,694
(37,885)

44,066,764
(1,452,531)

3,772,248,431
(97,846,086)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_5

21/10/2017 15:54:52

1 hour 16 mins 2 secs

407

19

78.1%
(DNS: 0.1%, Conn: 0.3%
T-out: 4.8%, 404s: 5.9%
Robots: 6.6%, Other: 4.2%)

1,219,536
(41,452)

46,941,377
(1,542,518)

4,131,465,023
(104,951,976)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_5

21/10/2017 15:58:31

1 min 0 sec

702

n/a

52.2%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.0%, 404s: 13.3%
Robots: 29.0%, Other: 5.6%)

1,104,932
(37,637)

45,096,624
(1,479,571)

3,514,525,397
(91,467,639)

v1.7.16 (.NET 4.5)   Linux

CHDN003_1

21/10/2017 15:58:38

16 mins 1 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

4,428,788,542
(113,793,137)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MJ12-leaseweb4_5

21/10/2017 15:59:46

3 hours 46 mins 2 secs

1,368

14

80.1%
(DNS: 4.1%, Conn: 0.4%
T-out: 1.6%, 404s: 6.3%
Robots: 2.4%, Other: 5.0%)

1,172,070
(40,907)

45,413,249
(1,499,051)

5,177,116,361
(126,942,938)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_1

21/10/2017 15:59:49

16 mins 1 sec

30

6

42.1%
(DNS: 0.0%, Conn: 0.0%
T-out: 2.2%, 404s: 0.0%
Robots: 0.0%, Other: 55.7%)

1,165,072
(40,748)

47,986,622
(1,583,561)

3,550,766,742
(96,190,013)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_5

21/10/2017 15:59:55

16 mins 0 sec

166

22

64.0%
(DNS: 0.0%, Conn: 0.0%
T-out: 10.1%, 404s: 3.4%
Robots: 0.1%, Other: 22.5%)

1,085,820
(35,075)

48,051,006
(1,592,802)

1,640,224,001
(43,780,173)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_5

21/10/2017 15:59:58

46 mins 2 secs

336

23

78.9%
(DNS: 0.1%, Conn: 0.0%
T-out: 4.3%, 404s: 5.6%
Robots: 0.0%, Other: 11.0%)

1,065,763
(39,162)

38,528,875
(1,274,627)

6,067,167,371
(150,625,405)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_5

21/10/2017 15:59:59

1 hour 1 min 1 sec

616

15

81.8%
(DNS: 2.9%, Conn: 0.1%
T-out: 1.5%, 404s: 7.7%
Robots: 0.5%, Other: 5.7%)

631,819
(20,753)

26,843,399
(886,355)

3,451,610,903
(89,008,834)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_1

21/10/2017 16:00:05

16 mins 1 sec

20

5

100.0%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.0%, 404s: 0.0%
Robots: 0.0%, Other: 0.0%)

1,056,023
(35,802)

40,175,297
(1,343,253)

2,267,245,435
(60,296,373)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_1

21/10/2017 16:00:07

1 hour 31 mins 1 sec

283

16

82.3%
(DNS: 0.1%, Conn: 0.4%
T-out: 4.0%, 404s: 9.5%
Robots: 0.1%, Other: 3.7%)

1,149,474
(39,036)

46,541,134
(1,551,225)

4,103,039,585
(105,056,864)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_1

21/10/2017 16:00:31

16 mins 0 sec

118

13

80.9%
(DNS: 0.0%, Conn: 0.0%
T-out: 17.2%, 404s: 0.0%
Robots: 0.0%, Other: 1.9%)

990,945
(33,529)

44,936,365
(1,492,451)

3,863,353,642
(101,473,155)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_5

21/10/2017 16:00:34

16 mins 1 sec

4

15

39.3%
(DNS: 0.0%, Conn: 0.0%
T-out: 41.6%, 404s: 0.0%
Robots: 0.0%, Other: 19.1%)

1,067,575
(35,901)

40,967,397
(1,362,296)

3,691,759,808
(96,236,529)

v1.7.16 (.NET 4.5)   Linux

CHDN004_1

21/10/2017 16:00:42

16 mins 1 sec

58

7

61.4%
(DNS: 0.0%, Conn: 5.4%
T-out: 33.1%, 404s: 0.0%
Robots: 0.0%, Other: 0.0%)

1,115,685
(38,728)

45,522,636
(1,513,953)

4,485,569,539
(115,219,288)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_1

21/10/2017 16:00:45

1 hour 46 mins 3 secs

939

11

85.0%
(DNS: 0.3%, Conn: 0.2%
T-out: 0.6%, 404s: 8.5%
Robots: 2.8%, Other: 2.6%)

1,001,342
(33,958)

34,940,113
(1,152,400)

4,462,735,241
(107,846,184)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_1

21/10/2017 16:00:52

16 mins 0 sec

48

30

63.2%
(DNS: 0.0%, Conn: 0.3%
T-out: 25.3%, 404s: 0.0%
Robots: 0.0%, Other: 11.3%)

1,102,792
(36,565)

47,887,948
(1,576,230)

3,659,692,400
(95,308,636)

Total (19 nodes)

7,528

258

-

19,453,334
(666,468)

781,317,173
(25,863,602)

73,311,986,179
(1,882,245,476)

The following chart shows Majestic12's contribution (blue) to overall crawling effort by day.

Last updated: 21 Oct 2017 17:01:13:860 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12