Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Majestic12

Country:

United Kingdom United Kingdom

ID:

3684

Team:

Not in a team yet. Join one now!

Joined:

01/10/2010 14:16:00

URLs crawled:

550,433,262,255

Data (MB)*:

13,028,908,764

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_5

17/03/2017 13:28:57

2 hours 1 min 5 secs

6,742

41

82.3%
(DNS: 2.0%, Conn: 1.0%
T-out: 1.8%, 404s: 6.9%
Robots: 1.7%, Other: 4.2%)

0
(0)

51,709,845
(1,711,636)

1,300,530,506
(32,576,521)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_5

23/03/2017 05:37:54

16 mins 1 sec

2,920

n/a

88.6%
(DNS: 0.3%, Conn: 0.2%
T-out: 1.6%, 404s: 5.3%
Robots: 0.2%, Other: 3.7%)

450,426
(10,542)

81,134,114
(2,248,882)

3,684,953,571
(90,544,065)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb6_1

23/03/2017 05:46:18

46 mins 0 sec

732

20

87.3%
(DNS: 0.1%, Conn: 0.5%
T-out: 3.9%, 404s: 4.8%
Robots: 0.2%, Other: 3.3%)

457,873
(15,396)

75,856,081
(2,525,219)

1,289,456,934
(34,611,031)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb2_5

23/03/2017 05:47:21

16 mins 0 sec

591

2

79.4%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.6%, 404s: 9.3%
Robots: 0.4%, Other: 10.3%)

482,580
(14,803)

73,044,688
(2,435,922)

4,776,993,127
(114,331,919)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_5

23/03/2017 05:47:27

1 hour 31 mins 2 secs

951

29

75.7%
(DNS: 3.6%, Conn: 2.4%
T-out: 1.3%, 404s: 10.7%
Robots: 0.6%, Other: 5.8%)

374,916
(12,016)

48,586,188
(1,614,809)

3,192,479,177
(80,462,697)

v1.7.16 (.NET 4.5)   Linux

CHDN004_9

23/03/2017 05:47:34

1 hour 1 min 2 secs

1,014

26

78.9%
(DNS: 3.8%, Conn: 0.4%
T-out: 2.7%, 404s: 8.1%
Robots: 4.0%, Other: 1.9%)

483,404
(13,350)

83,137,040
(2,125,088)

342,571,253
(9,252,485)

v1.7.16 (.NET 4.5)   Linux

CHDN003_1

23/03/2017 05:47:58

1 hour 46 mins 4 secs

724

34

76.6%
(DNS: 1.4%, Conn: 0.2%
T-out: 3.2%, 404s: 7.1%
Robots: 5.4%, Other: 6.2%)

518,377
(16,380)

82,531,728
(2,727,197)

4,060,198,030
(101,834,475)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_1

23/03/2017 05:48:35

31 mins 1 sec

163

52

84.6%
(DNS: 0.0%, Conn: 0.0%
T-out: 9.2%, 404s: 4.9%
Robots: 0.0%, Other: 1.3%)

526,521
(13,959)

69,915,696
(1,950,045)

1,855,611,102
(47,354,453)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_5

23/03/2017 05:50:59

1 hour 1 min 2 secs

689

8

73.9%
(DNS: 2.8%, Conn: 0.5%
T-out: 0.8%, 404s: 7.5%
Robots: 6.3%, Other: 8.1%)

447,794
(15,316)

61,379,405
(2,030,701)

4,798,748,885
(114,688,224)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_1

23/03/2017 05:51:08

1 hour 16 mins 1 sec

945

17

79.8%
(DNS: 0.5%, Conn: 0.5%
T-out: 1.2%, 404s: 10.1%
Robots: 4.3%, Other: 3.6%)

402,768
(13,245)

63,182,928
(1,884,057)

3,448,141,685
(88,300,902)

v1.7.16 (.NET 4.5)   Linux

evo-h121-1_5

23/03/2017 05:51:24

1 hour 16 mins 3 secs

661

14

83.6%
(DNS: 2.0%, Conn: 0.1%
T-out: 2.3%, 404s: 4.3%
Robots: 3.6%, Other: 4.1%)

529,331
(18,239)

75,422,900
(2,514,871)

5,524,679,956
(131,320,696)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_1

23/03/2017 05:51:38

1 hour 16 mins 2 secs

442

10

82.8%
(DNS: 0.4%, Conn: 0.1%
T-out: 2.3%, 404s: 7.3%
Robots: 2.8%, Other: 4.3%)

558,595
(18,697)

82,937,556
(2,743,991)

3,096,941,394
(81,251,233)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_1

23/03/2017 05:51:48

1 hour 31 mins 4 secs

1,448

23

78.7%
(DNS: 1.7%, Conn: 0.8%
T-out: 3.4%, 404s: 6.0%
Robots: 4.6%, Other: 4.9%)

471,944
(14,656)

58,058,671
(1,630,475)

3,363,210,796
(84,677,949)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_5

23/03/2017 05:52:42

46 mins 2 secs

791

29

71.2%
(DNS: 2.7%, Conn: 0.6%
T-out: 1.1%, 404s: 9.5%
Robots: 9.7%, Other: 5.2%)

418,159
(13,837)

51,557,241
(1,707,415)

5,718,056,879
(139,108,072)

v1.7.16 (.NET 4.5)   Linux

evo-h121-1_1

23/03/2017 05:53:37

1 hour 31 mins 2 secs

1,163

23

72.9%
(DNS: 1.7%, Conn: 1.5%
T-out: 4.2%, 404s: 9.1%
Robots: 6.3%, Other: 4.2%)

528,718
(16,933)

78,131,229
(2,588,845)

5,314,903,142
(126,369,466)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb2_1

23/03/2017 05:54:26

16 mins 0 sec

1,763

23

83.5%
(DNS: 2.8%, Conn: 0.3%
T-out: 1.6%, 404s: 1.1%
Robots: 6.9%, Other: 3.7%)

588,776
(19,982)

71,514,368
(2,393,186)

5,258,382,085
(128,016,419)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_5

23/03/2017 05:54:32

1 hour 1 min 2 secs

1,343

22

81.2%
(DNS: 2.1%, Conn: 0.7%
T-out: 0.9%, 404s: 7.5%
Robots: 3.2%, Other: 4.4%)

513,297
(15,772)

74,378,569
(2,265,364)

4,126,136,293
(105,944,188)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_5

23/03/2017 05:55:04

1 hour 46 mins 4 secs

825

12

59.8%
(DNS: 21.1%, Conn: 0.3%
T-out: 1.8%, 404s: 7.9%
Robots: 3.8%, Other: 5.4%)

470,307
(13,146)

77,951,666
(2,237,612)

3,258,319,117
(82,498,068)

v1.7.16 (.NET 4.5)   Linux

CHDN004_1

23/03/2017 05:56:19

1 hour 1 min 2 secs

1,763

12

74.8%
(DNS: 5.0%, Conn: 0.1%
T-out: 4.2%, 404s: 10.9%
Robots: 1.3%, Other: 3.7%)

468,510
(14,036)

76,861,549
(1,883,901)

4,098,943,704
(102,702,283)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_1

23/03/2017 05:56:37

1 hour 31 mins 4 secs

837

15

84.3%
(DNS: 2.0%, Conn: 0.2%
T-out: 1.1%, 404s: 5.2%
Robots: 1.2%, Other: 5.9%)

528,025
(10,942)

79,581,302
(2,147,419)

3,665,280,118
(90,957,798)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_1

23/03/2017 05:56:46

31 mins 0 sec

1,648

17

77.1%
(DNS: 3.0%, Conn: 0.4%
T-out: 0.5%, 404s: 9.9%
Robots: 6.3%, Other: 2.8%)

367,856
(11,843)

44,156,523
(1,461,517)

4,164,015,927
(98,021,936)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_1

23/03/2017 05:57:49

1 hour 31 mins 2 secs

1,244

18

80.9%
(DNS: 1.6%, Conn: 0.2%
T-out: 2.3%, 404s: 5.1%
Robots: 4.0%, Other: 5.9%)

487,363
(15,648)

67,961,156
(2,246,017)

3,217,092,680
(80,673,738)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb6_5

23/03/2017 05:59:07

1 hour 16 mins 1 sec

1,065

8

77.0%
(DNS: 1.0%, Conn: 0.2%
T-out: 5.7%, 404s: 8.7%
Robots: 3.6%, Other: 3.7%)

495,730
(16,086)

75,856,851
(2,535,728)

1,441,355,058
(39,032,646)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_5

23/03/2017 05:59:24

1 hour 46 mins 2 secs

1,070

14

73.3%
(DNS: 1.6%, Conn: 2.1%
T-out: 1.9%, 404s: 10.7%
Robots: 3.7%, Other: 6.6%)

478,432
(15,192)

65,549,543
(1,900,396)

3,086,593,051
(77,639,081)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_1

23/03/2017 05:59:43

16 mins 0 sec

587

35

73.1%
(DNS: 0.0%, Conn: 1.1%
T-out: 6.2%, 404s: 2.4%
Robots: 13.0%, Other: 4.1%)

460,411
(15,073)

53,490,069
(1,758,302)

5,386,771,934
(132,783,933)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb3_5

23/03/2017 06:00:12

1 hour 1 min 0 sec

763

19

84.0%
(DNS: 0.2%, Conn: 1.0%
T-out: 1.7%, 404s: 4.7%
Robots: 5.3%, Other: 3.0%)

619,685
(19,678)

99,407,425
(3,324,179)

6,056,609,456
(148,765,691)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb3_1

23/03/2017 06:00:47

1 hour 46 mins 1 sec

983

24

74.9%
(DNS: 0.7%, Conn: 0.7%
T-out: 2.8%, 404s: 8.3%
Robots: 5.9%, Other: 6.7%)

604,668
(19,944)

98,861,459
(3,302,866)

5,733,955,402
(140,690,132)

Total (27 nodes)

33,867

547

-

12,734,466
(394,711)

1,922,155,790
(59,895,640)

101,260,931,262
(2,504,410,101)

The following chart shows Majestic12's contribution (blue) to overall crawling effort by day.

Last updated: 23 Mar 2017 06:01:24:517 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12