Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Majestic12

Country:

United Kingdom United Kingdom

ID:

3684

Team:

Not in a team yet. Join one now!

Joined:

01/10/2010 14:16:00

URLs crawled:

560,178,235,774

Data (MB)*:

13,345,909,340

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_1

26/09/2017 16:48:04

46 mins 1 sec

1,806

19

76.3%
(DNS: 0.8%, Conn: 0.1%
T-out: 2.7%, 404s: 9.1%
Robots: 2.9%, Other: 7.9%)

781,381
(25,668)

36,717,135
(1,224,744)

4,434,205,858
(106,909,841)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_5

26/09/2017 16:48:04

46 mins 1 sec

2,490

29

78.1%
(DNS: 1.4%, Conn: 0.4%
T-out: 3.3%, 404s: 12.5%
Robots: 2.4%, Other: 1.9%)

925,788
(30,195)

51,384,184
(1,723,807)

4,093,101,153
(103,693,178)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_5

26/09/2017 16:50:12

1 hour 1 min 0 sec

2,141

18

78.8%
(DNS: 1.7%, Conn: 0.9%
T-out: 1.5%, 404s: 12.4%
Robots: 2.2%, Other: 2.6%)

971,214
(32,921)

48,292,546
(1,608,065)

1,600,864,204
(42,474,026)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_1

26/09/2017 16:50:34

1 hour 16 mins 2 secs

3,567

26

76.2%
(DNS: 3.5%, Conn: 1.4%
T-out: 1.8%, 404s: 9.3%
Robots: 2.2%, Other: 5.5%)

951,884
(31,760)

52,153,048
(1,722,425)

3,511,338,967
(94,892,017)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_1

26/09/2017 16:50:37

1 hour 31 mins 2 secs

2,270

12

78.9%
(DNS: 2.5%, Conn: 0.5%
T-out: 2.9%, 404s: 8.9%
Robots: 2.8%, Other: 3.6%)

928,445
(31,726)

49,299,188
(1,638,653)

3,826,622,522
(100,254,481)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_5

26/09/2017 16:52:28

1 hour 1 min 2 secs

2,668

28

82.4%
(DNS: 1.0%, Conn: 1.6%
T-out: 2.5%, 404s: 6.8%
Robots: 2.3%, Other: 3.4%)

901,543
(30,794)

48,823,011
(1,624,231)

3,477,717,141
(90,256,001)

v1.7.16 (.NET 4.5)   Linux

CHDN003_1

26/09/2017 16:52:56

46 mins 1 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

7,443,063
(239,677)

4,428,788,542
(113,793,137)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MJ12-leaseweb4_1

26/09/2017 16:53:01

31 mins 0 sec

428

21

82.5%
(DNS: 0.3%, Conn: 0.0%
T-out: 8.4%, 404s: 6.1%
Robots: 0.4%, Other: 2.3%)

891,104
(29,105)

46,694,874
(1,443,993)

5,699,418,559
(142,789,551)

v1.7.16 (.NET 4.5)   Linux

CHDN004_9

26/09/2017 16:56:12

3 hours 46 mins 7 secs

1,515

19

77.0%
(DNS: 4.3%, Conn: 1.7%
T-out: 2.1%, 404s: 7.0%
Robots: 3.0%, Other: 5.1%)

950,956
(30,207)

50,668,885
(1,689,391)

703,447,467
(20,942,728)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_1

26/09/2017 16:56:38

1 hour 46 mins 2 secs

2,937

13

79.2%
(DNS: 2.8%, Conn: 1.3%
T-out: 2.0%, 404s: 8.2%
Robots: 3.3%, Other: 3.1%)

840,265
(28,260)

47,643,488
(1,587,779)

3,736,277,631
(96,660,257)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_5

26/09/2017 16:56:42

1 hour 46 mins 3 secs

2,299

14

76.0%
(DNS: 4.7%, Conn: 0.5%
T-out: 2.1%, 404s: 8.2%
Robots: 3.4%, Other: 5.2%)

772,632
(26,061)

46,309,602
(1,551,055)

3,658,187,375
(95,121,362)

v1.7.16 (.NET 4.5)   Linux

CHDN004_1

26/09/2017 16:56:46

1 hour 16 mins 2 secs

3,219

36

78.1%
(DNS: 2.6%, Conn: 1.2%
T-out: 0.8%, 404s: 7.6%
Robots: 5.8%, Other: 3.8%)

946,585
(31,195)

48,642,088
(1,627,795)

4,448,299,801
(113,978,899)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_5

26/09/2017 16:58:22

1 hour 31 mins 2 secs

3,134

33

78.8%
(DNS: 2.6%, Conn: 1.4%
T-out: 2.2%, 404s: 7.3%
Robots: 3.8%, Other: 4.0%)

1,001,389
(33,819)

50,470,142
(1,684,933)

4,529,257,698
(118,733,202)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_1

26/09/2017 16:59:33

1 hour 1 min 2 secs

2,178

27

78.7%
(DNS: 1.7%, Conn: 1.0%
T-out: 2.2%, 404s: 7.3%
Robots: 3.9%, Other: 5.3%)

1,001,372
(34,022)

50,524,815
(1,697,821)

4,065,081,081
(103,791,978)

v1.7.15 Update 2.3 (.NET 4.5)   Linux

MJ12-leaseweb4_5

26/09/2017 16:59:47

1 hour 46 mins 3 secs

2,870

18

80.0%
(DNS: 3.8%, Conn: 0.3%
T-out: 2.1%, 404s: 6.3%
Robots: 3.3%, Other: 4.1%)

945,752
(30,997)

47,818,623
(1,477,957)

5,139,803,459
(125,712,593)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_1

26/09/2017 17:00:35

1 hour 1 min 3 secs

2,118

24

74.6%
(DNS: 2.0%, Conn: 0.8%
T-out: 2.5%, 404s: 10.6%
Robots: 3.4%, Other: 6.2%)

786,385
(27,445)

44,312,958
(1,485,338)

2,234,267,748
(59,196,449)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_5

26/09/2017 17:01:14

1 hour 1 min 2 secs

1,256

41

79.9%
(DNS: 0.1%, Conn: 0.4%
T-out: 4.2%, 404s: 6.2%
Robots: 3.7%, Other: 5.4%)

736,874
(23,590)

43,557,515
(1,448,621)

6,035,260,983
(149,567,483)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_5

26/09/2017 17:01:52

1 min 0 sec

277

n/a

92.1%
(DNS: 0.0%, Conn: 1.6%
T-out: 0.0%, 404s: 0.0%
Robots: 0.0%, Other: 6.3%)

522,691
(15,668)

28,579,460
(950,866)

3,429,450,046
(88,278,379)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_1

26/09/2017 17:02:07

1 hour 16 mins 0 sec

2,410

20

80.8%
(DNS: 2.3%, Conn: 1.3%
T-out: 1.9%, 404s: 7.7%
Robots: 2.4%, Other: 3.6%)

971,821
(33,765)

45,969,722
(1,541,456)

3,620,598,251
(94,026,860)

Total (19 nodes)

39,583

398

-

15,828,081
(527,198)

845,304,347
(27,968,607)

72,671,988,486
(1,861,072,422)

The following chart shows Majestic12's contribution (blue) to overall crawling effort by day.

Last updated: 26 Sep 2017 17:02:44:843 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12