Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Majestic12

Country:

United Kingdom United Kingdom

ID:

3684

Team:

Not in a team yet. Join one now!

Joined:

01/10/2010 14:16:00

URLs crawled:

581,014,064,899

Data (MB)*:

14,008,757,886

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.20   Linux

MJ12-leaseweb7_1

14/11/2019 17:40:23

1 hour 46 mins 4 secs

1,448

46

76.6%
(DNS: 0.8%, Conn: 1.0%
T-out: 2.5%, 404s: 12.5%
Robots: 1.7%, Other: 5.0%)

1,625,048
(60,695)

28,904,329
(1,064,583)

4,837,111,306
(132,558,927)

v1.7.20   Linux

MJ12-leaseweb4_1

14/11/2019 17:42:03

46 mins 1 sec

59

37

63.1%
(DNS: 0.0%, Conn: 0.5%
T-out: 21.6%, 404s: 1.9%
Robots: 0.0%, Other: 12.9%)

1,561,929
(58,034)

28,191,789
(1,050,578)

6,782,072,271
(174,838,275)

v1.7.20   Linux

MJ12-leaseweb5_1

14/11/2019 17:48:34

31 mins 2 secs

66

44

66.4%
(DNS: 0.0%, Conn: 0.0%
T-out: 17.6%, 404s: 8.2%
Robots: 0.0%, Other: 7.8%)

1,684,599
(58,563)

29,693,052
(1,097,587)

5,418,849,579
(138,606,584)

v1.7.21   Linux

MJ12-CHDN007_5

14/11/2019 17:49:14

46 mins 2 secs

358

44

68.6%
(DNS: 0.9%, Conn: 0.2%
T-out: 6.2%, 404s: 15.9%
Robots: 0.0%, Other: 8.1%)

1,693,863
(58,972)

29,712,443
(1,105,692)

4,831,343,102
(132,124,041)

v1.7.20   Linux

CHDN004_9

14/11/2019 17:55:34

46 mins 1 sec

338

27

58.7%
(DNS: 0.8%, Conn: 0.2%
T-out: 9.3%, 404s: 20.4%
Robots: 1.6%, Other: 9.0%)

1,608,635
(57,231)

29,256,122
(1,082,076)

1,909,806,741
(59,637,561)

v1.7.20   Linux

Leaseweb8_1

14/11/2019 17:55:34

1 hour 16 mins 2 secs

277

51

73.5%
(DNS: 3.2%, Conn: 0.2%
T-out: 7.5%, 404s: 7.2%
Robots: 0.7%, Other: 7.7%)

1,682,894
(64,054)

30,078,926
(1,109,060)

4,960,728,821
(136,477,638)

v1.7.20   Linux

MJ12-CHDN008_5

14/11/2019 17:55:34

1 hour 31 mins 2 secs

238

40

67.1%
(DNS: 0.2%, Conn: 0.1%
T-out: 6.7%, 404s: 17.1%
Robots: 3.0%, Other: 5.9%)

1,665,054
(61,317)

28,839,614
(1,076,040)

2,709,692,217
(78,495,364)

v1.7.20   Linux

MJ12-CHDN005_1

14/11/2019 17:55:48

1 min 0 sec

155

n/a

84.3%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.0%, 404s: 13.4%
Robots: 0.0%, Other: 2.4%)

1,640,587
(59,888)

29,430,880
(1,078,624)

5,258,695,007
(142,625,256)

v1.7.20   Linux

MJ12-leaseweb5_5

14/11/2019 17:55:52

16 mins 1 sec

264

6

67.1%
(DNS: 7.4%, Conn: 0.0%
T-out: 5.0%, 404s: 16.7%
Robots: 0.8%, Other: 3.1%)

1,707,889
(62,426)

30,014,190
(1,105,705)

7,093,149,858
(183,621,081)

v1.7.20   Linux

MJ12-leaseweb4_5

14/11/2019 17:55:55

46 mins 2 secs

315

26

63.0%
(DNS: 0.1%, Conn: 0.0%
T-out: 12.9%, 404s: 11.9%
Robots: 6.5%, Other: 5.5%)

1,639,506
(61,620)

28,777,557
(1,072,166)

6,223,728,600
(157,804,475)

v1.7.20   Linux

MJ12-CHDN006_1

14/11/2019 17:55:57

46 mins 1 sec

168

47

79.7%
(DNS: 0.0%, Conn: 0.0%
T-out: 4.2%, 404s: 3.7%
Robots: 0.0%, Other: 12.2%)

1,204,716
(45,025)

28,190,957
(1,048,854)

4,757,384,858
(134,635,857)

v1.7.20   Linux

MJ12-leaseweb7_5

14/11/2019 17:56:03

31 mins 1 sec

223

30

72.8%
(DNS: 1.9%, Conn: 0.0%
T-out: 21.1%, 404s: 2.4%
Robots: 0.0%, Other: 1.7%)

1,670,557
(63,465)

29,086,161
(1,083,020)

4,626,988,911
(127,635,233)

v1.7.20   Linux

CHDN004_1

14/11/2019 17:56:06

1 hour 16 mins 1 sec

449

40

76.3%
(DNS: 0.2%, Conn: 2.7%
T-out: 4.3%, 404s: 8.3%
Robots: 1.0%, Other: 7.2%)

1,665,608
(58,054)

29,224,292
(1,077,247)

5,614,455,502
(151,388,140)

v1.7.21   Linux

MJ12-CHDN007_1

14/11/2019 17:56:06

1 hour 16 mins 1 sec

130

25

80.8%
(DNS: 0.4%, Conn: 0.0%
T-out: 0.2%, 404s: 16.8%
Robots: 0.1%, Other: 1.7%)

1,680,082
(64,288)

29,495,942
(1,095,502)

3,376,081,336
(95,291,360)

v1.7.20 RC1   Linux

CHDN003_1

14/11/2019 17:56:10

1 hour 16 mins 2 secs

303

41

76.4%
(DNS: 0.0%, Conn: 0.1%
T-out: 1.5%, 404s: 8.0%
Robots: 3.4%, Other: 10.6%)

1,746,634
(63,785)

30,835,220
(1,138,278)

5,295,267,578
(139,954,218)

v1.7.20   Linux

MJ12-CHDN006_5

14/11/2019 17:56:15

1 hour 46 mins 3 secs

542

30

74.5%
(DNS: 2.4%, Conn: 1.0%
T-out: 2.6%, 404s: 12.5%
Robots: 2.6%, Other: 4.3%)

879,082
(30,318)

17,659,187
(655,441)

4,120,281,669
(110,366,910)

v1.7.20   Linux

MJ12-CHDN005_5

14/11/2019 17:56:18

1 hour 16 mins 2 secs

477

54

69.0%
(DNS: 0.9%, Conn: 0.2%
T-out: 5.6%, 404s: 17.4%
Robots: 0.8%, Other: 6.0%)

1,660,548
(57,284)

29,220,004
(1,081,874)

5,304,638,068
(143,086,252)

v1.7.20   Linux

MJ12-CHDN008_1

14/11/2019 17:56:24

1 hour 16 mins 2 secs

508

28

69.1%
(DNS: 2.7%, Conn: 0.2%
T-out: 5.7%, 404s: 19.6%
Robots: 0.0%, Other: 2.8%)

1,624,652
(57,978)

28,680,750
(1,063,391)

4,674,791,967
(128,215,843)

v1.7.20   Linux

Leaseweb8_5

14/11/2019 17:56:26

1 hour 31 mins 4 secs

993

52

72.6%
(DNS: 2.4%, Conn: 1.1%
T-out: 4.9%, 404s: 13.4%
Robots: 0.6%, Other: 5.0%)

1,730,450
(62,102)

29,793,386
(1,098,859)

5,712,616,426
(156,553,689)

Total (19 nodes)

7,311

668

-

30,372,333
(1,105,099)

545,084,801
(20,184,577)

93,507,683,817
(2,523,916,704)

The following chart shows Majestic12's contribution (blue) to overall crawling effort by day.

Last updated: 14 Nov 2019 17:57:17:160 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12