Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Majestic12

Country:

United Kingdom United Kingdom

ID:

3684

Team:

Not in a team yet. Join one now!

Joined:

01/10/2010 14:16:00

URLs crawled:

577,839,738,602

Data (MB)*:

13,901,741,660

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

CHDN003_1

22/05/2019 02:42:46

1 hour 46 mins 1 sec

884

17

77.3%
(DNS: 1.8%, Conn: 1.5%
T-out: 5.1%, 404s: 8.4%
Robots: 0.7%, Other: 5.3%)

244,585
(6,463)

28,594,654
(855,671)

5,107,603,607
(133,664,028)

v1.7.16 (.NET 4.5)   Linux

CHDN004_9

22/05/2019 02:44:35

1 min 0 sec

1,200

n/a

79.5%
(DNS: 0.0%, Conn: 0.5%
T-out: 0.2%, 404s: 16.4%
Robots: 0.5%, Other: 2.9%)

223,705
(5,372)

25,871,469
(776,355)

1,738,837,662
(53,882,928)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_5

22/05/2019 02:45:53

46 mins 0 sec

826

3

78.1%
(DNS: 5.5%, Conn: 0.3%
T-out: 4.2%, 404s: 4.8%
Robots: 0.2%, Other: 6.8%)

127,089
(2,746)

17,158,483
(524,746)

4,016,479,222
(106,828,483)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_1

22/05/2019 02:46:54

1 min 0 sec

1,061

48

70.0%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.4%, 404s: 20.0%
Robots: 3.4%, Other: 6.1%)

209,416
(4,682)

25,307,706
(757,403)

4,507,045,603
(122,488,809)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_5

22/05/2019 02:47:10

1 hour 1 min 1 sec

1,664

9

72.2%
(DNS: 3.1%, Conn: 0.5%
T-out: 3.4%, 404s: 11.9%
Robots: 1.7%, Other: 7.3%)

223,686
(5,679)

26,335,915
(788,360)

6,051,994,346
(152,036,324)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_5

22/05/2019 02:47:35

1 min 0 sec

1,155

n/a

74.5%
(DNS: 0.0%, Conn: 0.4%
T-out: 0.2%, 404s: 12.4%
Robots: 0.0%, Other: 12.4%)

202,560
(4,969)

25,749,333
(766,150)

2,541,022,370
(72,758,806)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_1

22/05/2019 02:47:47

46 mins 0 sec

2,294

12

74.5%
(DNS: 3.7%, Conn: 0.7%
T-out: 6.0%, 404s: 5.0%
Robots: 1.0%, Other: 9.2%)

221,262
(5,934)

25,581,613
(759,537)

4,806,182,331
(131,318,094)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_1

22/05/2019 02:49:17

46 mins 1 sec

2,423

7

77.0%
(DNS: 2.3%, Conn: 0.7%
T-out: 2.8%, 404s: 8.9%
Robots: 0.7%, Other: 7.6%)

223,872
(5,953)

26,271,945
(790,388)

5,242,055,640
(132,636,005)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_5

22/05/2019 02:50:43

46 mins 0 sec

2,504

8

79.2%
(DNS: 3.1%, Conn: 1.3%
T-out: 4.1%, 404s: 7.5%
Robots: 0.7%, Other: 4.2%)

235,306
(6,149)

25,765,566
(769,848)

5,542,810,568
(150,845,563)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_5

22/05/2019 02:51:10

1 hour 31 mins 1 sec

1,505

7

76.6%
(DNS: 2.2%, Conn: 0.7%
T-out: 3.2%, 404s: 9.8%
Robots: 1.2%, Other: 6.3%)

202,525
(5,524)

25,495,022
(765,897)

4,457,202,938
(121,899,240)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_1

22/05/2019 02:51:53

31 mins 1 sec

4,568

7

76.4%
(DNS: 2.5%, Conn: 1.0%
T-out: 2.7%, 404s: 10.0%
Robots: 1.0%, Other: 6.3%)

216,143
(5,557)

26,032,819
(773,702)

3,208,720,049
(89,617,026)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_1

22/05/2019 02:53:58

1 hour 46 mins 1 sec

1,611

12

75.4%
(DNS: 1.8%, Conn: 1.8%
T-out: 3.2%, 404s: 10.3%
Robots: 0.7%, Other: 6.8%)

250,495
(6,432)

26,564,483
(796,517)

4,590,706,743
(129,040,955)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_5

22/05/2019 02:54:54

1 hour 1 min 2 secs

2,546

8

77.8%
(DNS: 0.5%, Conn: 0.6%
T-out: 3.5%, 404s: 9.1%
Robots: 0.8%, Other: 7.8%)

199,671
(5,257)

26,802,414
(802,188)

6,914,654,264
(177,620,191)

v1.7.16 (.NET 4.5)   Linux

CHDN004_1

22/05/2019 02:55:38

1 hour 31 mins 1 sec

1,663

7

78.8%
(DNS: 1.7%, Conn: 0.5%
T-out: 2.1%, 404s: 8.6%
Robots: 0.7%, Other: 7.6%)

210,149
(5,763)

25,812,143
(777,414)

5,444,780,195
(145,688,678)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_5

22/05/2019 02:55:53

1 hour 16 mins 1 sec

2,332

7

79.3%
(DNS: 4.1%, Conn: 1.2%
T-out: 0.7%, 404s: 6.8%
Robots: 1.1%, Other: 7.0%)

217,652
(5,292)

26,468,251
(787,763)

5,132,524,328
(137,288,224)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_5

22/05/2019 02:56:18

31 mins 1 sec

4,502

4

75.0%
(DNS: 5.4%, Conn: 0.8%
T-out: 2.6%, 404s: 8.7%
Robots: 1.7%, Other: 5.9%)

222,522
(5,568)

25,635,832
(767,810)

4,663,339,945
(126,422,400)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_1

22/05/2019 02:57:37

1 hour 1 min 0 sec

3,005

15

77.0%
(DNS: 2.2%, Conn: 0.7%
T-out: 2.4%, 404s: 8.6%
Robots: 1.2%, Other: 7.8%)

218,324
(5,376)

26,299,851
(786,308)

6,612,023,683
(169,131,716)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_1

22/05/2019 02:57:40

46 mins 1 sec

3,595

6

77.7%
(DNS: 2.8%, Conn: 2.2%
T-out: 2.1%, 404s: 7.1%
Robots: 0.8%, Other: 7.3%)

228,263
(6,166)

25,510,929
(768,063)

4,668,887,201
(126,899,190)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_1

22/05/2019 02:57:52

1 hour 31 mins 2 secs

2,180

10

78.3%
(DNS: 1.6%, Conn: 1.3%
T-out: 1.7%, 404s: 9.0%
Robots: 0.8%, Other: 7.3%)

201,803
(5,621)

26,124,188
(784,078)

5,086,620,619
(136,838,082)

Total (19 nodes)

41,518

187

-

4,079,028
(104,503)

487,382,616
(14,598,198)

90,333,491,314
(2,416,904,742)

The following chart shows Majestic12's contribution (blue) to overall crawling effort by day.

Last updated: 22 May 2019 02:59:07:607 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12