Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Majestic12

Country:

United Kingdom United Kingdom

ID:

3684

Team:

Not in a team yet. Join one now!

Joined:

01/10/2010 14:16:00

URLs crawled:

570,401,593,063

Data (MB)*:

13,675,615,922

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_1

20/06/2018 11:35:55

1 hour 16 mins 5 secs

1,197

15

48.8%
(DNS: 35.1%, Conn: 1.2%
T-out: 5.1%, 404s: 7.1%
Robots: 0.7%, Other: 2.0%)

867,367
(24,918)

48,422,528
(1,203,777)

6,269,032,706
(158,977,439)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_5

20/06/2018 11:52:05

16 mins 0 sec

2,092

48

65.1%
(DNS: 3.9%, Conn: 0.1%
T-out: 12.8%, 404s: 10.7%
Robots: 1.8%, Other: 5.7%)

1,043,430
(33,220)

44,528,788
(1,425,877)

6,518,068,343
(165,469,586)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_1

20/06/2018 11:53:33

16 mins 1 sec

1,245

42

67.7%
(DNS: 0.0%, Conn: 0.1%
T-out: 0.3%, 404s: 17.4%
Robots: 0.0%, Other: 14.6%)

1,265,056
(40,659)

53,292,114
(1,726,025)

4,680,510,366
(124,114,773)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_1

20/06/2018 11:55:18

16 mins 0 sec

2,815

30

77.5%
(DNS: 0.1%, Conn: 0.8%
T-out: 7.3%, 404s: 10.2%
Robots: 0.3%, Other: 3.7%)

929,367
(30,201)

40,876,407
(1,329,039)

4,858,154,323
(120,914,354)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_5

20/06/2018 11:56:48

46 mins 1 sec

2,458

23

72.6%
(DNS: 2.7%, Conn: 1.5%
T-out: 7.5%, 404s: 7.1%
Robots: 4.8%, Other: 3.8%)

1,214,166
(39,281)

52,640,476
(1,693,048)

4,061,116,166
(109,424,111)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_1

20/06/2018 11:57:52

16 mins 0 sec

1,166

46

72.2%
(DNS: 9.6%, Conn: 0.2%
T-out: 0.2%, 404s: 10.7%
Robots: 0.2%, Other: 6.9%)

1,148,158
(35,013)

48,570,338
(1,564,870)

4,286,848,024
(114,870,651)

v1.7.16 (.NET 4.5)   Linux

CHDN003_1

20/06/2018 11:58:45

31 mins 0 sec

1,137

20

67.1%
(DNS: 9.3%, Conn: 0.7%
T-out: 6.9%, 404s: 5.0%
Robots: 0.6%, Other: 10.4%)

856,404
(25,702)

51,043,552
(1,516,229)

4,706,042,871
(122,313,938)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_5

20/06/2018 11:59:01

31 mins 1 sec

1,106

22

56.5%
(DNS: 5.9%, Conn: 0.1%
T-out: 1.4%, 404s: 11.6%
Robots: 2.9%, Other: 21.5%)

1,068,643
(29,974)

52,987,163
(1,653,331)

5,124,767,084
(138,308,675)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_5

20/06/2018 11:59:37

16 mins 0 sec

967

22

69.9%
(DNS: 2.2%, Conn: 0.7%
T-out: 0.5%, 404s: 14.6%
Robots: 3.2%, Other: 8.9%)

1,273,764
(41,058)

48,985,822
(1,572,451)

2,137,871,073
(60,168,582)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_5

20/06/2018 11:59:46

31 mins 1 sec

871

23

63.9%
(DNS: 1.8%, Conn: 2.3%
T-out: 0.6%, 404s: 22.8%
Robots: 0.3%, Other: 8.1%)

775,677
(22,290)

29,426,965
(900,898)

3,756,293,875
(98,967,253)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_1

20/06/2018 11:59:51

1 hour 1 min 1 sec

2,299

32

69.8%
(DNS: 2.8%, Conn: 0.3%
T-out: 2.3%, 404s: 7.5%
Robots: 3.1%, Other: 14.2%)

1,260,674
(36,013)

50,847,748
(1,487,048)

2,793,216,853
(77,166,268)

v1.7.16 (.NET 4.5)   Linux

CHDN004_9

20/06/2018 11:59:53

1 hour 46 mins 3 secs

1,985

35

56.1%
(DNS: 3.1%, Conn: 0.5%
T-out: 3.0%, 404s: 8.5%
Robots: 6.3%, Other: 22.5%)

1,106,472
(31,370)

54,380,101
(1,714,343)

1,318,566,993
(41,218,812)

v1.7.16 (.NET 4.5)   Linux

CHDN004_1

20/06/2018 11:59:55

31 mins 0 sec

949

39

59.8%
(DNS: 2.9%, Conn: 0.2%
T-out: 0.7%, 404s: 17.6%
Robots: 3.1%, Other: 15.7%)

1,060,893
(29,886)

52,857,793
(1,646,953)

5,036,452,301
(133,365,221)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_1

20/06/2018 11:59:56

31 mins 1 sec

1,671

23

72.6%
(DNS: 1.7%, Conn: 2.7%
T-out: 0.7%, 404s: 14.1%
Robots: 1.7%, Other: 6.4%)

1,183,333
(38,595)

46,517,409
(1,506,796)

4,120,578,080
(110,393,525)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_5

20/06/2018 12:00:00

1 min 0 sec

3

53

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

1,256,912
(34,606)

53,740,120
(1,565,894)

4,243,939,015
(113,835,803)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_1

20/06/2018 12:00:01

31 mins 2 secs

1,455

39

81.9%
(DNS: 2.2%, Conn: 0.5%
T-out: 0.5%, 404s: 4.5%
Robots: 0.3%, Other: 10.2%)

1,184,594
(32,061)

55,068,941
(1,713,047)

4,165,069,872
(116,251,205)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_5

20/06/2018 12:00:03

16 mins 1 sec

1,112

35

92.2%
(DNS: 0.0%, Conn: 0.2%
T-out: 0.2%, 404s: 4.3%
Robots: 1.5%, Other: 1.6%)

1,292,535
(38,779)

55,507,925
(1,780,149)

4,718,475,921
(124,337,649)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_1

20/06/2018 12:00:04

31 mins 2 secs

970

46

43.3%
(DNS: 7.9%, Conn: 0.5%
T-out: 7.5%, 404s: 6.4%
Robots: 0.3%, Other: 34.2%)

1,131,794
(28,224)

50,467,276
(1,563,703)

4,396,449,445
(118,977,397)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_5

20/06/2018 12:00:05

2 hours 31 mins 4 secs

1,574

11

54.0%
(DNS: 29.1%, Conn: 0.6%
T-out: 3.4%, 404s: 7.2%
Robots: 1.8%, Other: 3.9%)

891,088
(23,933)

48,315,921
(1,194,612)

5,703,892,464
(141,703,762)

Total (19 nodes)

27,072

604

-

20,810,327
(615,783)

938,477,387
(28,758,090)

82,895,345,775
(2,190,779,004)

The following chart shows Majestic12's contribution (blue) to overall crawling effort by day.

Last updated: 20 Jun 2018 12:00:25:210 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12