Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Majestic12

Country:

United Kingdom United Kingdom

ID:

3684

Team:

Not in a team yet. Join one now!

Joined:

01/10/2010 14:16:00

URLs crawled:

572,738,303,057

Data (MB)*:

13,747,774,867

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

CHDN004_9

23/09/2018 21:37:08

3 hours 46 mins 3 secs

1,465

17

68.4%
(DNS: 2.5%, Conn: 0.6%
T-out: 3.4%, 404s: 10.8%
Robots: 4.7%, Other: 9.7%)

1,534,593
(46,800)

40,758,457
(1,243,408)

1,456,643,236
(45,386,502)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_5

23/09/2018 21:39:12

1 min 0 sec

41

n/a

76.5%
(DNS: 0.0%, Conn: 0.0%
T-out: 11.8%, 404s: 0.0%
Robots: 0.0%, Other: 11.8%)

989,174
(31,113)

29,381,424
(966,238)

5,812,960,447
(144,643,947)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_1

23/09/2018 21:41:39

1 min 0 sec

94

n/a

47.1%
(DNS: 0.0%, Conn: 0.0%
T-out: 3.9%, 404s: 49.0%
Robots: 0.0%, Other: 0.0%)

1,442,342
(43,556)

39,686,496
(1,204,418)

2,927,403,629
(81,203,207)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_5

23/09/2018 21:42:14

46 mins 0 sec

23

6

28.0%
(DNS: 0.0%, Conn: 0.0%
T-out: 47.7%, 404s: 11.5%
Robots: 0.3%, Other: 12.4%)

874,254
(25,435)

24,748,111
(766,768)

3,837,516,177
(101,424,078)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_1

23/09/2018 21:42:47

31 mins 0 sec

141

7

55.1%
(DNS: 5.2%, Conn: 0.0%
T-out: 14.1%, 404s: 17.6%
Robots: 0.0%, Other: 7.9%)

982,376
(31,447)

30,711,350
(1,014,029)

4,957,679,569
(124,199,929)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb5_5

23/09/2018 21:43:13

1 hour 46 mins 1 sec

1,782

17

67.0%
(DNS: 3.8%, Conn: 1.8%
T-out: 3.6%, 404s: 13.8%
Robots: 4.8%, Other: 5.2%)

1,086,636
(34,002)

33,179,187
(1,095,674)

6,625,619,844
(169,004,741)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_1

23/09/2018 21:43:14

1 hour 31 mins 1 sec

1,041

17

71.8%
(DNS: 0.8%, Conn: 0.3%
T-out: 4.6%, 404s: 13.5%
Robots: 2.8%, Other: 6.3%)

1,495,969
(43,563)

39,831,905
(1,209,981)

4,530,252,559
(123,023,672)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN007_5

23/09/2018 21:43:28

1 hour 46 mins 2 secs

2,182

18

67.8%
(DNS: 2.1%, Conn: 0.4%
T-out: 4.2%, 404s: 13.3%
Robots: 4.5%, Other: 7.7%)

1,504,893
(45,941)

40,735,370
(1,235,248)

4,381,141,185
(117,962,643)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_5

23/09/2018 21:44:02

46 mins 0 sec

142

11

72.9%
(DNS: 0.4%, Conn: 1.9%
T-out: 7.9%, 404s: 7.3%
Robots: 5.0%, Other: 4.7%)

1,256,222
(40,281)

38,511,773
(1,252,743)

4,187,289,416
(113,549,290)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_5

23/09/2018 21:44:09

1 hour 1 min 0 sec

175

12

65.2%
(DNS: 1.8%, Conn: 0.1%
T-out: 2.4%, 404s: 20.4%
Robots: 2.8%, Other: 7.3%)

1,281,693
(41,171)

37,849,450
(1,235,197)

2,265,462,271
(64,333,086)

v1.7.16 (.NET 4.5)   Linux

Leaseweb8_5

23/09/2018 21:44:11

1 hour 31 mins 1 sec

951

20

71.0%
(DNS: 6.6%, Conn: 0.8%
T-out: 2.3%, 404s: 12.7%
Robots: 0.9%, Other: 5.6%)

1,519,947
(44,196)

40,105,575
(1,225,567)

5,259,702,962
(142,369,416)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb4_1

23/09/2018 21:44:51

1 hour 16 mins 0 sec

404

15

67.0%
(DNS: 2.3%, Conn: 1.1%
T-out: 8.6%, 404s: 11.2%
Robots: 6.8%, Other: 3.0%)

1,016,844
(32,882)

29,240,295
(964,689)

6,376,437,215
(161,868,854)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_1

23/09/2018 21:47:01

1 hour 31 mins 0 sec

994

18

75.6%
(DNS: 1.2%, Conn: 1.4%
T-out: 1.6%, 404s: 10.6%
Robots: 3.3%, Other: 6.3%)

1,279,416
(41,755)

37,809,190
(1,244,198)

4,808,465,457
(128,303,544)

v1.7.16 (.NET 4.5)   Linux

CHDN004_1

23/09/2018 21:47:55

1 hour 46 mins 2 secs

2,038

10

71.9%
(DNS: 1.4%, Conn: 1.1%
T-out: 2.3%, 404s: 11.9%
Robots: 2.3%, Other: 9.2%)

1,465,553
(43,230)

39,610,696
(1,222,337)

5,171,846,803
(137,474,554)

v1.7.16 (.NET 4.5)   Linux

MJ12-leaseweb7_1

23/09/2018 21:48:28

1 hour 46 mins 2 secs

1,798

16

69.8%
(DNS: 2.9%, Conn: 1.0%
T-out: 4.5%, 404s: 13.0%
Robots: 5.2%, Other: 3.6%)

1,127,488
(37,550)

37,432,464
(1,227,105)

4,407,046,250
(118,813,539)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN005_5

23/09/2018 21:48:34

1 hour 46 mins 3 secs

2,294

16

73.7%
(DNS: 2.6%, Conn: 0.7%
T-out: 3.1%, 404s: 10.9%
Robots: 3.5%, Other: 5.6%)

1,323,502
(42,341)

38,319,056
(1,259,561)

4,849,934,945
(128,640,249)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN006_1

23/09/2018 21:49:41

16 mins 0 sec

2,362

1

61.1%
(DNS: 4.3%, Conn: 0.1%
T-out: 2.1%, 404s: 9.5%
Robots: 5.8%, Other: 17.1%)

1,462,813
(43,436)

40,588,933
(1,244,934)

4,303,547,586
(120,441,433)

v1.7.16 (.NET 4.5)   Linux

MJ12-CHDN008_1

23/09/2018 21:52:00

16 mins 0 sec

2,936

8

71.7%
(DNS: 2.8%, Conn: 1.0%
T-out: 3.2%, 404s: 7.7%
Robots: 5.7%, Other: 7.9%)

1,194,931
(38,843)

35,568,391
(1,154,800)

4,240,478,303
(114,308,664)

v1.7.16 (.NET 4.5)   Linux

CHDN003_1

23/09/2018 21:52:57

1 hour 46 mins 1 sec

1,472

16

68.6%
(DNS: 2.7%, Conn: 8.3%
T-out: 3.8%, 404s: 10.2%
Robots: 2.5%, Other: 3.9%)

1,378,396
(37,226)

37,590,366
(1,070,485)

4,832,627,915
(125,986,601)

Total (19 nodes)

22,335

225

-

24,217,042
(744,768)

691,658,489
(21,837,380)

85,232,055,769
(2,262,937,949)

The following chart shows Majestic12's contribution (blue) to overall crawling effort by day.

Last updated: 23 Sep 2018 21:53:35:363 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12