Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

XS_Martijn

Country:

Netherlands Netherlands

ID:

1094

Team:

XtremeSystems (Join this team)

Joined:

24/06/2006 13:24:00

URLs crawled:

18,148,061,247

Data (MB)*:

497,180,010

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

Z10PE-D8-1088

16/10/2018 14:48:09

11 hours 16 mins 22 secs

6,423

26

73.4%
(DNS: 2.4%, Conn: 1.2%
T-out: 2.2%, 404s: 10.7%
Robots: 2.1%, Other: 8.1%)

1,079,137
(32,843)

31,499,332
(951,810)

178,157,199
(5,481,565)

v1.7.16 (.NET 4.5)   Linux

Z10PE-D8-1089

16/10/2018 14:48:20

11 hours 16 mins 23 secs

6,169

28

71.0%
(DNS: 2.0%, Conn: 1.1%
T-out: 2.5%, 404s: 11.1%
Robots: 2.7%, Other: 9.6%)

1,181,650
(35,627)

29,709,042
(913,241)

169,171,836
(5,206,219)

v1.7.16 (.NET 4.5)   Linux

Z10PE-D8-1092

16/10/2018 14:49:11

11 hours 16 mins 25 secs

6,520

25

72.7%
(DNS: 2.6%, Conn: 1.0%
T-out: 1.8%, 404s: 11.3%
Robots: 2.5%, Other: 8.2%)

1,096,377
(32,956)

31,587,329
(957,636)

175,024,204
(5,368,966)

v1.7.16 (.NET 4.5)   Linux

Z10PE-D8-1093

16/10/2018 14:49:27

11 hours 16 mins 21 secs

6,516

29

72.4%
(DNS: 1.7%, Conn: 0.9%
T-out: 1.7%, 404s: 11.5%
Robots: 2.7%, Other: 9.2%)

1,228,222
(37,857)

30,652,397
(934,794)

172,883,065
(5,317,102)

v1.7.16 (.NET 4.5)   Linux

Z10PE-D8-1090

16/10/2018 14:58:35

11 hours 16 mins 22 secs

5,707

27

71.9%
(DNS: 2.2%, Conn: 1.6%
T-out: 2.7%, 404s: 10.0%
Robots: 2.6%, Other: 9.0%)

1,124,787
(34,783)

31,550,382
(953,348)

173,691,347
(5,326,851)

v1.7.16 (.NET 4.5)   Linux

Z10PE-D8-1091

16/10/2018 14:58:50

11 hours 16 mins 23 secs

6,046

29

73.3%
(DNS: 1.6%, Conn: 0.7%
T-out: 2.1%, 404s: 11.1%
Robots: 2.5%, Other: 8.7%)

1,203,312
(36,427)

32,051,764
(979,102)

173,616,873
(5,337,032)

Total (6 nodes)

37,381

164

-

6,913,485
(210,493)

187,050,246
(5,689,931)

1,042,544,524
(32,037,735)

The following chart shows XS_Martijn's contribution (blue) to overall crawling effort by day.

Last updated: 16 Oct 2018 15:00:02:027 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12