Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | About

Majestic-12 : DSearch : User Info

Nickname:

thomster

Country:

United Kingdom United Kingdom

ID:

2581

Team:

Not in a team yet. Join one now!

Joined:

13/09/2008 15:06:00

URLs crawled:

174,209,602

Data (MB)*:

6,405,789

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.20   Linux

Fedora

16/01/2020 16:05:56

7 days 22 hours 20 mins 46 secs

816

16

67.1%
(DNS: 12.8%, Conn: 2.3%
T-out: 1.9%, 404s: 10.0%
Robots: 1.9%, Other: 3.9%)

0
(0)

11,672,549
(396,389)

11,672,549
(396,389)

v1.7.20 Windows

NUC

16/01/2020 23:52:54

4 hours 1 min 4 secs

786

10

69.6%
(DNS: 4.9%, Conn: 4.4%
T-out: 0.9%, 404s: 12.1%
Robots: 2.9%, Other: 5.2%)

0
(0)

13,457,802
(507,718)

54,851,423
(2,084,337)

v1.7.20 Windows

VM2

16/01/2020 23:55:25

1 hour 46 mins 5 secs

1,145

21

73.1%
(DNS: 2.1%, Conn: 3.3%
T-out: 1.3%, 404s: 11.0%
Robots: 2.8%, Other: 6.4%)

0
(0)

17,415,651
(666,126)

82,956,405
(3,143,563)

Total (3 nodes)

2,747

47

-

0
(0)

42,546,002
(1,570,233)

149,480,377
(5,624,289)

The following chart shows thomster's contribution (blue) to overall crawling effort by day.

Last updated: 19 Jan 2020 15:59:28:387 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12