Majestic-12 : DSearch : User Info
Crawl to freedom (Join this team)
Current run successes
v1.7.15 (.NET 4.5) Windows
1 day 15 hours 17 mins 24 secs
(DNS: 1.3%, Conn: 2.3%
T-out: 0.4%, 404s: 8.3%
Robots: 2.6%, Other: 4.0%)
The following chart shows sportman's contribution (blue) to overall crawling effort by day.
* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
Last updated: 20 Nov 2017 19:02:02:227 GMT
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else