Majestic-12 : DSearch : User Info
Ars Technica (Join this team)
none used recently or versions older than v1.0.0
The following chart shows Dark Star's contribution (blue) to overall crawling effort by day.
* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
Last updated: 20 Jun 2018 03:00:19:007 GMT
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else