Majestic-12 : DSearch : User Info
X Grubbers Kick Ass (Join this team)
Current run successes
v1.7.16 (.NET 4.5) Windows
15 hours 1 min 27 secs
(DNS: 0.2%, Conn: 2.7%
T-out: 0.7%, 404s: 9.1%
Robots: 2.8%, Other: 4.1%)
The following chart shows Grubee's contribution (blue) to overall crawling effort by day.
* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
Last updated: 16 Jan 2018 10:00:34:507 GMT
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else