Majestic-12 : DSearch : User Info
X Grubbers Kick Ass (Join this team)
Current run successes
v1.7.16 (.NET 4.5) Windows
7 hours 16 mins 13 secs
(DNS: 0.2%, Conn: 2.3%
T-out: 1.5%, 404s: 9.3%
Robots: 1.8%, Other: 6.2%)
The following chart shows Grubee's contribution (blue) to overall crawling effort by day.
* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
Last updated: 19 Aug 2018 11:55:54:997 GMT
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else