Majestic-12 : DSearch : User Info
X Grubbers Kick Ass (Join this team)
Current run successes
v1.7.16 (.NET 4.5) Windows
5 hours 16 mins 9 secs
(DNS: 1.5%, Conn: 3.9%
T-out: 1.2%, 404s: 10.3%
Robots: 3.1%, Other: 4.0%)
The following chart shows Grubee's contribution (blue) to overall crawling effort by day.
* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
Last updated: 19 Dec 2018 00:59:01:033 GMT
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else