Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://patdavies.net/

Joined:

18/10/2005 21:15:00

URLs crawled:

94,434,819,820

Data (MB)*:

2,883,837,450

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

mj12-kan-26-01

17/07/2019 18:46:20

46 mins 0 sec

324

8

76.4%
(DNS: 0.1%, Conn: 0.0%
T-out: 4.8%, 404s: 3.2%
Robots: 0.0%, Other: 15.5%)

850,167
(24,763)

30,619,520
(916,899)

792,507,232
(24,561,063)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-21-02

17/07/2019 18:46:20

46 mins 0 sec

73

6

78.1%
(DNS: 0.0%, Conn: 0.0%
T-out: 8.3%, 404s: 5.4%
Robots: 0.0%, Other: 8.3%)

402,370
(12,319)

30,497,392
(916,981)

969,624,135
(30,287,526)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-21-01

17/07/2019 18:46:20

46 mins 0 sec

230

8

91.4%
(DNS: 0.8%, Conn: 0.0%
T-out: 1.5%, 404s: 3.5%
Robots: 0.0%, Other: 2.7%)

954,879
(29,885)

30,652,189
(924,525)

959,735,807
(29,944,084)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-26-02

17/07/2019 18:46:20

46 mins 0 sec

206

10

83.6%
(DNS: 0.5%, Conn: 0.1%
T-out: 1.3%, 404s: 2.6%
Robots: 0.0%, Other: 11.9%)

855,351
(25,349)

30,094,571
(906,619)

787,717,619
(24,506,230)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-21-03

17/07/2019 18:46:20

46 mins 0 sec

349

9

69.5%
(DNS: 5.5%, Conn: 0.7%
T-out: 0.6%, 404s: 5.5%
Robots: 0.4%, Other: 17.8%)

368,614
(11,005)

29,631,362
(888,346)

960,609,597
(30,084,484)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-23-02

17/07/2019 18:46:21

46 mins 0 sec

183

11

75.4%
(DNS: 0.0%, Conn: 0.0%
T-out: 5.6%, 404s: 10.2%
Robots: 0.0%, Other: 8.8%)

394,627
(11,299)

30,068,510
(901,968)

982,859,468
(30,884,039)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-22-03

17/07/2019 18:46:21

46 mins 1 sec

226

11

75.1%
(DNS: 0.0%, Conn: 7.8%
T-out: 1.4%, 404s: 2.3%
Robots: 2.4%, Other: 11.1%)

973,256
(28,457)

30,501,095
(906,242)

968,882,769
(30,394,975)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-26-03

17/07/2019 18:46:21

46 mins 0 sec

67

12

71.2%
(DNS: 0.0%, Conn: 0.0%
T-out: 3.1%, 404s: 0.0%
Robots: 0.0%, Other: 25.6%)

854,101
(25,573)

31,106,515
(935,560)

788,721,781
(24,446,211)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-23-01

17/07/2019 18:46:21

46 mins 1 sec

221

10

56.9%
(DNS: 0.0%, Conn: 0.0%
T-out: 12.6%, 404s: 12.1%
Robots: 1.7%, Other: 16.7%)

978,083
(27,743)

30,712,599
(923,908)

978,258,358
(30,720,388)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-24-01

17/07/2019 18:46:21

46 mins 0 sec

142

15

60.4%
(DNS: 0.0%, Conn: 0.0%
T-out: 8.6%, 404s: 5.2%
Robots: 0.0%, Other: 25.8%)

389,395
(12,359)

30,554,487
(914,330)

979,484,987
(30,795,257)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-24-03

17/07/2019 18:46:21

46 mins 0 sec

77

8

64.9%
(DNS: 0.0%, Conn: 0.2%
T-out: 7.2%, 404s: 6.3%
Robots: 3.0%, Other: 18.4%)

344,284
(10,643)

30,503,401
(912,501)

982,004,593
(30,881,404)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-22-02

17/07/2019 18:46:21

46 mins 1 sec

439

12

86.8%
(DNS: 0.0%, Conn: 0.0%
T-out: 3.9%, 404s: 2.4%
Robots: 1.5%, Other: 5.3%)

401,324
(12,046)

30,246,845
(898,550)

981,345,609
(30,835,199)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-22-01

17/07/2019 18:46:21

46 mins 1 sec

280

8

86.4%
(DNS: 0.0%, Conn: 0.0%
T-out: 5.2%, 404s: 4.0%
Robots: 1.2%, Other: 3.2%)

427,411
(12,231)

30,762,343
(922,047)

985,919,588
(30,910,360)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-24-02

17/07/2019 18:46:21

46 mins 0 sec

355

7

77.0%
(DNS: 0.8%, Conn: 0.2%
T-out: 2.3%, 404s: 9.2%
Robots: 2.7%, Other: 7.8%)

952,012
(29,283)

31,073,794
(931,417)

983,102,562
(30,866,737)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-23-03

17/07/2019 18:46:21

46 mins 1 sec

181

12

70.9%
(DNS: 0.0%, Conn: 0.1%
T-out: 2.2%, 404s: 11.0%
Robots: 0.2%, Other: 15.6%)

386,723
(12,520)

29,510,501
(885,050)

979,863,448
(30,727,369)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-25-01

17/07/2019 18:46:21

46 mins 0 sec

49

8

84.7%
(DNS: 0.0%, Conn: 0.0%
T-out: 1.3%, 404s: 2.8%
Robots: 0.0%, Other: 11.2%)

403,031
(12,522)

29,754,423
(893,898)

975,858,685
(30,650,752)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-25-03

17/07/2019 18:46:22

46 mins 0 sec

371

8

75.3%
(DNS: 0.2%, Conn: 0.2%
T-out: 3.4%, 404s: 12.0%
Robots: 3.9%, Other: 5.0%)

910,243
(27,102)

30,905,210
(929,209)

975,398,216
(30,735,822)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-25-02

17/07/2019 18:46:22

46 mins 0 sec

201

6

73.2%
(DNS: 0.1%, Conn: 0.2%
T-out: 0.5%, 404s: 13.2%
Robots: 1.6%, Other: 11.3%)

958,308
(28,343)

30,662,282
(928,395)

975,095,787
(30,651,446)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-28-02

17/07/2019 18:46:22

46 mins 0 sec

168

15

82.0%
(DNS: 0.1%, Conn: 0.0%
T-out: 2.9%, 404s: 10.1%
Robots: 2.1%, Other: 2.7%)

406,326
(11,914)

29,863,154
(897,966)

797,971,694
(24,718,747)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-28-01

17/07/2019 18:46:22

46 mins 0 sec

474

8

74.1%
(DNS: 0.1%, Conn: 0.2%
T-out: 2.9%, 404s: 10.4%
Robots: 3.1%, Other: 9.1%)

899,821
(26,723)

30,934,013
(930,835)

792,911,317
(24,583,689)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-28-03

17/07/2019 18:46:22

46 mins 0 sec

252

9

62.7%
(DNS: 6.9%, Conn: 0.7%
T-out: 9.0%, 404s: 10.0%
Robots: 0.0%, Other: 10.7%)

894,698
(25,939)

31,013,323
(931,143)

798,945,276
(24,749,776)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-27-03

17/07/2019 18:46:23

46 mins 0 sec

70

5

69.8%
(DNS: 0.0%, Conn: 0.0%
T-out: 2.5%, 404s: 18.1%
Robots: 0.0%, Other: 9.5%)

927,701
(26,538)

30,405,306
(912,273)

774,388,506
(23,851,448)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-27-02

17/07/2019 18:46:23

46 mins 0 sec

178

10

61.1%
(DNS: 4.5%, Conn: 0.0%
T-out: 6.8%, 404s: 3.4%
Robots: 1.1%, Other: 23.2%)

395,057
(11,991)

30,304,896
(911,280)

777,068,063
(23,907,799)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-27-01

17/07/2019 18:46:23

46 mins 0 sec

71

12

94.3%
(DNS: 0.0%, Conn: 0.1%
T-out: 4.9%, 404s: 0.6%
Robots: 0.2%, Other: 0.0%)

870,361
(27,335)

30,936,636
(933,265)

774,770,553
(23,900,260)

Total (24 nodes)

5,187

228

-

16,198,143
(483,882)

731,314,367
(21,953,207)

21,723,045,650
(678,595,065)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 17 Jul 2019 18:55:12:690 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12