Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://patdavies.net/

Joined:

18/10/2005 21:15:00

URLs crawled:

94,431,009,394

Data (MB)*:

2,883,719,957

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

mj12-kan-28-01

17/07/2019 12:46:19

46 mins 0 sec

437

30

77.8%
(DNS: 0.6%, Conn: 0.0%
T-out: 7.3%, 404s: 7.3%
Robots: 0.0%, Other: 7.0%)

745,570
(21,934)

30,779,762
(926,046)

792,757,066
(24,578,900)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-28-02

17/07/2019 12:46:19

46 mins 0 sec

100

16

75.5%
(DNS: 0.0%, Conn: 0.2%
T-out: 9.0%, 404s: 2.1%
Robots: 0.0%, Other: 13.3%)

244,185
(7,166)

29,701,013
(893,218)

797,809,553
(24,713,999)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-28-03

17/07/2019 12:46:20

46 mins 0 sec

347

16

81.5%
(DNS: 0.0%, Conn: 0.0%
T-out: 1.2%, 404s: 5.7%
Robots: 3.6%, Other: 7.9%)

750,984
(21,483)

30,869,609
(926,687)

798,801,562
(24,745,320)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-23-03

17/07/2019 12:46:20

46 mins 0 sec

238

30

47.3%
(DNS: 0.0%, Conn: 0.0%
T-out: 4.7%, 404s: 1.6%
Robots: 0.2%, Other: 46.2%)

233,172
(7,705)

29,356,950
(880,235)

979,709,897
(30,722,554)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-23-02

17/07/2019 12:46:20

46 mins 0 sec

292

20

55.3%
(DNS: 0.1%, Conn: 0.0%
T-out: 9.6%, 404s: 14.9%
Robots: 0.0%, Other: 20.1%)

221,597
(6,447)

29,895,480
(897,116)

982,686,438
(30,879,187)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-27-02

17/07/2019 12:46:20

46 mins 1 sec

329

24

70.4%
(DNS: 0.8%, Conn: 0.0%
T-out: 10.9%, 404s: 4.1%
Robots: 1.8%, Other: 11.9%)

214,661
(6,707)

30,124,500
(905,996)

776,887,667
(23,902,515)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-26-02

17/07/2019 12:46:20

46 mins 1 sec

273

16

74.3%
(DNS: 0.1%, Conn: 0.4%
T-out: 12.6%, 404s: 8.0%
Robots: 0.3%, Other: 4.3%)

689,292
(19,986)

29,928,512
(901,256)

787,551,560
(24,500,867)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-27-01

17/07/2019 12:46:20

46 mins 1 sec

249

19

86.5%
(DNS: 0.0%, Conn: 0.5%
T-out: 5.5%, 404s: 2.5%
Robots: 0.0%, Other: 5.0%)

711,824
(22,062)

30,778,099
(927,992)

774,612,016
(23,894,987)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-27-03

17/07/2019 12:46:20

46 mins 1 sec

152

18

84.1%
(DNS: 0.0%, Conn: 0.2%
T-out: 9.4%, 404s: 1.4%
Robots: 0.0%, Other: 4.9%)

761,850
(22,273)

30,239,455
(908,008)

774,222,655
(23,847,183)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-26-03

17/07/2019 12:46:20

46 mins 1 sec

600

25

73.2%
(DNS: 1.5%, Conn: 0.1%
T-out: 4.7%, 404s: 11.8%
Robots: 0.5%, Other: 8.2%)

693,484
(20,261)

30,945,898
(930,248)

788,561,164
(24,440,899)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-26-01

17/07/2019 12:46:20

46 mins 1 sec

380

11

74.3%
(DNS: 0.4%, Conn: 0.1%
T-out: 1.8%, 404s: 7.5%
Robots: 0.6%, Other: 15.3%)

689,241
(19,748)

30,458,594
(911,884)

792,346,306
(24,556,048)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-23-01

17/07/2019 12:46:21

46 mins 1 sec

266

22

59.9%
(DNS: 0.1%, Conn: 0.3%
T-out: 3.2%, 404s: 26.3%
Robots: 0.4%, Other: 9.9%)

819,895
(22,938)

30,554,411
(919,103)

978,100,170
(30,715,583)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-25-02

17/07/2019 12:46:21

46 mins 0 sec

265

19

66.0%
(DNS: 0.9%, Conn: 0.3%
T-out: 4.8%, 404s: 7.1%
Robots: 0.8%, Other: 20.1%)

798,320
(23,393)

30,502,294
(923,445)

974,935,799
(30,646,496)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-25-01

17/07/2019 12:46:21

46 mins 0 sec

206

12

79.8%
(DNS: 0.1%, Conn: 4.8%
T-out: 2.2%, 404s: 6.8%
Robots: 0.2%, Other: 6.1%)

257,151
(7,920)

29,608,543
(889,296)

975,712,805
(30,646,150)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-25-03

17/07/2019 12:46:21

46 mins 0 sec

182

26

70.6%
(DNS: 0.0%, Conn: 0.1%
T-out: 2.1%, 404s: 6.9%
Robots: 5.9%, Other: 14.4%)

758,990
(22,050)

30,753,957
(924,157)

975,246,963
(30,730,770)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-21-03

17/07/2019 12:46:21

46 mins 0 sec

113

18

81.8%
(DNS: 0.6%, Conn: 0.0%
T-out: 6.8%, 404s: 5.2%
Robots: 0.0%, Other: 5.7%)

226,639
(6,856)

29,489,387
(884,197)

960,467,622
(30,080,335)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-21-01

17/07/2019 12:46:21

46 mins 0 sec

223

18

71.6%
(DNS: 0.0%, Conn: 0.2%
T-out: 5.1%, 404s: 10.4%
Robots: 0.2%, Other: 12.4%)

798,500
(24,934)

30,495,810
(919,574)

959,579,428
(29,939,133)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-21-02

17/07/2019 12:46:21

46 mins 0 sec

214

17

76.0%
(DNS: 0.0%, Conn: 0.1%
T-out: 5.7%, 404s: 6.8%
Robots: 0.0%, Other: 11.4%)

258,613
(7,950)

30,353,635
(912,612)

969,480,378
(30,283,157)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-24-01

17/07/2019 12:46:22

46 mins 1 sec

447

18

83.1%
(DNS: 0.0%, Conn: 0.0%
T-out: 1.5%, 404s: 7.2%
Robots: 3.8%, Other: 4.4%)

221,685
(7,076)

30,386,777
(909,047)

979,317,277
(30,789,974)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-24-02

17/07/2019 12:46:22

46 mins 1 sec

262

15

62.2%
(DNS: 0.0%, Conn: 0.0%
T-out: 14.4%, 404s: 8.6%
Robots: 0.0%, Other: 14.8%)

793,700
(23,623)

30,915,482
(925,757)

982,944,250
(30,861,077)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-22-02

17/07/2019 12:46:22

46 mins 1 sec

394

20

69.2%
(DNS: 3.8%, Conn: 0.4%
T-out: 4.6%, 404s: 8.2%
Robots: 0.0%, Other: 13.7%)

230,225
(7,077)

30,075,746
(893,581)

981,174,510
(30,830,230)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-22-03

17/07/2019 12:46:22

46 mins 1 sec

357

17

86.9%
(DNS: 0.1%, Conn: 0.1%
T-out: 2.5%, 404s: 7.0%
Robots: 0.1%, Other: 3.5%)

819,814
(23,755)

30,347,653
(901,540)

968,729,327
(30,390,273)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-24-03

17/07/2019 12:46:22

46 mins 1 sec

277

14

89.8%
(DNS: 0.1%, Conn: 0.3%
T-out: 1.1%, 404s: 2.4%
Robots: 0.0%, Other: 6.2%)

198,865
(6,038)

30,357,982
(907,896)

981,859,174
(30,876,799)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-22-01

17/07/2019 12:46:22

46 mins 1 sec

142

12

58.5%
(DNS: 0.0%, Conn: 0.0%
T-out: 5.8%, 404s: 9.8%
Robots: 0.0%, Other: 25.9%)

249,460
(7,007)

30,584,392
(916,823)

985,741,637
(30,905,136)

Total (24 nodes)

6,745

453

-

12,387,717
(366,389)

727,503,941
(21,835,714)

21,719,235,224
(678,477,572)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 17 Jul 2019 12:55:11:580 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12