Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://patdavies.net/

Joined:

18/10/2005 21:15:00

URLs crawled:

76,696,397,082

Data (MB)*:

2,337,119,085

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.16 (.NET 4.5)   Linux

mj12-kan-11-03

19/07/2018 00:16:22

16 mins 0 sec

50

n/a

99.2%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.8%, 404s: 0.0%
Robots: 0.0%, Other: 0.0%)

0
(0)

42,642,789
(1,370,633)

887,904,098
(27,229,721)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-12-02

19/07/2018 01:46:23

1 hour 46 mins 1 sec

472

5

78.9%
(DNS: 3.0%, Conn: 1.1%
T-out: 3.4%, 404s: 7.5%
Robots: 3.6%, Other: 2.6%)

33,996
(1,181)

9,413,860
(305,300)

154,862,388
(4,648,030)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-15-01

19/07/2018 01:46:23

1 hour 46 mins 0 sec

1,648

17

84.4%
(DNS: 1.0%, Conn: 1.0%
T-out: 1.1%, 404s: 6.0%
Robots: 3.0%, Other: 3.5%)

75,231
(2,636)

46,585,984
(1,478,400)

716,201,682
(23,380,908)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-15-02

19/07/2018 01:46:23

1 hour 46 mins 0 sec

1,116

11

80.3%
(DNS: 2.2%, Conn: 1.1%
T-out: 1.7%, 404s: 7.5%
Robots: 3.5%, Other: 3.7%)

61,612
(2,016)

44,399,446
(1,416,950)

714,353,011
(23,395,600)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-12-01

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,079

16

85.8%
(DNS: 0.9%, Conn: 1.1%
T-out: 3.0%, 404s: 5.5%
Robots: 1.7%, Other: 2.0%)

51,392
(1,943)

48,176,578
(1,547,042)

886,928,630
(28,407,594)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-12-03

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,174

14

81.7%
(DNS: 3.7%, Conn: 0.1%
T-out: 2.8%, 404s: 5.9%
Robots: 3.9%, Other: 2.0%)

63,444
(2,509)

46,844,624
(1,502,854)

894,318,632
(28,578,096)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-13-01

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,188

11

80.6%
(DNS: 1.3%, Conn: 2.6%
T-out: 1.7%, 404s: 7.8%
Robots: 3.0%, Other: 3.0%)

71,932
(2,634)

48,463,243
(1,548,023)

734,317,799
(23,986,164)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-14-03

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,547

12

84.2%
(DNS: 3.4%, Conn: 0.9%
T-out: 1.2%, 404s: 6.2%
Robots: 0.9%, Other: 3.2%)

66,912
(2,993)

45,022,487
(1,441,010)

720,503,804
(23,583,750)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-14-02

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,213

12

83.6%
(DNS: 1.7%, Conn: 1.4%
T-out: 1.5%, 404s: 4.9%
Robots: 2.3%, Other: 4.6%)

56,491
(1,953)

46,843,034
(1,511,896)

724,115,513
(23,696,037)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-15-03

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,743

19

83.6%
(DNS: 1.6%, Conn: 1.1%
T-out: 0.6%, 404s: 6.6%
Robots: 4.2%, Other: 2.4%)

76,334
(2,672)

45,857,804
(1,467,722)

719,991,377
(23,523,119)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-23-01

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,203

8

78.2%
(DNS: 0.7%, Conn: 0.8%
T-out: 1.7%, 404s: 6.1%
Robots: 2.9%, Other: 9.6%)

53,789
(2,074)

32,172,196
(924,343)

594,305,085
(19,154,377)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-16-01

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,179

11

82.1%
(DNS: 1.7%, Conn: 0.8%
T-out: 2.1%, 404s: 6.0%
Robots: 2.5%, Other: 4.9%)

59,084
(2,325)

44,379,841
(1,432,173)

546,050,259
(17,873,509)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-13-02

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,466

10

81.1%
(DNS: 1.1%, Conn: 0.3%
T-out: 1.2%, 404s: 4.6%
Robots: 6.5%, Other: 5.1%)

64,417
(2,647)

43,591,077
(1,406,631)

732,834,677
(23,967,896)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-23-03

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,387

8

70.9%
(DNS: 1.6%, Conn: 1.2%
T-out: 6.9%, 404s: 5.8%
Robots: 3.4%, Other: 10.3%)

59,387
(2,117)

33,243,174
(955,219)

596,689,556
(19,197,700)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-23-02

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,565

15

77.6%
(DNS: 3.7%, Conn: 1.3%
T-out: 2.5%, 404s: 3.6%
Robots: 2.6%, Other: 8.6%)

91,401
(3,282)

32,208,272
(928,184)

596,324,386
(19,251,746)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-13-03

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,391

12

83.2%
(DNS: 1.8%, Conn: 1.3%
T-out: 1.7%, 404s: 7.8%
Robots: 2.3%, Other: 1.8%)

56,995
(2,078)

47,048,530
(1,502,196)

716,747,581
(23,408,804)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-25-02

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,315

11

83.9%
(DNS: 3.3%, Conn: 1.1%
T-out: 0.8%, 404s: 4.1%
Robots: 1.5%, Other: 5.3%)

62,907
(2,371)

31,630,004
(926,902)

591,346,675
(19,083,234)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-14-01

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,067

21

78.9%
(DNS: 1.8%, Conn: 0.2%
T-out: 1.5%, 404s: 5.7%
Robots: 6.0%, Other: 5.8%)

59,300
(2,113)

45,170,254
(1,450,436)

719,786,789
(23,583,293)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-18-03

19/07/2018 01:46:23

1 hour 46 mins 1 sec

n/a

n/a

0.0%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.0%, 404s: 0.0%
Robots: 0.0%, Other: 100.0%)

0
(0)

5,599,354
(179,334)

601,248,481
(19,643,777)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-16-03

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,331

13

82.3%
(DNS: 0.8%, Conn: 0.5%
T-out: 2.9%, 404s: 5.3%
Robots: 2.7%, Other: 5.5%)

63,926
(2,200)

44,967,692
(1,436,424)

557,190,727
(18,262,372)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-18-01

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,450

15

84.6%
(DNS: 1.9%, Conn: 0.7%
T-out: 2.8%, 404s: 5.1%
Robots: 2.8%, Other: 2.0%)

69,086
(3,032)

46,544,256
(1,504,908)

635,238,275
(20,743,326)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-16-02

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,383

13

86.3%
(DNS: 0.3%, Conn: 0.2%
T-out: 1.2%, 404s: 5.7%
Robots: 2.5%, Other: 3.8%)

66,113
(2,544)

44,720,292
(1,443,661)

546,310,222
(17,924,742)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-19-02

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,666

13

82.2%
(DNS: 3.5%, Conn: 0.8%
T-out: 1.4%, 404s: 6.2%
Robots: 2.7%, Other: 3.2%)

69,369
(2,495)

44,587,331
(1,438,884)

643,660,001
(21,033,803)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-25-01

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,681

13

78.8%
(DNS: 2.6%, Conn: 0.9%
T-out: 2.1%, 404s: 8.2%
Robots: 2.4%, Other: 5.0%)

79,272
(3,086)

33,830,743
(968,284)

592,734,248
(19,098,281)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-18-02

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,358

18

81.8%
(DNS: 1.3%, Conn: 0.8%
T-out: 3.0%, 404s: 4.7%
Robots: 2.1%, Other: 6.3%)

80,452
(3,012)

46,513,086
(1,493,560)

642,548,405
(20,985,353)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-11-01

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,194

14

76.6%
(DNS: 2.3%, Conn: 1.2%
T-out: 3.1%, 404s: 8.7%
Robots: 3.8%, Other: 4.3%)

74,097
(2,674)

42,517,212
(1,365,737)

878,806,982
(27,150,058)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-19-01

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,472

14

83.6%
(DNS: 0.7%, Conn: 0.5%
T-out: 1.9%, 404s: 5.0%
Robots: 4.2%, Other: 4.2%)

64,349
(2,447)

41,047,806
(1,329,243)

641,155,850
(20,969,947)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-21-01

19/07/2018 01:46:23

1 hour 46 mins 1 sec

1,222

10

78.6%
(DNS: 0.2%, Conn: 0.3%
T-out: 3.0%, 404s: 4.9%
Robots: 3.3%, Other: 9.8%)

61,402
(2,442)

33,397,744
(968,298)

577,286,958
(18,444,548)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-11-02

19/07/2018 01:46:23

1 hour 46 mins 1 sec

2,042

26

81.2%
(DNS: 0.8%, Conn: 0.8%
T-out: 2.7%, 404s: 7.6%
Robots: 2.7%, Other: 4.1%)

119,314
(3,959)

39,930,053
(1,284,047)

862,408,385
(26,741,763)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-19-03

19/07/2018 01:46:24

1 hour 46 mins 2 secs

1,265

19

81.5%
(DNS: 1.8%, Conn: 0.3%
T-out: 2.4%, 404s: 6.4%
Robots: 3.7%, Other: 3.8%)

75,918
(2,538)

45,039,664
(1,447,194)

634,735,692
(20,766,068)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-17-02

19/07/2018 01:46:24

1 hour 46 mins 1 sec

1,312

17

84.6%
(DNS: 1.7%, Conn: 1.1%
T-out: 2.3%, 404s: 3.6%
Robots: 4.8%, Other: 1.9%)

61,949
(2,094)

44,261,049
(1,422,943)

631,043,721
(20,632,037)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-21-03

19/07/2018 01:46:24

1 hour 46 mins 2 secs

1,449

14

83.8%
(DNS: 1.5%, Conn: 0.3%
T-out: 2.6%, 404s: 2.8%
Robots: 3.3%, Other: 5.8%)

64,456
(2,403)

32,460,195
(947,282)

576,881,578
(18,493,427)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-25-03

19/07/2018 01:46:24

1 hour 46 mins 2 secs

1,347

15

81.5%
(DNS: 1.2%, Conn: 0.7%
T-out: 4.8%, 404s: 4.0%
Robots: 1.8%, Other: 6.0%)

70,832
(2,766)

32,458,023
(945,378)

592,844,805
(19,168,942)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-28-03

19/07/2018 01:46:24

1 hour 46 mins 1 sec

1,452

14

79.9%
(DNS: 1.2%, Conn: 0.2%
T-out: 2.2%, 404s: 4.8%
Robots: 2.1%, Other: 9.6%)

71,177
(2,512)

31,721,043
(914,896)

412,096,376
(13,128,259)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-28-01

19/07/2018 01:46:24

1 hour 46 mins 2 secs

1,087

12

77.0%
(DNS: 1.6%, Conn: 1.1%
T-out: 0.9%, 404s: 6.3%
Robots: 3.4%, Other: 9.7%)

69,712
(2,564)

32,642,411
(939,891)

404,045,793
(12,895,186)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-21-02

19/07/2018 01:46:24

1 hour 46 mins 2 secs

1,352

11

76.3%
(DNS: 1.3%, Conn: 0.4%
T-out: 3.3%, 404s: 9.0%
Robots: 3.5%, Other: 6.2%)

61,223
(2,258)

32,101,860
(943,014)

580,176,392
(18,550,534)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-28-02

19/07/2018 01:46:24

1 hour 46 mins 2 secs

1,435

14

73.9%
(DNS: 1.6%, Conn: 0.9%
T-out: 3.5%, 404s: 4.8%
Robots: 4.4%, Other: 10.9%)

71,828
(2,449)

32,096,172
(931,001)

409,760,886
(13,045,377)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-17-01

19/07/2018 01:46:24

1 hour 46 mins 2 secs

1,571

17

83.8%
(DNS: 1.1%, Conn: 0.2%
T-out: 1.9%, 404s: 5.5%
Robots: 3.2%, Other: 4.3%)

72,036
(3,095)

43,575,070
(1,404,282)

635,246,530
(20,745,462)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-24-02

19/07/2018 01:46:24

1 hour 46 mins 1 sec

1,372

12

82.0%
(DNS: 1.7%, Conn: 0.4%
T-out: 1.8%, 404s: 3.9%
Robots: 4.1%, Other: 6.2%)

64,536
(2,248)

33,260,701
(952,459)

593,561,979
(19,155,706)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-26-02

19/07/2018 01:46:24

1 hour 46 mins 1 sec

1,471

12

79.3%
(DNS: 2.3%, Conn: 0.2%
T-out: 1.7%, 404s: 4.6%
Robots: 1.9%, Other: 9.9%)

61,205
(2,171)

32,193,719
(933,800)

402,882,114
(12,900,116)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-22-03

19/07/2018 01:46:24

1 hour 46 mins 2 secs

1,140

13

74.5%
(DNS: 0.7%, Conn: 1.3%
T-out: 0.7%, 404s: 9.5%
Robots: 3.1%, Other: 10.1%)

73,830
(2,408)

33,351,422
(962,775)

584,991,937
(18,850,330)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-22-01

19/07/2018 01:46:24

1 hour 46 mins 2 secs

1,161

12

84.6%
(DNS: 0.6%, Conn: 0.7%
T-out: 2.7%, 404s: 4.1%
Robots: 3.3%, Other: 3.9%)

66,916
(2,577)

33,054,698
(956,205)

598,268,856
(19,282,709)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-22-02

19/07/2018 01:46:24

1 hour 46 mins 2 secs

1,520

11

79.2%
(DNS: 1.6%, Conn: 0.3%
T-out: 3.6%, 404s: 4.7%
Robots: 3.8%, Other: 6.8%)

63,998
(1,968)

32,020,760
(927,592)

595,975,114
(19,224,060)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-17-03

19/07/2018 01:46:24

1 hour 46 mins 2 secs

1,441

19

81.2%
(DNS: 1.5%, Conn: 0.7%
T-out: 3.7%, 404s: 8.0%
Robots: 2.2%, Other: 2.7%)

66,209
(2,245)

44,987,320
(1,443,224)

639,030,699
(20,880,171)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-24-03

19/07/2018 01:46:25

1 hour 46 mins 1 sec

1,288

13

73.7%
(DNS: 2.0%, Conn: 0.2%
T-out: 6.8%, 404s: 6.8%
Robots: 2.5%, Other: 8.0%)

75,924
(2,383)

33,694,771
(984,779)

598,104,226
(19,329,195)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-26-03

19/07/2018 01:46:25

1 hour 46 mins 2 secs

1,357

8

78.4%
(DNS: 1.6%, Conn: 1.0%
T-out: 1.6%, 404s: 4.7%
Robots: 5.1%, Other: 7.4%)

64,148
(2,364)

32,930,563
(951,806)

399,679,502
(12,760,812)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-26-01

19/07/2018 01:46:25

1 hour 46 mins 2 secs

1,488

16

77.0%
(DNS: 0.9%, Conn: 1.4%
T-out: 3.0%, 404s: 6.8%
Robots: 2.2%, Other: 8.8%)

59,252
(2,200)

31,861,227
(930,849)

410,034,907
(13,036,227)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-24-01

19/07/2018 01:46:25

1 hour 46 mins 2 secs

1,372

14

76.4%
(DNS: 3.3%, Conn: 0.8%
T-out: 1.9%, 404s: 5.7%
Robots: 2.8%, Other: 9.1%)

73,619
(2,507)

31,777,896
(910,793)

594,031,106
(19,174,714)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-27-03

19/07/2018 01:46:25

1 hour 46 mins 2 secs

1,069

11

79.7%
(DNS: 0.9%, Conn: 0.3%
T-out: 3.1%, 404s: 6.3%
Robots: 2.4%, Other: 7.3%)

62,030
(2,328)

32,405,197
(943,572)

387,093,131
(12,203,903)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-27-01

19/07/2018 01:46:25

1 hour 46 mins 3 secs

1,526

15

78.5%
(DNS: 2.9%, Conn: 0.4%
T-out: 1.4%, 404s: 7.1%
Robots: 2.4%, Other: 7.3%)

66,413
(2,552)

32,745,065
(953,477)

390,706,456
(12,324,904)

v1.7.16 (.NET 4.5)   Linux

mj12-kan-27-02

19/07/2018 01:46:25

1 hour 46 mins 3 secs

1,093

10

76.8%
(DNS: 0.8%, Conn: 0.2%
T-out: 4.6%, 404s: 4.5%
Robots: 4.0%, Other: 9.1%)

56,833
(2,171)

33,278,407
(963,517)

390,746,344
(12,277,305)

Total (51 nodes)

66,170

661

-

3,286,048
(120,236)

1,921,265,999
(59,239,023)

30,888,108,620
(995,772,992)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 19 Jul 2018 01:58:17:953 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12