Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | About

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://patdavies.net/

Joined:

18/10/2005 21:15:00

URLs crawled:

98,481,417,776

Data (MB)*:

3,028,192,626

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.20   Linux

mj12-kan-22-03

21/01/2020 18:46:17

46 mins 0 sec

19

4

78.1%
(DNS: 0.0%, Conn: 0.0%
T-out: 20.8%, 404s: 1.0%
Robots: 0.0%, Other: 0.1%)

1,037,895
(36,047)

27,133,002
(976,326)

1,137,514,952
(36,403,627)

v1.7.20   Linux

mj12-kan-26-02

21/01/2020 18:46:18

46 mins 0 sec

123

14

86.0%
(DNS: 0.0%, Conn: 0.1%
T-out: 6.8%, 404s: 1.2%
Robots: 0.0%, Other: 5.9%)

1,000,364
(35,874)

27,296,637
(997,611)

956,902,771
(30,534,249)

v1.7.20   Linux

mj12-kan-24-01

21/01/2020 18:46:19

46 mins 0 sec

139

9

53.3%
(DNS: 4.9%, Conn: 0.2%
T-out: 2.9%, 404s: 19.7%
Robots: 3.5%, Other: 15.5%)

1,025,320
(37,523)

27,231,465
(983,465)

1,148,028,663
(36,797,949)

v1.7.19   Linux

mj12-nyc-01-02

21/01/2020 18:46:20

46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,433,338
(55,391)

v1.7.19   Linux

mj12-nyc-01-01

21/01/2020 18:46:20

46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,740,326
(70,473)

v1.7.19   Linux

mj12-nyc-01-03

21/01/2020 18:46:20

46 mins 1 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

936,660
(36,821)

v1.7.19   Linux

mj12-sf-01-03

21/01/2020 18:46:20

46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

714,519
(28,617)

v1.7.19   Linux

mj12-sf-01-01

21/01/2020 18:46:21

46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,865,336
(77,144)

v1.7.19   Linux

mj12-sf-01-02

21/01/2020 18:46:21

46 mins 1 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,451,555
(64,172)

v1.7.20   Linux

mj12-kan-27-02

21/01/2020 18:57:48

46 mins 0 sec

35

12

68.6%
(DNS: 0.0%, Conn: 0.3%
T-out: 25.2%, 404s: 2.3%
Robots: 2.3%, Other: 1.4%)

1,005,182
(37,197)

26,930,973
(984,650)

945,212,667
(29,896,810)

v1.7.20   Linux

mj12-kan-25-03

21/01/2020 18:57:50

46 mins 0 sec

40

16

62.3%
(DNS: 0.0%, Conn: 0.6%
T-out: 18.3%, 404s: 18.8%
Robots: 0.0%, Other: 0.1%)

1,014,364
(34,333)

27,099,567
(987,022)

1,143,047,590
(36,697,182)

v1.7.20   Linux

mj12-kan-25-02

21/01/2020 18:57:50

46 mins 0 sec

9

9

71.4%
(DNS: 0.0%, Conn: 0.0%
T-out: 27.6%, 404s: 0.0%
Robots: 0.0%, Other: 1.0%)

1,010,859
(37,537)

27,033,936
(986,651)

1,142,352,975
(36,630,043)

v1.7.20   Linux

mj12-kan-27-03

21/01/2020 18:57:50

46 mins 0 sec

146

3

64.1%
(DNS: 0.1%, Conn: 0.1%
T-out: 6.0%, 404s: 24.7%
Robots: 4.9%, Other: 0.1%)

987,490
(34,844)

27,077,631
(974,894)

941,521,447
(29,807,836)

v1.7.20   Linux

mj12-kan-21-03

21/01/2020 18:57:55

46 mins 0 sec

177

4

79.1%
(DNS: 0.0%, Conn: 0.0%
T-out: 1.3%, 404s: 11.7%
Robots: 5.1%, Other: 2.8%)

1,040,322
(37,794)

27,208,131
(994,963)

1,128,657,309
(36,081,299)

v1.7.20   Linux

mj12-kan-22-01

21/01/2020 18:57:58

46 mins 0 sec

56

6

64.5%
(DNS: 10.7%, Conn: 0.1%
T-out: 2.0%, 404s: 20.4%
Robots: 1.5%, Other: 0.9%)

1,034,881
(36,194)

27,280,632
(992,059)

1,155,354,974
(36,966,466)

v1.7.20   Linux

mj12-kan-23-03

21/01/2020 18:57:59

46 mins 0 sec

16

3

55.4%
(DNS: 0.0%, Conn: 0.3%
T-out: 31.8%, 404s: 8.5%
Robots: 0.0%, Other: 4.0%)

977,328
(35,778)

26,999,996
(973,831)

1,147,760,170
(36,708,530)

v1.7.20   Linux

mj12-kan-22-02

21/01/2020 18:57:59

46 mins 0 sec

324

7

85.3%
(DNS: 0.0%, Conn: 0.0%
T-out: 3.9%, 404s: 3.1%
Robots: 6.9%, Other: 0.8%)

1,072,874
(37,998)

27,288,985
(987,147)

1,150,160,944
(36,846,262)

v1.7.20   Linux

mj12-kan-26-03

21/01/2020 18:58:00

46 mins 0 sec

200

12

58.0%
(DNS: 5.0%, Conn: 0.0%
T-out: 0.7%, 404s: 16.0%
Robots: 0.4%, Other: 19.8%)

992,375
(35,267)

27,240,811
(982,052)

957,775,137
(30,475,197)

v1.7.20   Linux

mj12-kan-25-01

21/01/2020 18:58:01

46 mins 0 sec

199

1

57.6%
(DNS: 0.0%, Conn: 0.1%
T-out: 8.8%, 404s: 23.7%
Robots: 1.7%, Other: 8.1%)

995,834
(34,531)

26,991,072
(978,155)

1,144,026,436
(36,639,887)

v1.7.20   Linux

mj12-kan-28-03

21/01/2020 18:58:01

46 mins 0 sec

71

14

80.7%
(DNS: 0.1%, Conn: 0.0%
T-out: 3.1%, 404s: 1.1%
Robots: 0.1%, Other: 14.9%)

1,007,789
(37,480)

26,988,233
(988,377)

966,269,029
(30,702,362)

v1.7.20   Linux

mj12-kan-21-02

21/01/2020 18:58:02

46 mins 0 sec

28

11

38.7%
(DNS: 0.0%, Conn: 0.2%
T-out: 5.8%, 404s: 29.3%
Robots: 0.5%, Other: 25.4%)

1,015,079
(36,260)

27,296,467
(990,568)

1,138,778,227
(36,308,168)

v1.7.20   Linux

mj12-kan-28-02

21/01/2020 18:58:06

46 mins 0 sec

44

6

63.2%
(DNS: 0.3%, Conn: 0.1%
T-out: 8.6%, 404s: 8.0%
Robots: 4.6%, Other: 15.3%)

1,015,559
(37,352)

27,056,954
(978,168)

966,514,332
(30,719,522)

v1.7.20   Linux

mj12-kan-27-01

21/01/2020 18:58:09

46 mins 0 sec

108

13

62.9%
(DNS: 4.7%, Conn: 0.2%
T-out: 4.4%, 404s: 19.3%
Robots: 4.4%, Other: 4.2%)

1,008,700
(37,530)

27,021,190
(998,585)

942,953,071
(29,907,666)

v1.7.20   Linux

mj12-kan-26-01

21/01/2020 18:58:11

46 mins 0 sec

330

9

67.4%
(DNS: 0.1%, Conn: 2.0%
T-out: 1.7%, 404s: 3.4%
Robots: 9.5%, Other: 15.8%)

1,041,967
(39,373)

27,373,799
(998,640)

962,030,924
(30,618,776)

v1.7.20   Linux

mj12-kan-21-01

21/01/2020 18:58:12

46 mins 0 sec

174

20

75.3%
(DNS: 0.3%, Conn: 0.4%
T-out: 7.4%, 404s: 12.5%
Robots: 0.1%, Other: 3.9%)

996,582
(35,910)

26,807,401
(984,888)

1,128,392,331
(35,958,019)

v1.7.20   Linux

mj12-kan-24-02

21/01/2020 18:58:12

46 mins 0 sec

345

15

75.4%
(DNS: 0.1%, Conn: 4.0%
T-out: 8.1%, 404s: 9.4%
Robots: 0.1%, Other: 2.9%)

1,066,440
(38,295)

27,110,384
(984,229)

1,150,907,356
(36,880,622)

v1.7.20   Linux

mj12-kan-23-02

21/01/2020 18:58:21

46 mins 0 sec

161

1

85.5%
(DNS: 0.2%, Conn: 0.1%
T-out: 1.5%, 404s: 8.8%
Robots: 0.0%, Other: 4.0%)

1,033,161
(36,206)

26,922,645
(966,828)

1,151,198,762
(36,886,583)

v1.7.20   Linux

mj12-kan-23-01

21/01/2020 18:58:22

46 mins 0 sec

155

3

73.4%
(DNS: 5.7%, Conn: 0.2%
T-out: 4.2%, 404s: 14.4%
Robots: 0.2%, Other: 2.0%)

1,034,282
(39,212)

26,850,614
(982,005)

1,145,650,014
(36,690,426)

v1.7.20   Linux

mj12-kan-24-03

21/01/2020 18:58:23

46 mins 0 sec

221

21

76.2%
(DNS: 6.5%, Conn: 0.2%
T-out: 2.6%, 404s: 6.1%
Robots: 3.8%, Other: 4.7%)

1,032,905
(38,128)

27,069,821
(982,199)

1,149,442,622
(36,858,716)

v1.7.20   Linux

mj12-kan-28-01

21/01/2020 18:58:33

46 mins 0 sec

162

16

78.2%
(DNS: 4.6%, Conn: 0.1%
T-out: 1.1%, 404s: 10.5%
Robots: 0.4%, Other: 5.1%)

989,868
(36,826)

27,085,843
(989,126)

961,049,169
(30,601,426)

Total (30 nodes)

3,282

229

-

24,437,420
(883,489)

650,396,189
(23,642,439)

25,769,643,606
(822,950,241)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 21 Jan 2020 18:59:23:327 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12