Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | Blog | About

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://patdavies.net/

Joined:

18/10/2005 21:15:00

URLs crawled:

96,198,365,990

Data (MB)*:

2,944,097,709

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.20   Linux

mj12-kan-22-01

13/10/2019 19:46:13

1 hour 46 mins 0 sec

129

14

69.5%
(DNS: 0.0%, Conn: 0.1%
T-out: 2.6%, 404s: 7.9%
Robots: 5.3%, Other: 14.5%)

521,225
(19,134)

19,396,835
(679,678)

1,059,817,284
(33,440,848)

v1.7.20   Linux

mj12-kan-25-03

13/10/2019 19:46:13

1 hour 46 mins 0 sec

53

10

68.4%
(DNS: 6.6%, Conn: 0.0%
T-out: 4.7%, 404s: 19.5%
Robots: 0.0%, Other: 0.7%)

470,684
(15,491)

19,505,943
(679,144)

1,048,404,808
(33,225,059)

v1.7.20   Linux

mj12-kan-23-01

13/10/2019 19:46:13

1 hour 46 mins 0 sec

56

15

57.4%
(DNS: 0.0%, Conn: 0.1%
T-out: 10.8%, 404s: 21.1%
Robots: 1.8%, Other: 8.9%)

549,951
(19,932)

19,516,175
(675,651)

1,050,534,724
(33,182,806)

v1.7.20   Linux

mj12-kan-24-03

13/10/2019 19:46:13

1 hour 46 mins 0 sec

252

9

66.3%
(DNS: 3.5%, Conn: 1.5%
T-out: 9.1%, 404s: 15.0%
Robots: 2.5%, Other: 2.2%)

500,923
(16,521)

19,611,784
(681,886)

1,054,307,702
(33,367,514)

v1.7.20   Linux

mj12-kan-23-03

13/10/2019 19:46:13

1 hour 46 mins 0 sec

298

17

70.4%
(DNS: 2.9%, Conn: 1.5%
T-out: 2.2%, 404s: 16.6%
Robots: 1.3%, Other: 5.0%)

533,207
(16,630)

19,684,085
(687,222)

1,053,103,727
(33,228,501)

v1.7.19   Linux

mj12-nyc-01-01

13/10/2019 19:46:16

46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,740,326
(70,473)

v1.7.19   Linux

mj12-nyc-01-02

13/10/2019 19:46:16

46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,433,338
(55,391)

v1.7.19   Linux

mj12-nyc-01-03

13/10/2019 19:46:16

46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

936,660
(36,821)

v1.7.19   Linux

mj12-sf-01-02

13/10/2019 19:46:16

46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,451,555
(64,172)

v1.7.19   Linux

mj12-sf-01-03

13/10/2019 19:46:16

46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

714,519
(28,617)

v1.7.19   Linux

mj12-sf-01-01

13/10/2019 19:46:16

46 mins 0 sec

n/a

n/a

n/a
(DNS: n/a, Conn: n/a
T-out: n/a, 404s: n/a
Robots: n/a, Other: n/a)

0
(0)

0
(0)

1,865,336
(77,144)

v1.7.20   Linux

mj12-kan-26-01

13/10/2019 19:57:50

1 hour 46 mins 0 sec

218

10

55.5%
(DNS: 8.8%, Conn: 0.0%
T-out: 20.0%, 404s: 6.6%
Robots: 0.0%, Other: 9.1%)

518,417
(17,522)

19,573,051
(670,823)

866,382,982
(27,074,544)

v1.7.20   Linux

mj12-kan-26-03

13/10/2019 19:57:50

1 hour 46 mins 0 sec

46

8

51.0%
(DNS: 0.0%, Conn: 0.3%
T-out: 12.4%, 404s: 13.0%
Robots: 15.7%, Other: 7.7%)

492,274
(16,324)

19,598,134
(675,739)

862,165,957
(26,948,180)

v1.7.20   Linux

mj12-kan-28-01

13/10/2019 19:57:50

1 hour 46 mins 0 sec

21

5

41.5%
(DNS: 0.3%, Conn: 0.3%
T-out: 10.1%, 404s: 31.8%
Robots: 8.3%, Other: 7.7%)

523,339
(18,183)

19,307,094
(674,586)

866,199,120
(27,082,737)

v1.7.20   Linux

mj12-kan-26-02

13/10/2019 19:57:50

1 hour 46 mins 0 sec

153

12

70.4%
(DNS: 0.5%, Conn: 0.2%
T-out: 7.7%, 404s: 8.2%
Robots: 7.7%, Other: 5.3%)

515,254
(18,449)

19,475,230
(674,323)

861,462,872
(27,009,218)

v1.7.20   Linux

mj12-kan-22-03

13/10/2019 19:57:51

1 hour 46 mins 0 sec

74

15

55.3%
(DNS: 0.7%, Conn: 0.0%
T-out: 19.3%, 404s: 4.2%
Robots: 12.0%, Other: 8.5%)

462,906
(17,628)

19,492,173
(683,891)

1,042,200,521
(32,899,331)

v1.7.20   Linux

mj12-kan-24-01

13/10/2019 19:57:51

1 hour 46 mins 0 sec

63

14

60.7%
(DNS: 3.1%, Conn: 0.2%
T-out: 5.3%, 404s: 1.8%
Robots: 9.4%, Other: 19.6%)

506,208
(17,780)

19,488,667
(673,494)

1,052,817,875
(33,298,516)

v1.7.20   Linux

mj12-kan-25-01

13/10/2019 19:57:51

1 hour 46 mins 0 sec

35

14

55.2%
(DNS: 0.5%, Conn: 2.6%
T-out: 19.8%, 404s: 7.2%
Robots: 0.0%, Other: 14.6%)

493,503
(17,186)

19,530,707
(678,399)

1,049,172,002
(33,148,029)

v1.7.20   Linux

mj12-kan-27-03

13/10/2019 19:57:51

1 hour 46 mins 0 sec

61

12

62.4%
(DNS: 0.7%, Conn: 0.1%
T-out: 7.3%, 404s: 9.4%
Robots: 9.8%, Other: 10.3%)

505,832
(19,701)

19,711,717
(682,803)

846,344,304
(26,310,296)

v1.7.20   Linux

mj12-kan-28-03

13/10/2019 19:57:56

1 hour 46 mins 0 sec

360

9

66.7%
(DNS: 5.5%, Conn: 1.3%
T-out: 3.7%, 404s: 13.6%
Robots: 0.9%, Other: 8.3%)

489,024
(17,090)

19,459,950
(659,567)

871,414,093
(27,206,886)

v1.7.20   Linux

mj12-kan-24-02

13/10/2019 19:57:56

1 hour 46 mins 0 sec

179

13

62.5%
(DNS: 6.4%, Conn: 1.9%
T-out: 3.2%, 404s: 17.4%
Robots: 3.8%, Other: 4.8%)

492,370
(17,116)

19,567,302
(680,438)

1,055,990,700
(33,374,206)

v1.7.20   Linux

mj12-kan-22-02

13/10/2019 19:57:57

1 hour 46 mins 0 sec

392

13

62.9%
(DNS: 0.1%, Conn: 1.1%
T-out: 3.4%, 404s: 20.9%
Robots: 2.9%, Other: 8.8%)

506,715
(17,299)

19,671,492
(684,288)

1,054,980,230
(33,353,309)

v1.7.20   Linux

mj12-kan-27-01

13/10/2019 19:57:57

1 hour 46 mins 0 sec

315

10

71.9%
(DNS: 0.5%, Conn: 0.3%
T-out: 3.8%, 404s: 16.3%
Robots: 2.9%, Other: 4.4%)

460,161
(15,261)

19,743,637
(690,696)

847,724,088
(26,405,035)

v1.7.20   Linux

mj12-kan-21-03

13/10/2019 19:57:59

1 hour 46 mins 1 sec

536

11

79.5%
(DNS: 1.5%, Conn: 0.7%
T-out: 5.9%, 404s: 7.4%
Robots: 2.4%, Other: 2.7%)

512,416
(17,140)

19,532,141
(673,600)

1,033,527,350
(32,569,265)

v1.7.20   Linux

mj12-kan-21-02

13/10/2019 19:57:59

1 hour 46 mins 1 sec

300

10

72.1%
(DNS: 0.9%, Conn: 0.1%
T-out: 3.6%, 404s: 12.7%
Robots: 4.7%, Other: 6.0%)

513,404
(18,655)

19,657,765
(681,767)

1,043,193,709
(32,807,166)

v1.7.20   Linux

mj12-kan-23-02

13/10/2019 19:58:01

1 hour 46 mins 0 sec

164

11

80.9%
(DNS: 1.5%, Conn: 0.0%
T-out: 2.7%, 404s: 4.7%
Robots: 0.0%, Other: 10.3%)

477,752
(15,813)

19,504,465
(680,360)

1,056,271,617
(33,393,422)

v1.7.20   Linux

mj12-kan-28-02

13/10/2019 19:58:01

1 hour 46 mins 0 sec

75

9

60.1%
(DNS: 5.4%, Conn: 0.0%
T-out: 6.6%, 404s: 20.1%
Robots: 0.0%, Other: 7.7%)

509,686
(17,978)

19,605,973
(673,406)

871,624,740
(27,219,342)

v1.7.20   Linux

mj12-kan-25-02

13/10/2019 19:58:02

1 hour 46 mins 0 sec

153

12

78.1%
(DNS: 2.3%, Conn: 0.0%
T-out: 4.9%, 404s: 6.4%
Robots: 3.7%, Other: 4.6%)

494,581
(16,093)

19,488,803
(671,596)

1,047,369,596
(33,119,252)

v1.7.20   Linux

mj12-kan-21-01

13/10/2019 19:58:08

1 hour 46 mins 1 sec

433

8

73.8%
(DNS: 3.7%, Conn: 0.9%
T-out: 5.9%, 404s: 5.1%
Robots: 4.7%, Other: 5.9%)

489,678
(17,459)

19,402,568
(673,834)

1,033,386,403
(32,460,222)

v1.7.20   Linux

mj12-kan-27-02

13/10/2019 19:58:13

1 hour 46 mins 0 sec

115

31

64.2%
(DNS: 3.4%, Conn: 3.4%
T-out: 5.8%, 404s: 6.0%
Robots: 5.2%, Other: 11.9%)

526,717
(18,501)

19,646,197
(683,932)

850,053,682
(26,399,022)

Total (30 nodes)

4,481

292

-

12,066,227
(418,886)

469,171,888
(16,271,123)

23,486,591,820
(738,855,324)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 13 Oct 2019 19:59:21:000 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12