Majestic-12 logo
Distributed Search Engine
Use it:
Install the 'Majestic-12' search plugin.
Home | DSearch | Projects | Stats | Download | Forum | Blog | About | SEO Services

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://patdavies.net/

Joined:

18/10/2005 21:15:00

URLs crawled:

108,618,152,562

Data (MB)*:

3,382,444,583

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.21   Linux

mj12-kan-28-03

17/09/2021 03:01:20

3 hours 1 min 0 sec

12

2

41.5%
(DNS: 0.0%, Conn: 0.0%
T-out: 0.0%, 404s: 54.2%
Robots: 0.1%, Other: 4.2%)

33,755
(1,542)

19,524,479
(826,642)

1,399,923,471
(45,720,652)

v1.7.21   Linux

mj12-kan-28-02

17/09/2021 03:31:21

3 hours 31 mins 0 sec

10

2

36.0%
(DNS: 0.9%, Conn: 1.3%
T-out: 0.8%, 404s: 51.8%
Robots: 0.2%, Other: 8.9%)

14,568
(469)

19,522,523
(820,903)

1,401,539,272
(45,819,838)

v1.7.21   Linux

mj12-kan-24-01

17/09/2021 03:31:21

3 hours 31 mins 0 sec

91

3

54.2%
(DNS: 3.9%, Conn: 0.5%
T-out: 8.4%, 404s: 23.9%
Robots: 1.2%, Other: 7.9%)

25,213
(1,243)

19,539,155
(834,730)

1,582,377,147
(51,916,817)

v1.7.21   Linux

mj12-kan-28-01

17/09/2021 03:31:21

3 hours 31 mins 1 sec

232

15

73.0%
(DNS: 1.5%, Conn: 1.2%
T-out: 3.8%, 404s: 10.7%
Robots: 2.0%, Other: 7.9%)

105,734
(4,590)

18,418,352
(779,629)

1,391,883,018
(45,603,533)

v1.7.21   Linux

mj12-kan-24-02

17/09/2021 03:31:21

3 hours 31 mins 0 sec

44

1

56.1%
(DNS: 0.3%, Conn: 3.5%
T-out: 8.4%, 404s: 9.6%
Robots: 2.3%, Other: 19.6%)

26,322
(1,177)

20,293,613
(849,824)

1,584,429,506
(51,966,952)

v1.7.21   Linux

mj12-kan-24-03

17/09/2021 03:31:21

3 hours 31 mins 0 sec

58

3

46.8%
(DNS: 8.3%, Conn: 0.1%
T-out: 5.4%, 404s: 12.9%
Robots: 6.2%, Other: 20.3%)

30,659
(1,303)

20,291,590
(851,298)

1,584,970,068
(51,940,248)

v1.7.21   Linux

mj12-kan-23-02

17/09/2021 03:31:21

3 hours 31 mins 0 sec

69

2

66.5%
(DNS: 6.1%, Conn: 0.1%
T-out: 1.4%, 404s: 13.6%
Robots: 0.0%, Other: 12.3%)

26,318
(1,107)

19,507,218
(831,250)

1,585,693,672
(51,963,448)

v1.7.21   Linux

mj12-kan-23-01

17/09/2021 03:31:21

3 hours 31 mins 0 sec

9

2

31.0%
(DNS: 9.2%, Conn: 2.0%
T-out: 23.9%, 404s: 23.5%
Robots: 0.1%, Other: 10.4%)

19,223
(732)

20,053,188
(838,574)

1,584,990,043
(51,968,648)

v1.7.21   Linux

mj12-kan-23-03

17/09/2021 03:31:21

3 hours 31 mins 1 sec

82

1

55.6%
(DNS: 0.3%, Conn: 12.3%
T-out: 4.8%, 404s: 7.8%
Robots: 4.1%, Other: 15.1%)

21,639
(894)

19,471,652
(827,325)

1,586,179,704
(51,903,822)

v1.7.21   Linux

mj12-kan-26-02

17/09/2021 03:31:21

3 hours 31 mins 0 sec

25

1

51.1%
(DNS: 16.1%, Conn: 0.1%
T-out: 0.0%, 404s: 24.5%
Robots: 4.0%, Other: 4.2%)

14,823
(844)

19,742,787
(822,579)

1,291,520,298
(42,999,294)

v1.7.21   Linux

mj12-kan-26-03

17/09/2021 03:31:21

3 hours 31 mins 0 sec

105

2

65.4%
(DNS: 2.9%, Conn: 3.8%
T-out: 0.5%, 404s: 8.7%
Robots: 1.2%, Other: 17.5%)

26,749
(963)

19,477,836
(819,039)

1,292,361,752
(43,010,534)

v1.7.21   Linux

mj12-kan-26-01

17/09/2021 03:31:21

3 hours 31 mins 0 sec

23

5

92.3%
(DNS: 0.8%, Conn: 0.2%
T-out: 0.1%, 404s: 1.6%
Robots: 0.1%, Other: 4.9%)

12,212
(651)

18,841,711
(793,383)

1,295,813,050
(43,082,392)

v1.7.21   Linux

mj12-kan-22-02

17/09/2021 03:31:21

3 hours 31 mins 0 sec

34

3

68.7%
(DNS: 5.6%, Conn: 0.1%
T-out: 3.6%, 404s: 9.8%
Robots: 6.0%, Other: 6.2%)

26,307
(1,188)

19,331,432
(817,552)

1,585,186,387
(51,856,726)

v1.7.21   Linux

mj12-kan-22-03

17/09/2021 03:31:21

3 hours 31 mins 0 sec

38

3

60.4%
(DNS: 0.7%, Conn: 0.1%
T-out: 7.6%, 404s: 15.5%
Robots: 2.4%, Other: 13.2%)

19,594
(997)

19,741,437
(831,010)

1,575,197,173
(51,566,048)

v1.7.21   Linux

mj12-kan-22-01

17/09/2021 03:31:21

3 hours 31 mins 0 sec

127

4

68.7%
(DNS: 5.8%, Conn: 1.0%
T-out: 2.7%, 404s: 10.3%
Robots: 7.2%, Other: 4.4%)

41,074
(1,794)

20,203,430
(859,223)

1,590,495,486
(52,017,525)

v1.7.21   Linux

mj12-kan-21-02

17/09/2021 03:31:22

3 hours 31 mins 1 sec

36

2

61.0%
(DNS: 0.1%, Conn: 0.1%
T-out: 19.7%, 404s: 15.9%
Robots: 0.0%, Other: 3.3%)

17,025
(852)

19,798,894
(827,602)

1,574,359,106
(51,425,308)

v1.7.21   Linux

mj12-kan-27-01

17/09/2021 03:31:22

3 hours 31 mins 1 sec

61

5

64.2%
(DNS: 1.5%, Conn: 0.0%
T-out: 5.4%, 404s: 5.6%
Robots: 14.7%, Other: 8.6%)

34,053
(1,845)

19,938,768
(842,469)

1,374,911,143
(44,941,480)

v1.7.21   Linux

mj12-kan-27-03

17/09/2021 03:31:22

3 hours 31 mins 1 sec

88

2

56.4%
(DNS: 6.9%, Conn: 5.8%
T-out: 4.8%, 404s: 12.6%
Robots: 9.4%, Other: 4.1%)

27,025
(1,394)

19,094,246
(810,617)

1,374,469,246
(44,842,073)

v1.7.21   Linux

mj12-kan-27-02

17/09/2021 03:31:23

3 hours 31 mins 1 sec

115

6

80.0%
(DNS: 0.8%, Conn: 0.1%
T-out: 2.8%, 404s: 4.9%
Robots: 5.9%, Other: 5.6%)

40,845
(2,102)

19,933,570
(840,153)

1,381,491,712
(45,048,473)

v1.7.21   Linux

mj12-kan-21-01

17/09/2021 03:31:23

3 hours 31 mins 1 sec

129

2

64.2%
(DNS: 2.4%, Conn: 2.7%
T-out: 2.3%, 404s: 18.6%
Robots: 2.2%, Other: 7.5%)

23,946
(1,154)

19,705,576
(823,215)

1,565,416,567
(51,147,154)

v1.7.21   Linux

mj12-kan-21-03

17/09/2021 03:31:23

3 hours 31 mins 1 sec

94

2

57.0%
(DNS: 4.2%, Conn: 4.4%
T-out: 3.2%, 404s: 9.9%
Robots: 0.4%, Other: 20.9%)

38,732
(1,505)

19,576,798
(837,757)

1,565,010,827
(51,282,683)

v1.7.21   Linux

mj12-kan-25-01

17/09/2021 03:31:27

3 hours 31 mins 2 secs

31

n/a

49.2%
(DNS: 6.7%, Conn: 0.3%
T-out: 11.3%, 404s: 3.3%
Robots: 6.1%, Other: 23.1%)

17,198
(1,311)

18,605,884
(778,239)

1,577,813,825
(51,599,585)

v1.7.21   Linux

mj12-kan-25-03

17/09/2021 03:31:27

3 hours 31 mins 2 secs

67

2

67.7%
(DNS: 0.7%, Conn: 5.7%
T-out: 7.0%, 404s: 15.4%
Robots: 0.2%, Other: 3.3%)

30,906
(1,198)

18,725,589
(790,633)

1,575,958,694
(51,611,170)

v1.7.21   Linux

mj12-kan-25-02

17/09/2021 03:31:27

3 hours 31 mins 2 secs

63

2

71.6%
(DNS: 0.7%, Conn: 0.9%
T-out: 0.3%, 404s: 21.5%
Robots: 2.7%, Other: 2.3%)

26,301
(1,251)

18,750,816
(790,709)

1,576,245,491
(51,635,177)

Total (24 nodes)

1,643

72

-

700,221
(32,106)

468,090,544
(19,744,355)

35,898,236,658
(1,176,869,580)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 17 Sep 2021 03:59:11:060 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12