Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | About

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://patdavies.net/

Joined:

18/10/2005 21:15:00

URLs crawled:

101,443,131,000

Data (MB)*:

3,135,966,576

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.20   Linux

mj12-kan-23-02

03/06/2020 02:46:20

2 hours 46 mins 1 sec

319

25

67.4%
(DNS: 1.1%, Conn: 0.1%
T-out: 2.9%, 404s: 14.6%
Robots: 0.9%, Other: 13.1%)

98,795
(3,197)

26,768,866
(954,486)

1,274,437,184
(41,369,559)

v1.7.20   Linux

mj12-kan-22-02

03/06/2020 02:46:20

2 hours 46 mins 1 sec

488

45

71.2%
(DNS: 0.1%, Conn: 1.9%
T-out: 1.1%, 404s: 12.2%
Robots: 3.0%, Other: 10.5%)

113,415
(3,701)

26,894,554
(977,691)

1,273,705,022
(41,355,139)

v1.7.20   Linux

mj12-kan-24-03

03/06/2020 02:46:20

2 hours 46 mins 1 sec

414

15

67.2%
(DNS: 0.5%, Conn: 1.0%
T-out: 4.3%, 404s: 13.1%
Robots: 2.0%, Other: 12.0%)

98,088
(3,021)

26,430,202
(938,480)

1,272,606,671
(41,317,119)

v1.7.20   Linux

mj12-kan-22-03

03/06/2020 02:46:20

2 hours 46 mins 1 sec

591

18

72.8%
(DNS: 1.0%, Conn: 1.4%
T-out: 1.7%, 404s: 14.3%
Robots: 1.6%, Other: 7.2%)

113,378
(5,099)

26,844,100
(973,095)

1,261,174,616
(40,931,080)

v1.7.20   Linux

mj12-kan-25-03

03/06/2020 02:46:20

2 hours 46 mins 1 sec

489

19

67.9%
(DNS: 1.5%, Conn: 1.1%
T-out: 3.0%, 404s: 14.8%
Robots: 2.9%, Other: 8.8%)

108,276
(3,399)

26,880,785
(973,638)

1,265,256,251
(41,144,377)

v1.7.20   Linux

mj12-kan-23-01

03/06/2020 02:46:20

2 hours 46 mins 2 secs

406

19

68.4%
(DNS: 0.4%, Conn: 1.1%
T-out: 4.5%, 404s: 16.0%
Robots: 1.7%, Other: 7.9%)

107,364
(3,393)

26,873,338
(965,717)

1,269,866,160
(41,240,578)

v1.7.20   Linux

mj12-kan-28-02

03/06/2020 02:59:26

2 hours 46 mins 1 sec

569

21

70.3%
(DNS: 1.0%, Conn: 0.6%
T-out: 4.3%, 404s: 12.6%
Robots: 1.5%, Other: 9.7%)

115,951
(4,725)

26,520,901
(955,771)

1,089,648,805
(35,190,437)

v1.7.20   Linux

mj12-kan-21-03

03/06/2020 02:59:27

2 hours 46 mins 1 sec

652

25

67.8%
(DNS: 3.6%, Conn: 2.1%
T-out: 1.7%, 404s: 18.3%
Robots: 1.5%, Other: 5.1%)

114,443
(4,163)

26,885,139
(967,137)

1,252,190,086
(40,573,955)

v1.7.20   Linux

mj12-kan-25-01

03/06/2020 02:59:28

2 hours 46 mins 0 sec

455

20

71.9%
(DNS: 1.0%, Conn: 0.2%
T-out: 3.2%, 404s: 14.0%
Robots: 0.2%, Other: 9.5%)

113,089
(4,142)

26,757,159
(966,548)

1,267,278,356
(41,115,169)

v1.7.20   Linux

mj12-kan-26-02

03/06/2020 02:59:30

2 hours 46 mins 1 sec

398

19

71.9%
(DNS: 0.7%, Conn: 1.0%
T-out: 3.5%, 404s: 13.1%
Robots: 2.3%, Other: 7.5%)

112,274
(3,961)

26,957,838
(971,779)

1,080,288,547
(35,008,576)

v1.7.20   Linux

mj12-kan-27-03

03/06/2020 02:59:31

2 hours 46 mins 1 sec

618

20

71.2%
(DNS: 1.1%, Conn: 1.4%
T-out: 3.9%, 404s: 11.5%
Robots: 2.6%, Other: 8.3%)

129,462
(4,699)

26,768,428
(970,083)

1,064,913,415
(34,310,542)

v1.7.20   Linux

mj12-kan-27-01

03/06/2020 02:59:31

2 hours 46 mins 1 sec

435

20

73.0%
(DNS: 1.0%, Conn: 1.2%
T-out: 2.9%, 404s: 12.5%
Robots: 1.3%, Other: 8.1%)

112,472
(3,118)

26,657,768
(968,097)

1,066,011,817
(34,387,947)

v1.7.20   Linux

mj12-kan-25-02

03/06/2020 02:59:32

2 hours 46 mins 1 sec

488

21

73.8%
(DNS: 0.5%, Conn: 1.0%
T-out: 3.0%, 404s: 12.6%
Robots: 1.2%, Other: 7.8%)

123,310
(4,024)

26,654,348
(960,128)

1,265,682,715
(41,132,412)

v1.7.20   Linux

mj12-kan-26-01

03/06/2020 02:59:32

2 hours 46 mins 1 sec

512

29

66.3%
(DNS: 1.0%, Conn: 0.9%
T-out: 5.4%, 404s: 12.0%
Robots: 2.1%, Other: 12.3%)

111,586
(3,464)

26,801,152
(956,883)

1,085,347,306
(35,090,956)

v1.7.20   Linux

mj12-kan-24-02

03/06/2020 02:59:33

2 hours 46 mins 1 sec

568

22

73.1%
(DNS: 0.9%, Conn: 0.9%
T-out: 1.6%, 404s: 13.6%
Robots: 1.6%, Other: 8.3%)

112,400
(4,273)

26,888,890
(974,236)

1,274,533,199
(41,386,030)

v1.7.20   Linux

mj12-kan-28-01

03/06/2020 02:59:33

2 hours 46 mins 1 sec

465

14

66.4%
(DNS: 1.7%, Conn: 1.4%
T-out: 4.3%, 404s: 10.8%
Robots: 3.6%, Other: 11.8%)

92,338
(3,375)

27,040,791
(972,443)

1,084,534,633
(35,103,636)

v1.7.20   Linux

mj12-kan-26-03

03/06/2020 02:59:34

2 hours 46 mins 2 secs

455

18

65.5%
(DNS: 1.1%, Conn: 2.6%
T-out: 2.2%, 404s: 12.1%
Robots: 4.7%, Other: 11.8%)

113,150
(4,105)

26,306,553
(951,318)

1,080,849,306
(34,976,106)

v1.7.20   Linux

mj12-kan-21-01

03/06/2020 02:59:34

2 hours 46 mins 2 secs

659

22

77.5%
(DNS: 0.1%, Conn: 0.6%
T-out: 1.6%, 404s: 9.2%
Robots: 0.7%, Other: 10.3%)

96,995
(3,461)

27,237,210
(977,666)

1,252,234,547
(40,455,862)

v1.7.20   Linux

mj12-kan-24-01

03/06/2020 02:59:34

2 hours 46 mins 2 secs

443

21

71.1%
(DNS: 0.7%, Conn: 0.5%
T-out: 3.6%, 404s: 10.6%
Robots: 3.1%, Other: 10.4%)

113,915
(4,088)

26,860,963
(974,891)

1,271,078,980
(41,272,756)

v1.7.20   Linux

mj12-kan-28-03

03/06/2020 02:59:36

2 hours 46 mins 1 sec

745

20

75.5%
(DNS: 0.8%, Conn: 0.9%
T-out: 2.1%, 404s: 14.7%
Robots: 2.6%, Other: 3.5%)

116,063
(4,805)

27,048,768
(976,118)

1,089,346,781
(35,153,832)

v1.7.20   Linux

mj12-kan-22-01

03/06/2020 02:59:36

2 hours 46 mins 1 sec

469

17

74.7%
(DNS: 0.5%, Conn: 0.9%
T-out: 4.4%, 404s: 11.0%
Robots: 1.4%, Other: 7.2%)

105,406
(3,859)

26,933,269
(979,001)

1,279,517,599
(41,493,997)

v1.7.20   Linux

mj12-kan-21-02

03/06/2020 02:59:38

2 hours 46 mins 1 sec

283

12

69.0%
(DNS: 0.1%, Conn: 1.7%
T-out: 5.8%, 404s: 13.3%
Robots: 1.0%, Other: 9.2%)

84,408
(2,986)

27,198,778
(967,928)

1,262,668,560
(40,790,262)

v1.7.20   Linux

mj12-kan-27-02

03/06/2020 02:59:38

2 hours 46 mins 1 sec

388

17

69.0%
(DNS: 1.7%, Conn: 0.9%
T-out: 3.3%, 404s: 14.0%
Robots: 1.2%, Other: 10.0%)

100,936
(3,772)

26,745,326
(960,837)

1,068,705,542
(34,397,333)

v1.7.20   Linux

mj12-kan-23-03

03/06/2020 02:59:38

2 hours 46 mins 1 sec

430

24

74.0%
(DNS: 0.5%, Conn: 0.6%
T-out: 3.1%, 404s: 13.9%
Robots: 0.8%, Other: 7.0%)

108,812
(3,645)

26,633,964
(963,984)

1,271,338,998
(41,193,913)

Total (24 nodes)

11,739

503

-

2,616,326
(92,475)

643,589,090
(23,197,955)

28,723,215,096
(930,391,573)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 03 Jun 2020 03:00:37:913 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12