Majestic-12 logo
Distributed Search Engine
Enter domain or URL:
Home | DSearch | Projects | Stats | Download | Forum | About

Majestic-12 : DSearch : User Info

Nickname:

Omega

Country:

United States United States

ID:

340

Team:

IGA (Join this team)

Web site:

https://patdavies.net/

Joined:

18/10/2005 21:15:00

URLs crawled:

102,956,582,625

Data (MB)*:

3,189,230,470

Peers (nodes):

Version

Name

Last seen

Uptime

Downstream
(Kbits)**

Upstream
(Kbits)**

Current run successes
(failures****)

Today
URLs (MBs)***

Last 30
days

Total

v1.7.20   Linux

mj12-kan-24-02

09/08/2020 13:46:32

1 hour 46 mins 0 sec

652

15

78.5%
(DNS: 1.1%, Conn: 0.9%
T-out: 3.0%, 404s: 8.8%
Robots: 1.2%, Other: 6.5%)

595,446
(22,220)

29,522,910
(1,069,231)

1,337,659,595
(43,599,739)

v1.7.20   Linux

mj12-kan-24-03

09/08/2020 13:46:32

1 hour 46 mins 0 sec

356

15

81.6%
(DNS: 0.4%, Conn: 0.1%
T-out: 0.0%, 404s: 9.1%
Robots: 1.3%, Other: 7.6%)

622,722
(26,152)

29,264,466
(1,063,585)

1,335,342,183
(43,518,258)

v1.7.20   Linux

mj12-kan-21-01

09/08/2020 13:46:32

1 hour 46 mins 0 sec

612

12

82.4%
(DNS: 0.1%, Conn: 1.6%
T-out: 2.7%, 404s: 9.0%
Robots: 1.0%, Other: 3.2%)

594,065
(23,886)

29,516,400
(1,062,568)

1,315,749,733
(42,693,964)

v1.7.20   Linux

mj12-kan-28-03

09/08/2020 13:46:32

1 hour 46 mins 0 sec

490

16

79.9%
(DNS: 0.0%, Conn: 2.8%
T-out: 4.0%, 404s: 8.2%
Robots: 2.0%, Other: 3.0%)

585,539
(20,555)

29,205,420
(1,056,170)

1,152,026,173
(37,358,914)

v1.7.20   Linux

mj12-kan-21-03

09/08/2020 13:46:32

1 hour 46 mins 0 sec

710

18

82.0%
(DNS: 0.8%, Conn: 0.2%
T-out: 2.2%, 404s: 9.0%
Robots: 1.6%, Other: 4.2%)

598,163
(21,545)

29,852,240
(1,084,169)

1,315,693,712
(42,817,754)

v1.7.20   Linux

mj12-kan-25-01

09/08/2020 13:46:32

1 hour 46 mins 0 sec

537

15

75.4%
(DNS: 1.2%, Conn: 1.9%
T-out: 2.7%, 404s: 11.0%
Robots: 1.1%, Other: 6.6%)

604,180
(21,594)

29,387,741
(1,066,785)

1,330,354,737
(43,337,359)

v1.7.20   Linux

mj12-kan-24-01

09/08/2020 13:46:32

1 hour 46 mins 1 sec

575

14

76.4%
(DNS: 0.2%, Conn: 0.9%
T-out: 3.0%, 404s: 13.3%
Robots: 2.6%, Other: 3.5%)

623,745
(22,995)

29,454,396
(1,065,964)

1,334,599,864
(43,500,568)

v1.7.20   Linux

mj12-kan-27-02

09/08/2020 13:46:32

1 hour 46 mins 0 sec

716

15

79.2%
(DNS: 0.0%, Conn: 0.3%
T-out: 2.2%, 404s: 11.6%
Robots: 1.3%, Other: 5.4%)

583,996
(23,343)

29,478,604
(1,064,920)

1,132,406,279
(36,642,997)

v1.7.20   Linux

mj12-kan-28-01

09/08/2020 13:46:32

1 hour 46 mins 0 sec

707

46

79.9%
(DNS: 0.0%, Conn: 0.2%
T-out: 2.8%, 404s: 9.1%
Robots: 2.8%, Other: 5.1%)

624,971
(23,784)

29,247,592
(1,065,150)

1,147,467,590
(37,317,777)

v1.7.20   Linux

mj12-kan-21-02

09/08/2020 13:46:32

1 hour 46 mins 1 sec

526

17

80.8%
(DNS: 0.1%, Conn: 0.3%
T-out: 4.6%, 404s: 6.0%
Robots: 4.0%, Other: 4.3%)

588,619
(21,126)

29,487,854
(1,067,406)

1,326,073,244
(43,020,458)

v1.7.20   Linux

mj12-kan-26-02

09/08/2020 13:46:33

1 hour 46 mins 0 sec

649

15

82.1%
(DNS: 0.0%, Conn: 1.9%
T-out: 1.4%, 404s: 8.5%
Robots: 2.6%, Other: 3.5%)

610,293
(22,236)

28,973,296
(1,046,651)

1,142,732,688
(37,216,245)

v1.7.20   Linux

mj12-kan-27-03

09/08/2020 13:46:33

1 hour 46 mins 0 sec

861

14

74.7%
(DNS: 0.9%, Conn: 0.4%
T-out: 3.9%, 404s: 10.0%
Robots: 3.7%, Other: 6.4%)

588,107
(22,967)

29,469,475
(1,067,663)

1,127,587,642
(36,522,686)

v1.7.20   Linux

mj12-kan-26-01

09/08/2020 13:46:33

1 hour 46 mins 0 sec

1,084

19

79.7%
(DNS: 1.0%, Conn: 1.0%
T-out: 1.5%, 404s: 12.8%
Robots: 0.9%, Other: 3.1%)

627,157
(23,389)

29,418,702
(1,067,833)

1,148,136,605
(37,305,837)

v1.7.20   Linux

mj12-kan-22-02

09/08/2020 13:46:33

1 hour 46 mins 0 sec

655

12

83.4%
(DNS: 3.5%, Conn: 1.2%
T-out: 1.8%, 404s: 6.7%
Robots: 1.4%, Other: 2.0%)

599,519
(21,482)

29,133,833
(1,050,211)

1,336,502,929
(43,569,796)

v1.7.20   Linux

mj12-kan-23-02

09/08/2020 13:46:33

1 hour 46 mins 0 sec

797

19

77.3%
(DNS: 0.6%, Conn: 2.5%
T-out: 3.3%, 404s: 9.0%
Robots: 2.5%, Other: 4.8%)

587,092
(20,703)

29,650,537
(1,070,173)

1,337,818,514
(43,593,797)

v1.7.20   Linux

mj12-kan-28-02

09/08/2020 13:46:33

1 hour 46 mins 1 sec

545

16

81.3%
(DNS: 0.0%, Conn: 1.3%
T-out: 2.6%, 404s: 5.4%
Robots: 2.6%, Other: 6.8%)

637,387
(23,540)

29,273,617
(1,050,710)

1,152,275,653
(37,387,280)

v1.7.20   Linux

mj12-kan-23-01

09/08/2020 13:46:33

1 hour 46 mins 1 sec

920

26

82.2%
(DNS: 0.7%, Conn: 1.2%
T-out: 3.0%, 404s: 8.9%
Robots: 2.1%, Other: 2.1%)

641,213
(22,842)

29,630,849
(1,062,311)

1,333,264,372
(43,470,951)

v1.7.20   Linux

mj12-kan-26-03

09/08/2020 13:46:33

1 hour 46 mins 1 sec

430

11

79.5%
(DNS: 4.2%, Conn: 0.1%
T-out: 1.9%, 404s: 13.0%
Robots: 1.2%, Other: 0.2%)

587,694
(21,758)

29,440,741
(1,073,810)

1,144,205,488
(37,219,875)

v1.7.20   Linux

mj12-kan-22-01

09/08/2020 13:46:33

1 hour 46 mins 1 sec

491

12

78.8%
(DNS: 1.3%, Conn: 0.7%
T-out: 2.0%, 404s: 8.5%
Robots: 2.9%, Other: 5.8%)

590,699
(21,848)

29,489,001
(1,060,084)

1,342,081,054
(43,694,775)

v1.7.20   Linux

mj12-kan-27-01

09/08/2020 13:46:33

1 hour 46 mins 1 sec

433

10

81.0%
(DNS: 0.6%, Conn: 1.2%
T-out: 3.5%, 404s: 6.2%
Robots: 2.8%, Other: 4.7%)

580,729
(22,369)

29,144,040
(1,053,290)

1,128,068,209
(36,572,320)

v1.7.20   Linux

mj12-kan-22-03

09/08/2020 13:46:33

1 hour 46 mins 1 sec

881

17

82.2%
(DNS: 0.7%, Conn: 1.1%
T-out: 2.0%, 404s: 9.3%
Robots: 1.6%, Other: 3.1%)

595,801
(22,966)

29,798,578
(1,074,280)

1,324,808,570
(43,167,068)

v1.7.20   Linux

mj12-kan-23-03

09/08/2020 13:46:33

1 hour 46 mins 1 sec

435

9

77.7%
(DNS: 0.1%, Conn: 1.5%
T-out: 1.6%, 404s: 11.0%
Robots: 0.9%, Other: 7.1%)

574,336
(21,530)

29,447,308
(1,062,645)

1,334,818,288
(43,420,906)

v1.7.20   Linux

mj12-kan-25-03

09/08/2020 13:46:33

1 hour 46 mins 1 sec

499

13

80.2%
(DNS: 1.2%, Conn: 1.2%
T-out: 1.1%, 404s: 9.8%
Robots: 2.0%, Other: 4.6%)

623,589
(23,133)

29,409,828
(1,061,623)

1,328,237,801
(43,353,021)

v1.7.20   Linux

mj12-kan-25-02

09/08/2020 13:46:34

1 hour 46 mins 1 sec

602

14

88.8%
(DNS: 0.0%, Conn: 1.9%
T-out: 1.7%, 404s: 4.5%
Robots: 1.1%, Other: 2.0%)

594,953
(20,866)

29,406,599
(1,065,110)

1,328,755,798
(43,353,122)

Total (24 nodes)

15,163

390

-

14,460,015
(538,829)

706,104,027
(25,532,342)

30,236,666,721
(983,655,467)

The following chart shows Omega's contribution (blue) to overall crawling effort by day.

Last updated: 09 Aug 2020 13:57:37:820 GMT

* data volumes were counted for nodes v1.0.0 or higher from 11 Apr 2005. Once indexing is complete data volumes will be updated retrospectively.
** sustained overall bandwidth usage over whole period of that session
*** URLs and Megabytes (MBs) of data crawled in that periods (Today, Last 30 days, Total)
**** DNS: DNS resolves errors, Conn: connection errors, T-out: timeouts, 404s: URL Not Found code, Robots: robots.txt blocks, Other: everything else

Copyright © Majestic-12