integrating htdig with cpanel mailman
Hello, I'm attempting to get Mailman 2.1.20 working with htdig. I've installed the htdig patch for this version of Mailman from Mark's site. When I run a search from the archive pages, I get a blank page. I've seen others asking this, but have never seen a solution. I think I may have had this working a few years ago, but don't remember what I did to fix it. It broke when cpanel updated mailman. When I try running the mmsearch script by itself, I get the following error, which is expected as I under stand it: htdig Archives Access Failure CGI problem. -5-Field count -4- fields: If you want to make another attempt to access a list archive then go via the list users information page.
If this problem persists then please e-mail the following information to the mailman@nfbnet.org: Referer not known /mailman/mmsearch/blparent_nfbnet.org
Running the htsearch command by itself doesn't yield any results with a keyword and the short format. The version of htdig is 3.2.0b6. I noticed that there are patched versions of rundig and the nightly scripts on the patch site, but don't know if that applies to newer patches or not.
Any help would be appreciated.
On 09/01/2015 12:32 PM, Jason Fayre wrote:
Hello, I'm attempting to get Mailman 2.1.20 working with htdig. I've installed the htdig patch for this version of Mailman from Mark's site.
I'd be surprised if this doesn't have conflicts with cPanel's mods. What happened when you ran patch? were there any rejects?
When I run a search from the archive pages, I get a blank page. I've seen others asking this, but have never seen a solution. I think I may have had this working a few years ago, but don't remember what I did to fix it. It broke when cpanel updated mailman.
Not surprising. cPanel's mailman has many patches of its own, mostly because of the list name = name_domain feature to allow lists of the same 'name' in different domains.
When I try running the mmsearch script by itself, I get the following error, which is expected as I under stand it: htdig Archives Access Failure CGI problem. -5-Field count -4- fields:
Yes, this is expected. You could try going to a URL like
http://example.com/mailman/mmsearch/LISTNAME?method=and&format=short&sort=score&config=LISTNAME
If you want to make another attempt to access a list archive then go via the list users information page.
If this problem persists then please e-mail the following information to the mailman@nfbnet.org: Referer not known /mailman/mmsearch/blparent_nfbnet.org
The above is not familiar to me. It may be a cPanel thing.
Running the htsearch command by itself doesn't yield any results with a keyword and the short format.
Do you specify the -c option with an appropriate config file?
The version of htdig is 3.2.0b6. I noticed that there are patched versions of rundig and the nightly scripts on the patch site, but don't know if that applies to newer patches or not.
Those patches allow the nightly update to do an update rather than a complete rebuild of the htdig search index.
-- Mark Sapiro mark@msapiro.net The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
Hello, I do not get any rejects when applying the patch. I did pass the config file for the list to htsearch with the -c option. Any other ideas? How are people typically handling archive search? I know I could use mail-archive, but would rather handle things on our end if we can. Occasionally we need to remove messages from the archives and not sure how easy that is with mail-archive.
-----Original Message----- From: Mailman-Users [mailto:mailman-users-bounces+jason=fayre.me@python.org] On Behalf Of Mark Sapiro Sent: Wednesday, September 02, 2015 3:04 AM To: mailman-users@python.org Subject: Re: [Mailman-Users] integrating htdig with cpanel mailman
On 09/01/2015 12:32 PM, Jason Fayre wrote:
Hello, I'm attempting to get Mailman 2.1.20 working with htdig. I've installed the htdig patch for this version of Mailman from Mark's site.
I'd be surprised if this doesn't have conflicts with cPanel's mods. What happened when you ran patch? were there any rejects?
When I run a search from the archive pages, I get a blank page. I've seen others asking this, but have never seen a solution. I think I may have had this working a few years ago, but don't remember what I did to fix it. It broke when cpanel updated mailman.
Not surprising. cPanel's mailman has many patches of its own, mostly because of the list name = name_domain feature to allow lists of the same 'name' in different domains.
When I try running the mmsearch script by itself, I get the following error, which is expected as I under stand it: htdig Archives Access Failure CGI problem. -5-Field count -4- fields:
Yes, this is expected. You could try going to a URL like
<http://example.com/mailman/mmsearch/LISTNAME?method=and&format=short&sort=s core&config=LISTNAME>
If you want to make another attempt to access a list archive then go via the list users information page.
If this problem persists then please e-mail the following information to the mailman@nfbnet.org: Referer not known /mailman/mmsearch/blparent_nfbnet.org
The above is not familiar to me. It may be a cPanel thing.
Running the htsearch command by itself doesn't yield any results with a keyword and the short format.
Do you specify the -c option with an appropriate config file?
The version of htdig is 3.2.0b6. I noticed that there are patched versions of rundig and the nightly scripts on the patch site, but don't know if that applies to newer patches or not.
Those patches allow the nightly update to do an update rather than a complete rebuild of the htdig search index.
-- Mark Sapiro mark@msapiro.net The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
Mailman-Users mailing list Mailman-Users@python.org https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/jason%40fayre.me
On 09/02/2015 06:22 AM, Jason Fayre wrote:
Hello, I do not get any rejects when applying the patch. I did pass the config file for the list to htsearch with the -c option. Any other ideas?
The attached htsearch.txt is a transcript of an htsearch interaction on my system. If you do the same do you get similar output? If not, your htdig installation is broken.
How are people typically handling archive search? I know I could use mail-archive, but would rather handle things on our end if we can.
I use htdig with Richard Barrett's patches as forward ported by me. Other suggestions are in the FAQ at http://wiki.list.org/x/4030514.
-- Mark Sapiro mark@msapiro.net The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
Ok, I will try that. What version of htdig are you running?
-----Original Message----- From: Mark Sapiro [mailto:mark@msapiro.net] Sent: Wednesday, September 02, 2015 11:46 AM To: Jason Fayre jason@fayre.me; mailman-users@python.org Subject: Re: [Mailman-Users] integrating htdig with cpanel mailman
On 09/02/2015 06:22 AM, Jason Fayre wrote:
Hello, I do not get any rejects when applying the patch. I did pass the config file for the list to htsearch with the -c option. Any other ideas?
The attached htsearch.txt is a transcript of an htsearch interaction on my system. If you do the same do you get similar output? If not, your htdig installation is broken.
How are people typically handling archive search? I know I could use mail-archive, but would rather handle things on our end if we can.
I use htdig with Richard Barrett's patches as forward ported by me. Other suggestions are in the FAQ at http://wiki.list.org/x/4030514.
-- Mark Sapiro mark@msapiro.net The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
On 09/02/2015 08:54 AM, Jason Fayre wrote:
Ok, I will try that. What version of htdig are you running?
3.2.0b6 with the rundig.0 patch from ftp://ftp.ccsf.org/htdig-patches/3.2.0b6/ and with this patch the source of which I no longer remember and can't find.
RCS file: /cvsroot/htdig/htdig/htsearch/Collection.h,v retrieving revision 1.4 diff -r1.4 Collection.h 39c39 < void Collection::Open();
void Open();
41c41 < void Collection::Close();
void Close();
Also, in an earlier reply I wrote:
If you want to make another attempt to access a list archive then go via the list users information page.
If this problem persists then please e-mail the following information to the mailman at nfbnet.org: Referer not known /mailman/mmsearch/blparent_nfbnet.org
The above is not familiar to me. It may be a cPanel thing.
Actually, that is also part of the normal expected output from running mmsearch with no parameters.
-- Mark Sapiro mark@msapiro.net The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
Absolutely unbelievable! I got results to come up by simlinking /var/www/html/htdig to /usr/share/htdig. Apparently this path is hard-coded in the binaries. I installed htdig from the Centos 6.7 packages. It wouldn't compile from source for some reason.
-----Original Message----- From: Mark Sapiro [mailto:mark@msapiro.net] Sent: Wednesday, September 02, 2015 12:31 PM To: Jason Fayre jason@fayre.me; mailman-users@python.org Subject: Re: [Mailman-Users] integrating htdig with cpanel mailman
On 09/02/2015 08:54 AM, Jason Fayre wrote:
Ok, I will try that. What version of htdig are you running?
3.2.0b6 with the rundig.0 patch from ftp://ftp.ccsf.org/htdig-patches/3.2.0b6/ and with this patch the source of which I no longer remember and can't find.
RCS file: /cvsroot/htdig/htdig/htsearch/Collection.h,v retrieving revision 1.4 diff -r1.4 Collection.h 39c39 < void Collection::Open();
void Open();
41c41 < void Collection::Close();
void Close();
Also, in an earlier reply I wrote:
If you want to make another attempt to access a list archive then go via the list users information page.
If this problem persists then please e-mail the following information to the mailman at nfbnet.org: Referer not known /mailman/mmsearch/blparent_nfbnet.org
The above is not familiar to me. It may be a cPanel thing.
Actually, that is also part of the normal expected output from running mmsearch with no parameters.
-- Mark Sapiro mark@msapiro.net The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
Hi, Almost got it. Since some of our lists are very large and the archives go back almost 7 years, generating the indexes can take a very long time. To be able to update the indexes, do I need both the rundig and nightly_htdig patches from msapiro.net/mm? The rundig patch failed when I tried to patch the rundig from 3.2.0b6.
-----Original Message----- From: Mark Sapiro [mailto:mark@msapiro.net] Sent: Wednesday, September 02, 2015 12:31 PM To: Jason Fayre jason@fayre.me; mailman-users@python.org Subject: Re: [Mailman-Users] integrating htdig with cpanel mailman
On 09/02/2015 08:54 AM, Jason Fayre wrote:
Ok, I will try that. What version of htdig are you running?
3.2.0b6 with the rundig.0 patch from ftp://ftp.ccsf.org/htdig-patches/3.2.0b6/ and with this patch the source of which I no longer remember and can't find.
RCS file: /cvsroot/htdig/htdig/htsearch/Collection.h,v retrieving revision 1.4 diff -r1.4 Collection.h 39c39 < void Collection::Open();
void Open();
41c41 < void Collection::Close();
void Close();
Also, in an earlier reply I wrote:
If you want to make another attempt to access a list archive then go via the list users information page.
If this problem persists then please e-mail the following information to the mailman at nfbnet.org: Referer not known /mailman/mmsearch/blparent_nfbnet.org
The above is not familiar to me. It may be a cPanel thing.
Actually, that is also part of the normal expected output from running mmsearch with no parameters.
-- Mark Sapiro mark@msapiro.net The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
On 09/02/2015 12:02 PM, Jason Fayre wrote:
Hi, Almost got it. Since some of our lists are very large and the archives go back almost 7 years, generating the indexes can take a very long time. To be able to update the indexes, do I need both the rundig and nightly_htdig patches from msapiro.net/mm? The rundig patch failed when I tried to patch the rundig from 3.2.0b6.
Yes, you need both. How did the rundig patch fail?
-- Mark Sapiro mark@msapiro.net The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
Hi, Here is a script from when I ran the patch: Script started on Wed 02 Sep 2015 11:35:43 PM UTC root@host [/usr/bin]# patch < ~/rundig patching file rundig Hunk #1 succeeded at 16 with fuzz 2 (offset 1 line). Hunk #2 FAILED at 59. Hunk #3 succeeded at 78 (offset 4 lines). 1 out of 3 hunks FAILED -- saving rejects to file rundig.rej root@host [/usr/bin]# cat rundig.rej --- rundig 2008-12-26 15:55:25.000000000 -0800 +++ rundig 2008-12-26 17:41:43.000000000 -0800 @@ -59,7 +61,7 @@ TMPDIR=$DBDIR export TMPDIR -$BINDIR/htdig -i $opts $stats $alt +$BINDIR/htdig $init $opts $stats $alt $BINDIR/htpurge $opts $alt case "$alt" in -a) root@host [/usr/bin]# On 2015-09-02 4:23 PM, Mark Sapiro wrote:
On 09/02/2015 12:02 PM, Jason Fayre wrote:
Hi, Almost got it. Since some of our lists are very large and the archives go back almost 7 years, generating the indexes can take a very long time. To be able to update the indexes, do I need both the rundig and nightly_htdig patches from msapiro.net/mm? The rundig patch failed when I tried to patch the rundig from 3.2.0b6.
Yes, you need both. How did the rundig patch fail?
On 09/02/2015 04:44 PM, Jason Fayre wrote:
Hi, Here is a script from when I ran the patch: Script started on Wed 02 Sep 2015 11:35:43 PM UTC root@host [/usr/bin]# patch < ~/rundig patching file rundig Hunk #1 succeeded at 16 with fuzz 2 (offset 1 line). Hunk #2 FAILED at 59. Hunk #3 succeeded at 78 (offset 4 lines). 1 out of 3 hunks FAILED -- saving rejects to file rundig.rej root@host [/usr/bin]# cat rundig.rej --- rundig 2008-12-26 15:55:25.000000000 -0800 +++ rundig 2008-12-26 17:41:43.000000000 -0800 @@ -59,7 +61,7 @@ TMPDIR=$DBDIR export TMPDIR
-$BINDIR/htdig -i $opts $stats $alt +$BINDIR/htdig $init $opts $stats $alt $BINDIR/htpurge $opts $alt case "$alt" in -a) root@host [/usr/bin]#
I don't understand this. My rundig is probably different from yours in that I applied the patch from ftp://ftp.ccsf.org/htdig-patches/3.2.0b6/rundig.0 before creating the rundig patch you are applying, but this should only result in a couple of line # offsets, not a failure of hunk 2 or fuzz in hunk 1. Send me a copy of your rundig off list and I'll look at it. -- Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
participants (2)
-
Jason Fayre
-
Mark Sapiro