[Mailman-Users] Mailman + htDig

Fri Aug 8 22:57:55 CEST 2003

> Can you confirm you mean that the per-list htdig directories of the  
> following form are being created:
>
> $prefix/archives/private/<listname>/htdig are being created
>
> and that inside each of them there is a file named <listname>.conf
>
> Is there also a file called rundig_last_run and a bunch of ,db files 
> in  any of these per list directories?

Yes, all of that did get created.

>> and if I manually perform a search (htsearch -c <blah>)
>
>
> While htsearch is used for index searching, it is not called directly  
> from the form on the list TOC page with the integration but via the  
> $prefix/Mailman/Cgi/mmsearch.py script.
>
> When you run htsearch -c are you specifying the configuration file 
> path  as:
>
> $prefix/archives/private/<listname>/htdig/<listname>.conf 

Yes.

>> , I do get output and results.
>
>
> How have the search indexes being used by htsearch when you run it by  
> hand been built? Did you run nightly_htdig by hand?

Yes.

>
> What form do the URLs of search hits in the response returned by  
> htsearch take? 

Well, they look like:
htsearch -c htdig/test.conf
Enter value for words: test
Content-type: text/html

Enter value for format:
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<html><head><title>Search results for 'test'</title></head>
<body bgcolor="#eef7ff">
<....snip....>
<hr noshade size="1">
<img src="/htdig/star.gif" alt="*"><img src="/htdig/star.gif" 
alt="*"><img src="/htdig/star.gif" alt="*"><img src="/htdig/star.gif" 
alt="*"> <strong><a 
href="http://lists.wesmo.com/mailman/htdig/test/2003-August/000029.html">[Test] 
test </a></strong><br>
<....snip....>

>> However, I am not getting the search form at the top of the 
>> index.html  page as is supposed to happen.  So, as expected, I cannot 
>> search via  the web interface. :(
>
>
> The trigger for this form to be added to a list's archive TOC page is 
> a  new message being sent to that particular list. And until 
> nightly_htidg  has been run (which can be done from the command lien 
> as well as by  cron) no per-list search indexes will be in existence. 
> Are these  criteria being met and yet still the form does not appear 
> on a list's  archive TOC page? 

Yes.  I first added the following to my mm_cfg.py:
USE_HTDIG = 0    # 0 - don't use integrated htdig, 1 - use it
HTDIG_FILES_URL = '/htdig/'
HTDIG_CONF_LINK_DIR = os.path.join(VAR_PREFIX, 'archives', 'htdig')
HTDIG_HTSEARCH_PATH = '/usr/bin/htsearch'
HTDIG_RUNDIG_PATH = '/usr/bin/rundig'

Then I changed "USE_HTDIG" to 1 and restarted the qrunner (just for the 
sake of sanity. :).  I then sent a message to the test list.  At once I 
got the message that was sent to the test list, I checked out the 
archives/private/test directory and saw that the timestamp on index.html 
was updated, that a directory called htdig was created, and there were a 
bunch of files (db.*, rundig_last_run, and test.conf) in that htdig 
directory.

> Does line 757 (or thereabouts) of 
> $prefix/Mailman/Archiver/HyperArch.py  contain the following text:
>
> d["htsearch"] = quick_maketext('TOC_htsearch.html', dict=h,
>
> This is the code that generates the form that is added to the html of  
> the list's TOC page a few lines further on. If this line is missing  
> then the patching has failed somehow. 

I just checked, and it is there.  Is the TOC_htsearch.html file supposed 
to be in a particular location?  It is in templates/en/ right now...

>> I *believe* I followed the htdig docs to the letter,
>
>
> Do you mean the INSTALL.htdig-mm document in the Mailman build  
> directory? 

Yup.. that, and the docs on the website.

I swear it seems like I missed something simple (and stupid) here.. I 
even confirmed that the permissions on the directory and all files were 
set correctly (owner & group, too!).

Thanks!
-Rich