[Mailman-Users] Archive merge and search
Hal
my_list_address at yahoo.no
Thu Dec 11 10:50:26 CET 2014
On 10/12/2014 20:07, Mark Sapiro wrote:
> On 12/10/2014 01:41 AM, Hal wrote:
>> Any idea what could be causing list messages not to be archived? My
>> "Archiving options" seem fine:
>>
>> archive: yes
>> archive_private: private
>> archive_volume_freq.: monthly
>
>
> Lot's of things. ArchRunner not running, permissions issues in the
> archive, other things causing exceptions in ArchRunner.
>
> Check that ArchRunner is running (ps -fAww|grep ArchRunner).
Here's what I get:
$ ps -fAww|grep ArchRunner
mailman 1368 1346 0 Aug01 ? 00:36:10 /usr/bin/python
/usr/lib/mailman/bin/qrunner --runner=ArchRunner:0:1 -s
hal 20027 20009 0 20:32 pts/3 00:00:00 grep ArchRunner
Does this mean it's been running since august 1st this year and it's
still running as it should?
> Look in Mailman's error log. If you find errors and shunted messages,
> you can archive the shunted messages by running 'bin/unshunt' after
> fixing the underlying problem and after removing any unwanted message
> entries from qfiles/shunt. Run 'bin/show_qfiles qfiles/shunt/*' to see
> what's there/
$ /usr/lib/mailman/bin/show_qfiles qfiles/shunt/*
====================> qfiles/shunt/*
Traceback (most recent call last):
File "/usr/lib/mailman/bin/show_qfiles", line 95, in <module>
main()
File "/usr/lib/mailman/bin/show_qfiles", line 81, in main
fp = open(filename)
IOError: [Errno 2] No such file or directory: 'qfiles/shunt/*'
$
I'm not sure how to interpret the above though.
I located the /var/log/mailman/ directory which is where I suppose the
mentioned logs are located?
There's a whole bunch of files there:
$ ls
total 144
-rw-rw-r-- 1 mailman mailman 16289 Dec 10 21:07 bounce
-rw-rw-r-- 1 mailman mailman 83 Nov 13 23:22 bounce-20141116
-rw-rw-r-- 1 mailman mailman 249 Nov 20 16:17 bounce-20141123
-rw-rw-r-- 1 mailman mailman 83 Nov 28 15:55 bounce-20141130
-rw-rw-r-- 1 mailman mailman 83 Dec 2 11:56 bounce-20141207
-rw-rw-r-- 1 apache mailman 15801 Dec 10 20:51 error
-rw-rw-r-- 1 apache mailman 128 Nov 10 12:03 error-20141116
-rw-rw-r-- 1 apache mailman 0 Nov 16 03:34 error-20141123
-rw-rw-r-- 1 apache mailman 0 Nov 23 03:32 error-20141130
-rw-rw-r-- 1 apache mailman 0 Nov 30 03:12 error-20141207
-rw-rw-r-- 1 apache mailman 279 May 24 2014 mischief
-rw-rw-r-- 1 mailman mailman 1843 Dec 10 20:51 post
-rw-rw-r-- 1 mailman mailman 0 Nov 9 03:35 post-20141116
-rw-rw-r-- 1 mailman mailman 0 Nov 16 03:34 post-20141123
-rw-rw-r-- 1 mailman mailman 0 Nov 23 03:32 post-20141130
-rw-rw-r-- 1 mailman mailman 0 Nov 30 03:12 post-20141207
-rw-rw-r-- 1 mailman mailman 729 Dec 7 03:08 qrunner
-rw-rw-r-- 1 mailman mailman 729 Nov 9 03:35 qrunner-20141116
-rw-rw-r-- 1 mailman mailman 729 Nov 16 03:34 qrunner-20141123
-rw-rw-r-- 1 mailman mailman 729 Nov 23 03:32 qrunner-20141130
-rw-rw-r-- 1 mailman mailman 729 Nov 30 03:12 qrunner-20141207
-rw-rw-r-- 1 mailman mailman 5834 Dec 11 12:00 smtp
-rw-rw-r-- 1 mailman mailman 2235 Nov 15 08:00 smtp-20141116
-rw-rw-r-- 1 mailman mailman 4178 Nov 22 08:00 smtp-20141123
-rw-rw-r-- 1 mailman mailman 2643 Nov 29 08:00 smtp-20141130
-rw-rw-r-- 1 mailman mailman 2792 Dec 6 08:00 smtp-20141207
-rw-rw-r-- 1 mailman mailman 2460 Dec 10 20:51 smtp-failure
-rw-rw-r-- 1 mailman mailman 0 Nov 9 03:35 smtp-failure-20141116
-rw-rw-r-- 1 mailman mailman 0 Nov 16 03:34 smtp-failure-20141123
-rw-rw-r-- 1 mailman mailman 0 Nov 23 03:32 smtp-failure-20141130
-rw-rw-r-- 1 mailman mailman 0 Nov 30 03:12 smtp-failure-20141207
-rw-rw-r-- 1 apache mailman 184 Dec 8 02:17 subscribe
-rw-rw-r-- 1 apache mailman 96 Nov 13 23:22 subscribe-20141116
-rw-rw-r-- 1 apache mailman 96 Nov 20 16:17 subscribe-20141123
-rw-rw-r-- 1 apache mailman 96 Nov 28 15:55 subscribe-20141130
-rw-rw-r-- 1 apache mailman 0 Nov 30 03:12 subscribe-20141207
-rw-rw-r-- 1 mailman mailman 206 Dec 8 02:51 vette
-rw-rw-r-- 1 mailman mailman 0 Nov 9 03:35 vette-20141116
-rw-rw-r-- 1 mailman mailman 374 Nov 20 15:14 vette-20141123
-rw-rw-r-- 1 mailman mailman 94 Nov 25 10:34 vette-20141130
-rw-rw-r-- 1 mailman mailman 204 Dec 6 01:57 vette-20141207
$
I had a look at the most obvious file "error" (with yesterday's date)
which shows a whole lot of permissions errors:
$ more error
Dec 09 12:58:27 2014 (1368) Archive file access failure:
/var/lib/mailman/archives/private/my_list_name.mbox/my_list_name.mbox
[Errno 13] Permission denied:
'/var/lib/mailman/archives/private/my_list_name.mbox/my_list_name.mbox'
Dec 09 12:58:27 2014 (1368) Uncaught runner exception: [Errno 13]
Permission denied: '/var/lib/mailman/archives/private/my_list_name.mbo
x/my_list_name.mbox'
Dec 09 12:58:27 2014 (1368) Traceback (most recent call last):
File "/usr/lib/mailman/Mailman/Queue/Runner.py", line 120, in _oneloop
self._onefile(msg, msgdata)
File "/usr/lib/mailman/Mailman/Queue/Runner.py", line 191, in _onefile
keepqueued = self._dispose(mlist, msg, msgdata)
File "/usr/lib/mailman/Mailman/Queue/ArchRunner.py", line 73, in _dispose
mlist.ArchiveMail(msg)
File "/usr/lib/mailman/Mailman/Archiver/Archiver.py", line 200, in
ArchiveMail
self.__archive_to_mbox(msg)
File "/usr/lib/mailman/Mailman/Archiver/Archiver.py", line 169, in
__archive_to_mbox
mbox = self.__archive_file(afn)
File "/usr/lib/mailman/Mailman/Archiver/Archiver.py", line 157, in
__archive_file
return Mailbox.Mailbox(open(afn, 'a+'))
IOError: [Errno 13] Permission denied:
'/var/lib/mailman/archives/private/my_list_name.mbox/my_list_name.mbox'
Dec 09 12:58:27 2014 (1368) SHUNTING:
1418083106.1332631+b14c9e32a3019daba3fe4613ed678dd0ea9ef638
Dec 09 13:25:58 2014 (1368) Archive file access failure:
/var/lib/mailman/archives/private/my_list_name.mbox/my_list_name.mbox
[Errno 13] Permission denied: '/var/lib/mailman/archives/privat
e/my_list_name.mbox/my_list_name.mbox'
Dec 09 13:25:58 2014 (1368) Uncaught runner exception: [Errno 13]
Permission denied: '/var/lib/mailman/archives/private/my_list_name.mbo
x/my_list_name.mbox'
Dec 09 13:25:58 2014 (1368) Traceback (most recent call last):
File "/usr/lib/mailman/Mailman/Queue/Runner.py", line 120, in _oneloop
self._onefile(msg, msgdata)
File "/usr/lib/mailman/Mailman/Queue/Runner.py", line 191, in _onefile
keepqueued = self._dispose(mlist, msg, msgdata)
File "/usr/lib/mailman/Mailman/Queue/ArchRunner.py", line 73, in _dispose
mlist.ArchiveMail(msg)
File "/usr/lib/mailman/Mailman/Archiver/Archiver.py", line 200, in
ArchiveMail
self.__archive_to_mbox(msg)
File "/usr/lib/mailman/Mailman/Archiver/Archiver.py", line 169, in
__archive_to_mbox
mbox = self.__archive_file(afn)
File "/usr/lib/mailman/Mailman/Archiver/Archiver.py", line 157, in
__archive_file
return Mailbox.Mailbox(open(afn, 'a+'))
IOError: [Errno 13] Permission denied:
'/var/lib/mailman/archives/private/my_list_name.mbox/my_list_name.mbox'
Dec 09 13:25:58 2014 (1368) SHUNTING:
1418084757.3008399+c295e9e54242ea28350cd2bc2b722c9e1c599436
Dec 09 14:26:30 2014 (1368) Archive file access failure:
/var/lib/mailman/archives/private/my_list_name.mbox/my_list_name.mbox
[Errno 13] Permission denied: '/var/lib/mailman/archives/privat
e/my_list_name.mbox/my_list_name.mbox'
Dec 09 14:26:30 2014 (1368) Uncaught runner exception: [Errno 13]
Permission denied: '/var/lib/mailman/archives/private/my_list_name.mbo
x/my_list_name.mbox'
Dec 09 14:26:30 2014 (1368) Traceback (most recent call last):
File "/usr/lib/mailman/Mailman/Queue/Runner.py", line 120, in _oneloop
self._onefile(msg, msgdata)
File "/usr/lib/mailman/Mailman/Queue/Runner.py", line 191, in _onefile
I've obviously messed something up while importing all my MBOX files
into the archive. Here's what comes up when I go to the archives to see
the mbox file mentioned in the error log above:
$ cd /var/lib/mailman/archives
$ ls
total 8
drwxr-s--x 6 hal mailman 4096 Nov 19 00:41 private/
drwxr-sr-x 2 hal mailman 4096 Nov 8 15:39 public/
$ cd private/
$ ls
total 32
drwxr-sr-x 2 hal mailman 4096 Nov 8 15:39 mailman/
drwxr-sr-x 2 hal mailman 4096 Nov 8 15:39 mailman.mbox/
drwxrwsr-x 176 hal mailman 20480 Nov 19 03:27 my_list_name/
drwxr-sr-x 2 hal mailman 4096 Nov 8 15:39 my_list_name.mbox/
$ cd my_list_name.mbox/
$ ls
total 808
-rw-r--r-- 1 hal mailman 825894 Nov 8 15:39 my_list_name.mbox
$
Hal
More information about the Mailman-Users
mailing list