Hi everybody,
today I tried to migrate our whole mailman installation to another server.
Old server: Centos 6.10, Mailman 2.1.29, Python 2.6.6
New server: Centos 7.7, Mailman 2.1.30 (from the tgz file), Python 2.7.5
It seemed to be an easy transition. But then I started to realize I've run into problems. For example, I can't release a moderated message. Also, I cannot switch users from moderated to not moderated or hidden to unhidden. The error logs look like this:
Apr 26 17:38:16 2020 (11727) Uncaught runner exception: [Errno 1] Operation not permitted Apr 26 17:38:16 2020 (11727) Traceback (most recent call last): Apr 26 17:38:16 2020 (11727) SHUNTING: 1587915493.168592+122b90464edb8dfe2a33eb4e84fd036f0943019c Apr 26 17:38:16 2020 (11727) Failed to unlink/preserve backup file: /var/spool/mailman/virgin/1587915493.168592+bfc8cbc934795ac0c0d663ac31c3ea3df13e9b59.bak Apr 26 17:52:18 2020 (11727) Uncaught runner exception: [Errno 2] No such file or directory: '/var/spool/mailman/virgin/1587916338.266272+f1e11334def7f62140a3442c10bd6b56268d9010.pck' Apr 26 17:52:18 2020 (11727) Traceback (most recent call last): Apr 26 17:52:18 2020 (11727) Skipping and preserving unparseable message: 1587916338.266272+f1e11334def7f62140a3442c10bd6b56268d9010 Apr 26 17:52:19 2020 (11726) Failed to unlink/preserve backup file: /var/spool/mailman/out/1587916338.266272+5c0165dec7b0fdd4e3851688a77b8e31a99b015d.bak Apr 26 17:52:20 2020 (11727) Failed to unlink/preserve backup file: /var/spool/mailman/virgin/1587916338.285911+c4b5275fd082841b395994955b37f5f85569bba9.bak
Apr 26 17:53:13 2020 qrunner(11694): Traceback (most recent call last): Apr 26 17:53:13 2020 qrunner(11694): File "/usr/lib/mailman/bin/qrunner", line 278, in <module> Apr 26 17:53:13 2020 qrunner(11694): main() Apr 26 17:53:13 2020 qrunner(11694): File "/usr/lib/mailman/bin/qrunner", line 238, in main Apr 26 17:53:13 2020 qrunner(11694): qrunner.run() Apr 26 17:53:13 2020 qrunner(11694): File "/usr/lib/mailman/Mailman/Queue/Runner.py", line 87, in run Apr 26 17:53:13 2020 qrunner(11694): self._cleanup() Apr 26 17:53:13 2020 qrunner(11694): File "/usr/lib/mailman/Mailman/Queue/BounceRunner.py", line 263, in _cleanup Apr 26 17:53:13 2020 qrunner(11694): BounceMixin._cleanup(self) Apr 26 17:53:13 2020 qrunner(11694): File "/usr/lib/mailman/Mailman/Queue/BounceRunner.py", line 137, in _cleanup Apr 26 17:53:13 2020 qrunner(11694): self._register_bounces() Apr 26 17:53:13 2020 qrunner(11694): File "/usr/lib/mailman/Mailman/Queue/BounceRunner.py", line 126, in _register_bounces Apr 26 17:53:13 2020 qrunner(11694): mlist.Save() Apr 26 17:53:13 2020 qrunner(11694): File "/usr/lib/mailman/Mailman/MailList.py", line 578, in Save Apr 26 17:53:13 2020 qrunner(11694): self.__save(dict) Apr 26 17:53:13 2020 qrunner(11694): File "/usr/lib/mailman/Mailman/MailList.py", line 555, in __save Apr 26 17:53:13 2020 qrunner(11694): os.link(fname, fname_last) Apr 26 17:53:13 2020 qrunner(11694): OSError : [Errno 1] Operation not permitted
Apr 26 17:53:16 2020 qrunner(11722): Traceback (most recent call last): Apr 26 17:53:16 2020 qrunner(11722): File "/usr/lib/mailman/bin/qrunner", line 278, in <module> Apr 26 17:53:16 2020 qrunner(11722): main() Apr 26 17:53:16 2020 qrunner(11722): File "/usr/lib/mailman/bin/qrunner", line 238, in main Apr 26 17:53:16 2020 qrunner(11722): qrunner.run() Apr 26 17:53:16 2020 qrunner(11722): File "/usr/lib/mailman/Mailman/Queue/Runner.py", line 87, in run Apr 26 17:53:16 2020 qrunner(11722): self._cleanup() Apr 26 17:53:16 2020 qrunner(11722): File "/usr/lib/mailman/Mailman/Queue/BounceRunner.py", line 263, in _cleanup Apr 26 17:53:16 2020 qrunner(11722): BounceMixin._cleanup(self) Apr 26 17:53:16 2020 qrunner(11722): File "/usr/lib/mailman/Mailman/Queue/BounceRunner.py", line 137, in _cleanup Apr 26 17:53:16 2020 qrunner(11722): self._register_bounces() Apr 26 17:53:16 2020 qrunner(11722): File "/usr/lib/mailman/Mailman/Queue/BounceRunner.py", line 126, in _register_bounces Apr 26 17:53:16 2020 qrunner(11722): mlist.Save() Apr 26 17:53:16 2020 qrunner(11722): File "/usr/lib/mailman/Mailman/MailList.py", line 578, in Save Apr 26 17:53:16 2020 qrunner(11722): self.__save(dict) Apr 26 17:53:16 2020 qrunner(11722): File "/usr/lib/mailman/Mailman/MailList.py", line 555, in __save Apr 26 17:53:16 2020 qrunner(11722): os.link(fname, fname_last) Apr 26 17:53:16 2020 qrunner(11722): OSError : [Errno 1] Operation not permitted
/usr/lib/mailman/bin/check_perms -f didn't give me any errors.
I also tried to fall back to Centos' standard mailman package which is 2.1.15 but to no avail.
This took me all day and I'm still where I was in the morning. Any help out there?
Thank you very much!
Lothar Schilling
On 4/26/20 9:05 AM, Lothar Schilling wrote:
Hi everybody,
today I tried to migrate our whole mailman installation to another server.
Old server: Centos 6.10, Mailman 2.1.29, Python 2.6.6
New server: Centos 7.7, Mailman 2.1.30 (from the tgz file), Python 2.7.5
It seemed to be an easy transition. But then I started to realize I've run into problems. For example, I can't release a moderated message. Also, I cannot switch users from moderated to not moderated or hidden to unhidden. The error logs look like this:
Apr 26 17:38:16 2020 (11727) Uncaught runner exception: [Errno 1] Operation not permitted
...
It looks like you have permission issues. Have you run Mailman's bin/check_perms?
Do you have SELinux enabled? If so, try disabling it.
Yes I did check the permissons several times, everything is fine. And no, SELinux was and still is disabled.
Am 26.04.2020 um 18:37 schrieb Mark Sapiro:
On 4/26/20 9:05 AM, Lothar Schilling wrote:
Hi everybody,
today I tried to migrate our whole mailman installation to another server.
Old server: Centos 6.10, Mailman 2.1.29, Python 2.6.6
New server: Centos 7.7, Mailman 2.1.30 (from the tgz file), Python 2.7.5
It seemed to be an easy transition. But then I started to realize I've run into problems. For example, I can't release a moderated message. Also, I cannot switch users from moderated to not moderated or hidden to unhidden. The error logs look like this:
Apr 26 17:38:16 2020 (11727) Uncaught runner exception: [Errno 1] Operation not permitted
...
It looks like you have permission issues. Have you run Mailman's bin/check_perms?
Do you have SELinux enabled? If so, try disabling it.
On 4/26/20 9:57 AM, Lothar Schilling wrote:
Yes I did check the permissons several times, everything is fine. And no, SELinux was and still is disabled.
What user is running Mailman's qrunners?
ps -fwwA|grep qrunner
And what does
ls -laR /var/spool/mailman /var/lib/mailman
give?
Am 26.04.2020 um 19:46 schrieb Mark Sapiro:
On 4/26/20 9:57 AM, Lothar Schilling wrote:
Yes I did check the permissons several times, everything is fine. And no, SELinux was and still is disabled.
What user is running Mailman's qrunners?
ps -fwwA|grep qrunner
And what does
ls -laR /var/spool/mailman /var/lib/mailman
give?
ps -fwwA | grep qrunner
mailman 7439 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=ArchRunner:0:1 -s mailman 7440 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=BounceRunner:0:1 -s mailman 7441 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=CommandRunner:0:1 -s mailman 7442 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=IncomingRunner:0:1 -s mailman 7443 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=NewsRunner:0:1 -s mailman 7444 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=OutgoingRunner:0:1 -s mailman 7445 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=VirginRunner:0:1 -s mailman 7446 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=RetryRunner:0:1 -s mailman 7468 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=ArchRunner:0:1 -s mailman 7469 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=BounceRunner:0:1 -s mailman 7470 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=CommandRunner:0:1 -s mailman 7471 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=IncomingRunner:0:1 -s mailman 7472 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=NewsRunner:0:1 -s mailman 7473 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=OutgoingRunner:0:1 -s mailman 7474 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=VirginRunner:0:1 -s mailman 7475 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=RetryRunner:0:1 -s
ls -laR /var/spool/mailman
drwxrws--- mailman mailman 4096 26. Apr 17:38 archive drwxrws--- mailman mailman 4096 26. Apr 17:52 bad drwxrws--- mailman mailman 4096 26. Apr 17:39 bounces drwxrws--- mailman mailman 4096 9. Okt 2015 commands drwxrws--- root mailman 4096 26. Apr 17:52 in drwxrws--- mailman mailman 4096 9. Okt 2015 news drwxrws--- mailman mailman 77824 26. Apr 17:52 out drwxrws--- mailman mailman 4096 9. Okt 2015 retry drwxrws--- mailman mailman 4096 26. Apr 17:38 shunt drwxrws--- root mailman 86016 26. Apr 17:52 virgin
ls -laR /var/lib/mailman All files & directories have: -rwxrwsr-x apache mailman
/usr/lib/mailman/bin/check_perms -f "Keine Probleme aufgetreten"
On 4/26/20 11:04 PM, Lothar Schilling wrote:
ps -fwwA | grep qrunner
mailman 7439 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=ArchRunner:0:1 -s mailman 7440 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=BounceRunner:0:1 -s mailman 7441 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=CommandRunner:0:1 -s mailman 7442 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=IncomingRunner:0:1 -s mailman 7443 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=NewsRunner:0:1 -s mailman 7444 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=OutgoingRunner:0:1 -s mailman 7445 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=VirginRunner:0:1 -s mailman 7446 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=RetryRunner:0:1 -s mailman 7468 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=ArchRunner:0:1 -s mailman 7469 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=BounceRunner:0:1 -s mailman 7470 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=CommandRunner:0:1 -s mailman 7471 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=IncomingRunner:0:1 -s mailman 7472 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=NewsRunner:0:1 -s mailman 7473 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=OutgoingRunner:0:1 -s mailman 7474 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=VirginRunner:0:1 -s mailman 7475 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=RetryRunner:0:1 -s
This may be a separate issue, but you have two Mailman instances running. See https://wiki.list.org/x/4030715 for how this can happen and what to do about it.
Am 27.04.2020 um 18:42 schrieb Mark Sapiro:
On 4/26/20 11:04 PM, Lothar Schilling wrote:
ps -fwwA | grep qrunner
mailman 7439 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=ArchRunner:0:1 -s mailman 7440 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=BounceRunner:0:1 -s mailman 7441 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=CommandRunner:0:1 -s mailman 7442 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=IncomingRunner:0:1 -s mailman 7443 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=NewsRunner:0:1 -s mailman 7444 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=OutgoingRunner:0:1 -s mailman 7445 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=VirginRunner:0:1 -s mailman 7446 7438 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=RetryRunner:0:1 -s mailman 7468 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=ArchRunner:0:1 -s mailman 7469 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=BounceRunner:0:1 -s mailman 7470 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=CommandRunner:0:1 -s mailman 7471 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=IncomingRunner:0:1 -s mailman 7472 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=NewsRunner:0:1 -s mailman 7473 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=OutgoingRunner:0:1 -s mailman 7474 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=VirginRunner:0:1 -s mailman 7475 7467 0 07:51 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=RetryRunner:0:1 -s
This may be a separate issue, but you have two Mailman instances running. See https://wiki.list.org/x/4030715 for how this can happen and what to do about it.
You're right: There were two mailman instances running simultaneously. I doubt, though, that this was the reason for the migration going wrong. But I'll give try again next weekend and then come back to you - if needed. Thank you.
David: Your qrunner exceptions sound surprisingly like a problem I had earlier this week with a new install of 2.1.30.
In Mailman/Archiver/pipermail.py
change line 60 from: while i>0 and (L[i-1][0] in lowercase or to: while i>0 and (L[i-1][0] in lowercase[:26] or
Restart mailman and see how things go from there.
— Tom Coradeschi tcora@skylands.ibmwr.org
On 26 Apr 2020, at 12:05 PM, Lothar Schilling ls@proasyl.de wrote:
Hi everybody,
today I tried to migrate our whole mailman installation to another server.
Old server: Centos 6.10, Mailman 2.1.29, Python 2.6.6
New server: Centos 7.7, Mailman 2.1.30 (from the tgz file), Python 2.7.5
It seemed to be an easy transition. But then I started to realize I've run into problems. For example, I can't release a moderated message. Also, I cannot switch users from moderated to not moderated or hidden to unhidden. The error logs look like this:
Apr 26 17:38:16 2020 (11727) Uncaught runner exception: [Errno 1] Operation not permitted Apr 26 17:38:16 2020 (11727) Traceback (most recent call last): Apr 26 17:38:16 2020 (11727) SHUNTING: 1587915493.168592+122b90464edb8dfe2a33eb4e84fd036f0943019c Apr 26 17:38:16 2020 (11727) Failed to unlink/preserve backup file: /var/spool/mailman/virgin/1587915493.168592+bfc8cbc934795ac0c0d663ac31c3ea3df13e9b59.bak Apr 26 17:52:18 2020 (11727) Uncaught runner exception: [Errno 2] No such file or directory: '/var/spool/mailman/virgin/1587916338.266272+f1e11334def7f62140a3442c10bd6b56268d9010.pck' Apr 26 17:52:18 2020 (11727) Traceback (most recent call last): Apr 26 17:52:18 2020 (11727) Skipping and preserving unparseable message: 1587916338.266272+f1e11334def7f62140a3442c10bd6b56268d9010 Apr 26 17:52:19 2020 (11726) Failed to unlink/preserve backup file: /var/spool/mailman/out/1587916338.266272+5c0165dec7b0fdd4e3851688a77b8e31a99b015d.bak Apr 26 17:52:20 2020 (11727) Failed to unlink/preserve backup file: /var/spool/mailman/virgin/1587916338.285911+c4b5275fd082841b395994955b37f5f85569bba9.bak
Apr 26 17:53:13 2020 qrunner(11694): Traceback (most recent call last): Apr 26 17:53:13 2020 qrunner(11694): File "/usr/lib/mailman/bin/qrunner", line 278, in <module> Apr 26 17:53:13 2020 qrunner(11694): main() Apr 26 17:53:13 2020 qrunner(11694): File "/usr/lib/mailman/bin/qrunner", line 238, in main Apr 26 17:53:13 2020 qrunner(11694): qrunner.run() Apr 26 17:53:13 2020 qrunner(11694): File "/usr/lib/mailman/Mailman/Queue/Runner.py", line 87, in run Apr 26 17:53:13 2020 qrunner(11694): self._cleanup() Apr 26 17:53:13 2020 qrunner(11694): File "/usr/lib/mailman/Mailman/Queue/BounceRunner.py", line 263, in _cleanup Apr 26 17:53:13 2020 qrunner(11694): BounceMixin._cleanup(self) Apr 26 17:53:13 2020 qrunner(11694): File "/usr/lib/mailman/Mailman/Queue/BounceRunner.py", line 137, in _cleanup Apr 26 17:53:13 2020 qrunner(11694): self._register_bounces() Apr 26 17:53:13 2020 qrunner(11694): File "/usr/lib/mailman/Mailman/Queue/BounceRunner.py", line 126, in _register_bounces Apr 26 17:53:13 2020 qrunner(11694): mlist.Save() Apr 26 17:53:13 2020 qrunner(11694): File "/usr/lib/mailman/Mailman/MailList.py", line 578, in Save Apr 26 17:53:13 2020 qrunner(11694): self.__save(dict) Apr 26 17:53:13 2020 qrunner(11694): File "/usr/lib/mailman/Mailman/MailList.py", line 555, in __save Apr 26 17:53:13 2020 qrunner(11694): os.link(fname, fname_last) Apr 26 17:53:13 2020 qrunner(11694): OSError : [Errno 1] Operation not permitted
Apr 26 17:53:16 2020 qrunner(11722): Traceback (most recent call last): Apr 26 17:53:16 2020 qrunner(11722): File "/usr/lib/mailman/bin/qrunner", line 278, in <module> Apr 26 17:53:16 2020 qrunner(11722): main() Apr 26 17:53:16 2020 qrunner(11722): File "/usr/lib/mailman/bin/qrunner", line 238, in main Apr 26 17:53:16 2020 qrunner(11722): qrunner.run() Apr 26 17:53:16 2020 qrunner(11722): File "/usr/lib/mailman/Mailman/Queue/Runner.py", line 87, in run Apr 26 17:53:16 2020 qrunner(11722): self._cleanup() Apr 26 17:53:16 2020 qrunner(11722): File "/usr/lib/mailman/Mailman/Queue/BounceRunner.py", line 263, in _cleanup Apr 26 17:53:16 2020 qrunner(11722): BounceMixin._cleanup(self) Apr 26 17:53:16 2020 qrunner(11722): File "/usr/lib/mailman/Mailman/Queue/BounceRunner.py", line 137, in _cleanup Apr 26 17:53:16 2020 qrunner(11722): self._register_bounces() Apr 26 17:53:16 2020 qrunner(11722): File "/usr/lib/mailman/Mailman/Queue/BounceRunner.py", line 126, in _register_bounces Apr 26 17:53:16 2020 qrunner(11722): mlist.Save() Apr 26 17:53:16 2020 qrunner(11722): File "/usr/lib/mailman/Mailman/MailList.py", line 578, in Save Apr 26 17:53:16 2020 qrunner(11722): self.__save(dict) Apr 26 17:53:16 2020 qrunner(11722): File "/usr/lib/mailman/Mailman/MailList.py", line 555, in __save Apr 26 17:53:16 2020 qrunner(11722): os.link(fname, fname_last) Apr 26 17:53:16 2020 qrunner(11722): OSError : [Errno 1] Operation not permitted
/usr/lib/mailman/bin/check_perms -f didn't give me any errors.
I also tried to fall back to Centos' standard mailman package which is 2.1.15 but to no avail.
This took me all day and I'm still where I was in the morning. Any help out there?
Thank you very much!
Lothar Schilling
Mailman-Users mailing list Mailman-Users@python.org https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/tjcora%40icloud.com
— Tom Coradeschi tjcora@icloud.com
— Tom Coradeschi tcora@skylands.ibmwr.org
participants (3)
-
Lothar Schilling -
Mark Sapiro -
Tom Coradeschi