[Mailman-Users] mailman uses wrong encoding, /etc/mailman/[language] not generated
mark at msapiro.net
Tue Apr 25 12:59:21 EDT 2017
On 04/24/2017 11:11 AM, Johannes Rohr wrote:
> The default language for most mailing lists is German. Since the migration,
> mailman serves all pages and mail notifications in latin-1 instead of
> utf-8, which the header still decleares the content to be UTF-8, which
> leads to broken display, see eg
First see my comments in your bug report at
> I noticed that the subdirectory for the English templates /etc/mailman/en
> exists, but there is no /etc/mailman/de
> On Debian/Ubuntu, /var/lib/mailman/Templates is a symlink to /etc/mailman,
> which by default is owned by root:root. I changed that to root:list and
> restarted mailman, in the hope that /etc/mailman/de would eventually be
> generated, but it wasn't.
The ownership of symlinks is irrelevant. Only the ownership (and mode)
of the target is significant.
In any case, the upstream source of the German Message catalog is
messages/de/LC_MESSAGES/mailman.po and it is latin-1 encoded. The Debian
91_utf8.patch which I mention in the above referenced comment creates a
utf-8 encoded version of that in
messages/de/LC_MESSAGES/mailman.po.utf-8 and compiles that into
messages/de/LC_MESSAGES/mailman.mo. All of that takes place in the
source build directory which is not the installed directory distributed
with the package. The installed directory should end up with a
mailman.po and mailman.mo, both utf-8 encoded.
> What is the mechanism, by which the templates directory for the respective
> language is generated? Could this be a permission issue, and could the
> mismatch between the charset declared in the header of the message or
> website and the actual charset in the content be somehow related to that?
You need to look at the messages/de/LC_MESSAGES/mailman.po file you
have. Near the beginning will be a line like
"Content-Type: text/plain; charset=xxx\n"
where xxx is either ISO-8859-1 or UTF-8. If it is UTF-8 and the 'msgstr'
values are utf-8 encoded, you can rebuild the .mo with
msgfmt -o mailman.mo mailman.po
but I suspect that is not the case. I suspect that somehow in your
migration process you replaced the Debian utf-8 encoded files with older
iso-8859-1 files. In that case you need to convert the .po to utf-8
before compiling with something like
msgconv -t utf-8 mailman.po | msgfmt -o mailman.mo -
or if you want to save the utf-8 encoded .po you could do something like
msgconv -t utf-8 -o mailman.po.utf-8 mailman.po
msgfmt -o mailman.mo mailman.po.utf-8
Note that in either of the above the msgfmt command will produce a few
"fatal" errors of the form
mailman.po:7051: 'msgid' and 'msgstr' entries do not both end with '\n'
but the output should be OK. To avoid this you can use the
var/mailman/bin/msgfmt.py command instead.
Mark Sapiro <mark at msapiro.net> The highway is for gamblers,
San Francisco Bay Area, California better use your sense - B. Dylan
More information about the Mailman-Users