Smart quotes are not properly encoded in mbox
Hi guys,
Is there a way to display/keep smart quotes (for example ‘Apple’ and “Banana”) properly in mailing list’s mbox? It seems that the smart quotes at the example above are saved with uni-hex code.
=E2=80=98Apple=E2=80=99 =E2=80=9CBanana=E2=80=9D
The received email from the mailing list do not have this kind of issue though.
The smart quotes feature can be disabled with the following instruction on Mac but I do not think that it is a good idea to have all the Mac subscribers disable smart quotes only for mailman. http://www.iclarified.com/38772/how-to-disable-curly-quotes-in-mac-os-x-mave...
Regards,
--
- DongInn
On 12/11/2016 07:03 AM, Kim, DongInn wrote:
Is there a way to display/keep smart quotes (for example ‘Apple’ and “Banana”) properly in mailing list’s mbox? It seems that the smart quotes at the example above are saved with uni-hex code.
=E2=80=98Apple=E2=80=99 =E2=80=9CBanana=E2=80=9D
No.
Internet email standards require that for reliable transmission the content of messages must consist of only 7-bit ascii characters. Thus, headers, message body parts, etc. containing non-ascii characters must be encoded for transmission. The encoding is either quoted-printable or base64.
What you are seeing is a quoted-printable encoding of the UTF-8 encoding of these characters. This is either in a body part whose Content-Transfer-Encoding: is quoted-printable or an RFC2047 quoted-printable encoded word in a header.
The received email from the mailing list do not have this kind of issue though.
Because the MUA viewing the mail knows how to decode it for display. If you look at the raw message text, it will be the same.
The list's archives/private/listname.mbox/listname.mbox file contains the raw messages as sent.
Why do you care? If you are using tools like grep to search the cumulative mbox or the periodic .txt files in the archive, there are more serious issues because many things will be base64 encoded which is not human readable at all.
For more information, see RFC's 5321, 5322, 2045 and 2047 at <https://www.rfc-editor.org/>.
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
On 12/11/2016 08:50 AM, Mark Sapiro wrote:
On 12/11/2016 07:03 AM, Kim, DongInn wrote:
Is there a way to display/keep smart quotes (for example ‘Apple’ and “Banana”) properly in mailing list’s mbox? It seems that the smart quotes at the example above are saved with uni-hex code.
=E2=80=98Apple=E2=80=99 =E2=80=9CBanana=E2=80=9D
No.
Actually, I was focusing on the "keep" aspect. You can display them "properly" by just viewing the mbox with a mail reader (mutt for example) that understands the encoding.
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
Hi Mark,
Thank you very much for detailed answers.
Yes, I just checked the raw source of that message and it has the same encoded part. Thank you.
The problem is that our mail archiver (hypermail) does not know how to deal with the encoded part. Do you have any good ideas to display the encoded part to html format?
Regards,
--
- DongInn
On Dec 11, 2016, at 11:55 AM, Mark Sapiro <mark@msapiro.net> wrote:
On 12/11/2016 08:50 AM, Mark Sapiro wrote:
On 12/11/2016 07:03 AM, Kim, DongInn wrote:
Is there a way to display/keep smart quotes (for example ‘Apple’ and “Banana”) properly in mailing list’s mbox? It seems that the smart quotes at the example above are saved with uni-hex code.
=E2=80=98Apple=E2=80=99 =E2=80=9CBanana=E2=80=9D
No.
Actually, I was focusing on the "keep" aspect. You can display them "properly" by just viewing the mbox with a mail reader (mutt for example) that understands the encoding.
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
Mailman-Users mailing list Mailman-Users@python.org https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/dikim%40indiana.edu
On 12/11/2016 09:16 AM, Kim, DongInn wrote:
The problem is that our mail archiver (hypermail) does not know how to deal with the encoded part. Do you have any good ideas to display the encoded part to html format?
This is a hypermail issue. You might find some help at <http://www.hypermail-project.org/>, but it doesn't look too promising.
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
participants (2)
-
Kim, DongInn -
Mark Sapiro