[issue31589] Links for French documentation pdf is broken
New submission from fabrice: Hi, In this page : https://docs.python.org/fr/2/download.html, all the documentation links aren't available, for example : - https://docs.python.org/fr/2/archives/python-2.7.14-docs-pdf-a4.zip - https://docs.python.org/fr/2/archives/python-2.7.14-docs-pdf-a4.tar.bz2 So, I can't read the documentation in French :) Regards, Fabrice ---------- assignee: docs@python components: Documentation messages: 303024 nosy: docs@python, fabrice priority: normal severity: normal status: open title: Links for French documentation pdf is broken versions: Python 2.7 _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Changes by STINNER Victor <victor.stinner@gmail.com>: ---------- nosy: +mdk _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Julien Palard added the comment: Hi Fabrice, Thanks for reporting. The whole archives/ directory is completly missing for french and japanese, I'll take a look. Bug is probably really near https://github.com/python/docsbuild-scripts/blob/master/build_docs.py#L222 ---------- _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Julien Palard <julien+python@palard.fr> added the comment: Problem happen during pdflatex, I tried a local build and got: ! Package hyperref Error: Wrong DVI mode driver option `dvipdfmx', (hyperref) because pdfTeX or LuaTeX is running in PDF mode. See the hyperref package documentation for explanation. Type H <return> for immediate help. ... l.4362 \ProcessKeyvalOptions{Hyp} ? ! Emergency stop. ---------- _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Change by Julien Palard <julien+python@palard.fr>: ---------- nosy: +linkid _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Ezio Melotti <ezio.melotti@gmail.com> added the comment: FWIW most of the errors I met while trying to build the pdfs of the main docs were caused by the presence of non-latin1 characters. French should be limited to the latin1 range and the error you pasted doesn't seem to be related, however that might explain while the Japanese docs are also missing (unless this issue got fixed in the meanwhile -- I haven't built the pdfs in a while). ---------- nosy: +ezio.melotti type: -> behavior _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Julien Palard <julien+python@palard.fr> added the comment: After an upgrade of my venv, the error is now: Latexmk: applying rule 'pdflatex'... Rule 'pdflatex': File changes, etc: Changed files, or newly in use since previous run(s): 'faq.aux' 'faq.out' 'faq.toc' Latexmk: Maximum runs of pdflatex reached without getting stable files Latexmk: All targets (faq.pdf) are up-to-date Latexmk: Did not finish processing file 'faq.tex': 'pdflatex' needed too many passes ---------- _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Julien Palard <julien+python@palard.fr> added the comment: One difference I see in the logs of sucessfully building the faq.tex and failing to build it is: Package hyperref Warning: Token not allowed in a PDF string (Unicode): Looks like if I remove all non-ascii characters from titles, it builds again. ---------- _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Julien Palard <julien+python@palard.fr> added the comment: Problem looks like the utf8x package is not friend with tableofcontent: - https://tex.stackexchange.com/questions/240801/utf8x-character-fails-in-the-... - https://tex.stackexchange.com/questions/164458/pleaseinsertintopreamble-in-t... ---------- nosy: +benjamin.peterson _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Julien Palard <julien+python@palard.fr> added the comment: For the record, I can reproduce the issue with this minimal test file: mdk@windhowl$ ls -lah total 108K drwxr-xr-x 2 mdk mdk 4.0K Oct 2 21:15 . drwxrwxrwt 18 root root 96K Oct 2 21:15 .. -rw-r--r-- 1 mdk mdk 196 Oct 2 21:13 faq.tex mdk@windhowl$ cat faq.tex \documentclass[a4,10pt,french]{report} \usepackage[utf8x]{inputenc} \usepackage[T1,T2A]{fontenc} \usepackage{babel} \begin{document} \tableofcontents \chapter{FAQ sur Python éh} \end{document} mdk@windhowl$ latexmk faq 2>&1 | tail -n 15 (/usr/share/texlive/texmf-dist/tex/latex/ucs/data/uni-0.def) [2] (./faq.aux) ) Output written on faq.dvi (2 pages, 608 bytes). Transcript written on faq.log. Latexmk: Log file says output to 'faq.dvi' Rule 'latex': File changes, etc: Changed files, or newly in use since previous run(s): 'faq.aux' 'faq.toc' Latexmk: Maximum runs of latex reached without getting stable files Latexmk: Did not finish processing file 'faq': 'latex' needed too many passes Latexmk: Use the -f option to force complete processing, unless error was exceeding maximum runs of latex/pdflatex. Latexmk: applying rule 'latex'... Latexmk: All targets (faq.dvi) are up-to-date Also, according to matrixise, it works with xelatex. ---------- _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
STINNER Victor <victor.stinner@gmail.com> added the comment: Julien: Is there any reason why you want to use utf8x in specific? https://tex.stackexchange.com/questions/13067/utf8x-vs-utf8-inputenc """ utf8x vs. utf8 (inputenc) (...) The simple answer is that utf8x is to be avoided if possible. It loads the ucs package, which for a long time was unmaintained (although there is now a new maintainer) and breaks various other things. """ ---------- nosy: +haypo _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Change by STINNER Victor <victor.stinner@gmail.com>: ---------- title: Links for French documentation pdf is broken -> Links for French documentation PDF is broken: LaTeX issue with non-ASCII characters? _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Julien Palard <julien+python@palard.fr> added the comment: I personally do not care about using utf8x, it has been introduced in: r74549 | benjamin.peterson | 2009-08-24 12:42:36 -0500 (Mon, 24 Aug 2009) | 1 line fix pdf building by teaching latex the right encoding package # Get LaTeX to handle Unicode correctly latex_elements = {'inputenc': r'\usepackage[utf8x]{inputenc}'} I tried with utf8 instead and it yielded a different set of errors, so I did not tried much. But utf8-induced bugs may be easier to fix that utf8x-induced bugs, I don't know. ---------- _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
STINNER Victor <victor.stinner@gmail.com> added the comment: (Oh sorry, I misunderstand what you wrote. I understood that Python didn't use utf8x yet and you proposed to start using it.) ---------- _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Julien Palard <julien+python@palard.fr> added the comment: Today I tried without utf8x and an up-to-date version of texlive, errors looked less mystical, so I was able to open a readable / easy to reproduce issue: https://github.com/sphinx-doc/sphinx/issues/4136 I then followed the idea of trying xetex and I was able to build english and french PDF (still not had time to try japanese). ---------- _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Change by Roundup Robot <devnull@psf.upfronthosting.co.za>: ---------- keywords: +patch pull_requests: +3913 stage: -> patch review _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Julien Palard <julien+python@palard.fr> added the comment: Finally have a combination of latex engines that work for every cases, did a PR on docsbuild-scripts: https://github.com/python/docsbuild-scripts/pull/34/ I already pulled xelatex on docs.iad1.psf.io via https://github.com/python/psf-salt/commit/989a7715c4a452b5af13baf9a33535bab0... Also opened a few related issue sphinx-doc side to track my thoughts: - https://github.com/sphinx-doc/sphinx/issues/4150 (Ask if there is a better way to set the latex engine than giving it from docsbuild-scripts) - https://github.com/sphinx-doc/sphinx/issues/4159 (Choose unicode-enabled default latex engines) - https://github.com/sphinx-doc/sphinx/issues/4149 (Be more explicit on documentation about how to choose a latex engine) ---------- _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Change by jfbu <jfbu@free.fr>: ---------- pull_requests: +4040 _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
jfbu <jfbu@free.fr> added the comment: I have made a PR at https://github.com/python/cpython/pull/4069 which enhances `conf.py` with some pdflatex extra Unicode configuration. I tested it with building PDF English documentation at master (at https://github.com/python/cpython/tree/db60a5bfa5d5f7a6f1538cc1fe76f0fda57b5...) and at 3.6 branch (at https://github.com/python/cpython/tree/1e78ed6825701029aa45a68f9e62dd3bb8d4e...) and also French documentation at 3.6 (at https://github.com/python/python-docs-fr/commit/76b522b79c3caa26658920c714ac...). The changes are only for ``pdflatex`` builds: if `latex_engine` is set to `xelatex`, `lualatex`, or `platex` (automatic if language is `ja`), nothing is modified. ---------- nosy: +jfbu _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Ned Deily <nad@python.org> added the comment: New changeset 7324b5ce8e7c031a0a3832a6a8d7c639111ae0ff by Ned Deily (Julien Palard) in branch 'master': bpo-31589 : Build PDF using xelatex for better UTF8 support. (#3940) https://github.com/python/cpython/commit/7324b5ce8e7c031a0a3832a6a8d7c639111... ---------- nosy: +ned.deily _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Change by Roundup Robot <devnull@psf.upfronthosting.co.za>: ---------- pull_requests: +4595 _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Ned Deily <nad@python.org> added the comment: New changeset 2ad350a713360e89ae6d264924cd28f519b8b22c by Ned Deily (Miss Islington (bot)) in branch '3.6': [3.6] bpo-31589 : Build PDF using xelatex for better UTF8 support. (GH-3940) (#4683) https://github.com/python/cpython/commit/2ad350a713360e89ae6d264924cd28f519b... ---------- _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Julien Palard <julien+python@palard.fr> added the comment: Due to issue 32200, we switched on xelatex, it however did **not** fixed the french builds as expected, maybe because we're using an old version of xelatex. The issue: ! Improper discretionary list. <recently read> } l.359 ...{PyObject} \PYG{o}{*}\PYG{n}{t}\PYG{p}{;} ? ! Emergency stop. The version of texlive-xetex on the build server: 2013.20140215-1ubuntu0.1 The version I tried: 2017.20171128-1 I'm not having the 2013 version on Debian. I'm trying now with 2014.20141024-2+deb8u1, and I'm trying to understand the error message too. ---------- _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
jfbu <jfbu@free.fr> added the comment: I can confirm the "Improper discretionary list" error from xetex build is a xetex bug which is present at XeTeX 0.99992 and absent at XeTeX 0.99996 and presumably all more recent releases. It was seen at https://github.com/sphinx-doc/sphinx/issues/3546 and reported to XeTeX mailing list at http://tug.org/pipermail/xetex/2017-March/027056.html ---------- _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Julien Palard <julien+python@palard.fr> added the comment: XeTeX 0.99996 was released in march 2016, so it's not even in Ubuntu 16.04 Xenial Xerus. On docs.iad1.psf.io we're having Ubuntu 14.04 (an LTS ending around february 2019). ---------- _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
jfbu <jfbu@free.fr> added the comment: On-going discussion at http://tug.org/pipermail/xetex/2017-December/027212.html has brought new element that polyglossia's French module is broken with xetex since TeXLive2016. We had only one problem, we now have two on our hands. Possibly Sphinx could be default use babel + French, not polyglossia + French, as the former is maintained but apparently less so the latter. I tested that TeXLive 2015 (fully updated) and test document showing the https://github.com/sphinx-doc/sphinx/issues/3546 problem now compiles fine if using latex_elements = { 'babel': r'\usepackage{babel}', } in conf.py file, to override polyglossia which is default for Sphinx with xelatex. ---------- _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Julien Palard <julien+python@palard.fr> added the comment: For me, french compile correctly with current state of cpython's conf.py and texlive-xetex 2017.20171128-1, if it helps. I tried (not enough) and fail to test locally with a texlive-xetex from 2013 (I should try with a VM maybe, Debian won't let me install packages from 2013 on my sid...). ---------- _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
jfbu <jfbu@free.fr> added the comment: Related https://github.com/sphinx-doc/sphinx/issues/4272 It is stated there that using babel-french in place of polyglossia-french avoids the "Improper discretionary list" xetex problem starting with xetex 0.99992 (i.e. TeXLive 2015) whereas with polyglossia-french the earliest xetex version I could test with success is 0.99996 (TL2016). But starting with TL2016, polyglossia-french as the issue https://github.com/sphinx-doc/sphinx/issues/4272 With TeXLive 2014, using babel-french does not avoid the "Improper discretionary list" xetex problem. I don't know how this maps to Debian packaging. One needs xetex 0.99992 at minimum. ---------- _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Julien Palard <julien+python@palard.fr> added the comment: The download links are now working, EWDurbin upgraded the servers and it solved a few issues, also now when a build fail we do no longer erase the old PDF, so the links should always work. Thanks for reporting and don't hesistate to open a new issue if problem happen again (but maybe on the https://github.com/python/docsbuild-scripts/ issue tracker). ---------- resolution: -> fixed stage: patch review -> resolved status: open -> closed _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
STINNER Victor <vstinner@redhat.com> added the comment: Thanks Julien for taking care of the documentation :-) It is good to have you aboard. ---------- _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
Change by miss-islington <mariatta.wijaya+miss-islington@gmail.com>: ---------- pull_requests: +16220 pull_request: https://github.com/python/cpython/pull/16636 _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
miss-islington <mariatta.wijaya+miss-islington@gmail.com> added the comment: New changeset d9b321692b6770c0fe7cb7ba05f9bd5c6082a880 by Miss Islington (bot) in branch '2.7': bpo-31589 : Build PDF using xelatex for better UTF8 support. (GH-3940) https://github.com/python/cpython/commit/d9b321692b6770c0fe7cb7ba05f9bd5c608... ---------- nosy: +miss-islington _______________________________________ Python tracker <report@bugs.python.org> <https://bugs.python.org/issue31589> _______________________________________
participants (8)
-
Ezio Melotti -
fabrice
-
jfbu
-
Julien Palard
-
miss-islington
-
Ned Deily
-
Roundup Robot
-
STINNER Victor