On Thu, Jan 20, 2011 at 4:45 PM, <exarkun@twistedmatrix.com> wrote:
On 10:05 pm, kevin.horn@gmail.com wrote:
>On Thu, Jan 20, 2011 at 1:55 AM, Glyph Lefkowitz
><glyph@twistedmatrix.com>wrote:
>>
>>(I was going to point you at the output of the buildbot, but it looks
>>like
>>something in trunk has broken the conversion process.  Anyone know
>>what this
>>is about? <
>>http://buildbot.twistedmatrix.com/builds/sphinx-
>>html-15724/contents.html>)
>I was going to address this as well.  I've been seeing what are
>apparently
>intermittent problems with the buildbot, though I haven't seen that one
>before, since the beginning of the year when I started seriously
>looking at
>this stuff again.
>
>I was able to build the docs properly on the buildbot yesterday, and in
>fact
>couldn't replicate any of the issues I had previously seen (which, in
>my
>case, seem to mostly have to do with missing CSS files). when I was
>talking
>to exarkun about it on IRC yesterday.
>
>I'm not sure whether it has to do with the buildbot configuration,
>maybe
>stuff timing out, network issues, problems in the actual conversion
>process,
>or what.

Does this help?

http://buildbot.twistedmatrix.com/builders/sphinx-
documentation/builds/123/steps/shell_4/logs/stdio

The salient point perhaps being:

 File
"/System/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/urllib.py",
line 347, in open_http
   'got a bad status line', None)
IOError: ('http protocol error', 0, 'got a bad status line', None)

Jean-Paul


Hmmm...yes, I think it does.  It looks like the l2s_builder script is choking on fetching the DTD for some reason.  lore2sphinx itself is supposed to cache the DTD between runs, but I'm betting it doesn't work in the buildbot due to the (hopefully) clean environment it has every time it runs.

I can change it to not care about that, but if I do, then it won't be able to resolve HTML entities (of which there are a few in the Lore sources, mostly em-dashes IIRC).  So the XML parsing will choke on those, unless I tell it to ignore them, in which case it might ignore other errors...etc.

I'll see what I can do to fix it, I haven't worked on that bit for a long time.  I'll see if possible to add a "pre-cached" DTD file to teh lore2sphinx repo, and that should fix that problem at least.

Thanks for the research!

(I sometimes forget that buildbot keeps a log of the stdio.  You wouldn't think that I would, since I use the analogous logs in hudson fairly frequently, but I do. Sigh.)

Kevin Horn