Mailman 3 November 2006 - Twisted

[Twisted-Python] blockingCallFromThread, ticket 1042
by Markus Schiltknecht Nov. 29, 2006

Nov. 29, 2006

Hi, A long time ago, I've been asking about a blocking callFromThread function and have been pointed to ticket 1042 at [1]. What's the state on that? Does that have a change of being integrated into twisted? Regards Markus [1]: http://twistedmatrix.com/trac/ticket/1042

1 0

Re: [Twisted-Python] trac's reliability
by glyph＠divmod.com Nov. 29, 2006

Nov. 29, 2006

On 05:53 am, foom(a)fuhm.net wrote: >Current trac status: >more or less working. On behalf of everyone using Twisted's trac, thanks a lot for putting some work into this. :)

1 0

Re: [Twisted-Python] trac's reliability
by exarkun＠divmod.com Nov. 29, 2006

Nov. 29, 2006

On 12:31 am, jml(a)mumak.net wrote: >Hello, > >The reliability of our trac instance is ludicrous. It is becoming >extremely difficult to do any work on Twisted, particularly during the >hours when America is asleep. > >I'm very grateful for Jp's tireless efforts in making trac work as >much as it has. I have some idea of how busy he is, and can imagine >how frustrating the task must be. However, we can't continue running >our issue tracker like this. > >… [View More]First question is, what is causing the outages? People on #twisted >have commented that they haven't seen similar behaviour on their own >tracs. The outages are so frequent that this is becoming an FAQ. There are several problems: Segfaults in the svn bindings - in correspondence with the trac team, I have been told (almost in so many words) that bdb-backed svn repositories are unsupported and we should switch to fsfs. Segfaults in the SQLite bindings - likewise, in correspondence with the trac team, I have more or less been told that SQLite is not a supported database engine and that we should switch to PostgreSQL. Deadlocks in... who knows where. > >The second question is, how can I help trac to work better? Would it >help to throw more hardware at the problem? Should we switch to >another tracker? (blech) Are there open tickets on trac itself that I >could submit patches for? It might be possible to resolve the above mentioned problems. If we convert the repository to fsfs, we might find the segfaults from the svn bindings disappear (of course, we might not - I think we can all recognize the quality of this sort of bug stomping). In addition to the actual task of converting, involved in this would be some level of investigation into the level of stability of the fsfs backend available in the version of debian used on wolfwood, an effort to package or have packaged a newer version, or an upgrade of wolfwood (however, since even edgy lacks svn 1.4, this probably isn't a useful endeavour). This may also involve recompiling several packages on pyramid to add fsfs support or remove bdb support. If we convert the trac database to use PostgreSQL, the SQLite segfaults will hopefully go away. ;) This involves setting up a PostgreSQL server which we can use for trac (one is running on pyramid now, for the benefit of buildbot, beyond that, what state it is in is not clear to me). There is a tool available from edgewall which is supposed to be capable of moving data from a SQLite database to a PostgreSQL database. The various scripts and utilities which we have (eg, the weekly bug summary) may also need to be adjusted (I forget to what extent they are tied to SQLite). Then, as an ongoing task, someone will need to maintain the PostgreSQL server. As for the random deadlocks which occur... I see no realistic course of action which is likely to resolve these. Perhaps, if the above changes are enacted, we will be lucky they will just go away by themselves. That seems to be the attitude of the trac developers, anyway. > >Finally, assuming Twisted's trac isn't going to get much better any >time soon, I would greatly appreciate being given the permissions and >training to restore trac. I think it would also be a good idea to >share the responsibility with someone in a European timezone. Before I left last week I set up a cron job to take care of this. When I returned it was still doing its job, so the level of availability seen over the past week or so may be the highest we can expect until we do something else fundamental to fix the issue. However, the SSH key you gave me long ago is still in place and you should still have access to restart the server (just connecting should do it). Personally, I am in favor of switching away from trac, as I have been since shortly before we adopted it. ;) The only open question is when the replacement will be ready. Jean-Paul [View Less]

9 11

[Twisted-Python] Why I have not gotten any mail in this list?
by Steve Han Nov. 29, 2006

Nov. 29, 2006

Anyone help me?

1 0

[Twisted-Python] Perspective Broker
by le dahut Nov. 28, 2006

Nov. 28, 2006

Hello, Using PB, I've setup a system where clients can control other clients in this way : client1 executes "remote_do_something" on server1 with "ip_client2" as argument. Then server1 connects to client2 and executes "remote_smthng" on it. code is like this : - client1: """ factory = pb.PBClientFactory() reactor.connectTCP(ip_server1, port, factory) d = factory.getRootObject() d.addCallback(lambda object: object.callRemote("do_something", ip_client2)) d.addCallback(client1_call_b) d.… [View More]

2 2

Re: [Twisted-Python] SQLAlchemy integration
by Ed Suominen Nov. 27, 2006

Nov. 27, 2006

>>> I'm writing some modules for integrating SQLALchemy with Twisted. >>> The idea is to write a custom Pool, EngineStrategy and Engine for Twisted. >>> I would like to know if there are some other people working on this >>> (excluding sAsync) >> Is there really a good reason for having *two* different efforts to >> integrate Twisted with a single other library? Surely it must be >> possible to collaborate somehow. I agree with Glyph. I've … [View More]

3 2

Re: [Twisted-Python] Need Exception that will stop ther reactor within twistd
by glyph＠divmod.com Nov. 27, 2006

Nov. 27, 2006

On 12:55 am, ncesar(a)lunix.com.ar wrote: >> This is bad form, however. Particular types of exception should not stop >> the reactor. Code that wants the reactor to stop, should call >> reactor.stop. Maybe you could make a method that both calls reactor.stop() >> *and* raises an exception. > >This is the way i'm doing it right now, but i'm starting to detect new >exceptions raised within standard library (among others) code... and instead >of catching all … [View More]

2 1

Re: [Twisted-Python] SQLAlchemy integration
by Maciej Szumocki Nov. 27, 2006

Nov. 27, 2006

> Date: Thu, 23 Nov 2006 07:39:58 -0000 > From: glyph(a)divmod.com > Subject: Re: [Twisted-Python] SQLAlchemy integration > To: Twisted general discussion <twisted-python(a)twistedmatrix.com> > Message-ID:> <20061123073958.22613.1053884361.divmod.xquotient.5(a)joule.divmod.com> > Content-Type: text/plain; charset="utf-8" > > On 22 Nov, 11:19 am, manlio_perillo(a)libero.it wrote: > > >I'm writing some modules for integrating SQLALchemy with … [View More]

1 0

Re: [Twisted-Python] Using Conch as a ssh server on MS Windows
by glyph＠divmod.com Nov. 27, 2006

Nov. 27, 2006

On 09:27 am, rasjidw(a)gmail.com wrote: >I'll probably stick with stdin/stdout, at least initially, as I have >done something along these lines before, just not within the twisted >framework. Previously I used threading and emulated a non-blocking >process through buffering the data read. I've been looking into >non-blocking pipe reading in win32, and it looks like there are a >coule of choices. Possibly the easiest I've seen so far uses some >calls from wxWidgets which … [View More]

2 1

[Twisted-Python] trac's reliability
by Jonathan Lange Nov. 27, 2006

Nov. 27, 2006

Hello, The reliability of our trac instance is ludicrous. It is becoming extremely difficult to do any work on Twisted, particularly during the hours when America is asleep. I'm very grateful for Jp's tireless efforts in making trac work as much as it has. I have some idea of how busy he is, and can imagine how frustrating the task must be. However, we can't continue running our issue tracker like this. First question is, what is causing the outages? People on #twisted have commented that … [View More]

1 0