Good day! I've partialy migrated my site from php to twisted-web and now under high load a memory size occupied by server raises from 12Mb to 130Mb during 1 day. I need help !!!! Andrey Chichak.
On Tue, Feb 22, 2005 at 10:14:56AM +0600, Andrey Chichak wrote:
Good day!
I've partialy migrated my site from php to twisted-web and now under high load a memory size occupied by server raises from 12Mb to 130Mb during 1 day.
I need help !!!!
What version of Twisted? What sort of application are you running in twisted-web? How many hits/day? There was a small leak in the 1.3.0 release... it was fixed in r10970 in SVN. As a workaround, you can delete twisted/protocols/_c_urlarg.so. But this is purely guesswork, please give us more details! -Andrew.
Andrew Bennetts wrote:
On Tue, Feb 22, 2005 at 10:14:56AM +0600, Andrey Chichak wrote:
Good day!
I've partialy migrated my site from php to twisted-web and now under high load a memory size occupied by server raises from 12Mb to 130Mb during 1 day.
I need help !!!!
What version of Twisted?
1.3.0
What sort of application are you running in twisted-web?
webchat
How many hits/day?
~650000 hits per 24 hours
There was a small leak in the 1.3.0 release... it was fixed in r10970 in SVN. As a workaround, you can delete twisted/protocols/_c_urlarg.so. But
I'll check this.
this is purely guesswork, please give us more details!
len(gc.get_objects()) is ~ 30000, and don't change in time.
-Andrew.
/usr/local/lib/python2.3/site-packages/twisted/web/twcgi.py:81: exceptions.DeprecationWarning: IPv4Address.__getitem__ is deprecated. Use attributes instead.
_______________________________________________ Twisted-web mailing list Twisted-web@twistedmatrix.com http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-web
Andrey Chichak
On Tue, Feb 22, 2005 at 11:19:03AM +0600, Andrey Chichak wrote:
Andrew Bennetts wrote: [...]
What version of Twisted?
1.3.0
[...]
How many hits/day?
~650000 hits per 24 hours
There was a small leak in the 1.3.0 release... it was fixed in r10970 in SVN. As a workaround, you can delete twisted/protocols/_c_urlarg.so. But
I'll check this.
Ok, this sounds like this leak is at least a large part of that. Assuming the average URL length is 40 bytes, that version would leak 26MB in 24 hours, according to the stats you give. If requested URLs are much longer (e.g. due to forms using request method GET), it may well account for all of it.
this is purely guesswork, please give us more details!
len(gc.get_objects()) is ~ 30000, and don't change in time.
This strongly suggests the leak is in a C module somewhere, which is consistent with the _c_urlarg bug. -Andrew.
Andrew Bennetts wrote:
How many hits/day?
~650000 hits per 24 hours
There was a small leak in the 1.3.0 release... it was fixed in r10970 in SVN. As a workaround, you can delete twisted/protocols/_c_urlarg.so. But
I'll check this.
3 hours of running without twisted/protocols/_c_urlarg.so - memory Ok.
_______________________________________________ Twisted-web mailing list Twisted-web@twistedmatrix.com http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-web
participants (2)
-
Andrew Bennetts -
Andrey Chichak