Perspective Broker: Max connections?

Greetings *,
I have been using perspective broker for a while, and now I am encountering a scalability issue.
I have set up a single pb server; I intend to create a big workload of client connections to this server. My server so far is possible to accept up to ~55 connections. If I try to push more connections in (e.g. 100), I get the following failure:
Unhandled error in Deferred: Traceback (most recent call last): Failure: twisted.internet.error.ConnectBindError: Couldn't bind: 24: Too many open files.
When one of these 55 clients logs out of my server, another one of the rest connects. It seems like there is some connection queue and the rest are waiting there until some of the first 55 clients exits... Is this possible? What could cause this error?
Thank you all for your attention!

Hello Ilias,
Maybe you are hitting your OS's file descriptor limit ? On Debian it is set quite low by default. Here's a bash script excerpt that increases it :
grep "fs.file-max =" /etc/sysctl.conf > /dev/null 2>&1 [ "$?" == 0 ] && sed -i "/fs.file-max =.*/d" /etc/sysctl.conf echo "fs.file-max = 65535" >> /etc/sysctl.conf
grep "soft nofile " /etc/security/limits.conf > /dev/null 2>&1 [ "$?" == 0 ] && sed -i "/soft nofile .*/d" /etc/security/limits.conf echo "soft nofile 65535" >> /etc/security/limits.conf
grep "hard nofile " /etc/security/limits.conf > /dev/null 2>&1 [ "$?" == 0 ] && sed -i "/hard nofile .*/d" /etc/security/limits.conf echo "hard nofile 65535" >> /etc/security/limits.conf
Proceed at your own risk :)
Matthieu
On 09/06/2011 17:02, Ilias Rinis wrote:
Greetings *,
I have been using perspective broker for a while, and now I am encountering a scalability issue.
I have set up a single pb server; I intend to create a big workload of client connections to this server. My server so far is possible to accept up to ~55 connections. If I try to push more connections in (e.g. 100), I get the following failure:
Unhandled error in Deferred: Traceback (most recent call last): Failure: twisted.internet.error.ConnectBindError: Couldn't bind: 24: Too many open files.
When one of these 55 clients logs out of my server, another one of the rest connects. It seems like there is some connection queue and the rest are waiting there until some of the first 55 clients exits... Is this possible? What could cause this error?
Thank you all for your attention!
Twisted-web mailing list Twisted-web@twistedmatrix.com http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-web
participants (2)
-
Ilias Rinis
-
Matthieu Huin