I want to release zopache.com as a web development platform, but I worry that someone will overload the servers.
So I have to track bandwidth for each user account.
Traditionally this is done by creating log files and processing them, but that seems exceedingly complex. Much easier to just have a python object for each user account, and track the amount of bandwidth used in the last day, week and month. Even for 50K users that cannot require that much RAM. Even if the web server goes down, and I loose the data, I do not care. I just need to be emailed when limits are exceeded.
Is this a good idea, or should I be using log files?
For years i have been watching Twisted, but never really required it. Maybe this is a good excuse to start using Twisted. Currently I am using NGinx.
Is there a library you would recommend to help me with this. An hour spent searching the web did not turn up anything. It can't be that hard to do.
What do you think?
Regards Chris
I am very pleased to announce the release of The Directory of Twisted Developers at:
Post your resume, answer a few questions, then link to your resume (web site), or blog. You can also link to your github, stack overflow, twitter, email, and facebook accounts. The other bigger job boards generally do not allow external links. You also get to control who has access to your information. Unlike the dominant web business model, I do not sell your information.
Why my interest in Twisted? Well, I have been following it for many years. I finally have an application for it. I want to crawl the web, and Scrapy uses Twisted. Of course interfacing it to the ZODB looks a ittle tricky. I did find zc.twist, very nicely documented, but at first glance looks way too complicated.
Feedback on PrivaCV.com/twisted is most appreciated. Tweets are also appreciated.
-
Christopher Lozinski