SQL/Python question -- slow... What is the fixed cost?
Leonardo B Lopes
leo at iems.nwu.edu
Wed Oct 3 23:07:09 CEST 2001
Is anyone here using Python with MySQL using the MySQLdb module? I have
been using it for a while in a prototype, and now that I am trying to
optimize it for speed I am running into problems.
I was analyzing my queries, trying to find out if a different
organization of my database might be warranted. I do lots and lots of
queries, most of which are quite simple. The worst query involves an
inner join of 3 tables and then a filtering on two clauses.
I have been using varchar columns as indexes (I know! It was just a
prototype), and as I am considering changing them, I am looking at the
output of the python profiler, and I notice that all the queries take
.001 cpu/sec. per call. Not only the more complex query above, but also
a query which only filters over one small table.
What I am wondering is what the fixed cost for this configuration:
(python + MySQLdb + MySQL). I am about to design a sophisticated caching
system, and before I do that, I was hoping someone with some experience
with this setup would be able to tell me if it is worth my time... Any
help would be appreciated. I can also share code if it helps.
a simple query that filters only one table based on only one parameter.
That brings a question: Does anyone have an idea of what
Leonardo B. Lopes leo at iems.nwu.edu
Ph.D. Student (847)491-8470
IEMS - Northwestern University http://www.iems.nwu.edu/~leo
More information about the Python-list