Question about asyncio and blocking operations
Frank Millman
frank at chagford.com
Tue Jan 26 09:15:30 EST 2016
"Frank Millman" wrote in message news:n8038j$575$1 at ger.gmane.org...
>
> I am developing a typical accounting/business application which involves a
> front-end allowing clients to access the system, a back-end connecting to
> a database, and a middle layer that glues it all together.
>
[...]
>
> There was one aspect that I deliberately ignored at that stage. I did not
> change the database access to an asyncio approach, so all reading
> from/writing to the database involved a blocking operation. I am now ready
> to tackle that.
I am making some progress, but I have found a snag - possibly unavoidable,
but worth a mention.
Usually when I retrieve rows from a database I iterate over the cursor -
def get_rows(sql, params):
cur.execute(sql, params)
for row in cur:
yield row
If I create a Future to run get_rows(), I have to 'return' the result so
that the caller can access it by calling future.result().
If I return the cursor, I can iterate over it, but isn't this a blocking
operation? As far as I know, the DB adaptor will only actually retrieve the
row when requested.
If I am right, I should call fetchall() while inside get_rows(), and return
all the rows as a list.
This seems to be swapping one bit of asynchronicity for another.
Does this sound right?
Frank
More information about the Python-list
mailing list