[Chicago] AppEngine Bulk Loading

[Feihong Hsu]

Yeah, it's their server-side code that needs to be patched. I wrote
my own custom bulk load WSGI app because I absolutely must have
Unicode strings for my app. I'll let you guys know how it goes after
I finish doing the bulk load tonight.

The dev server's datastore absolutely blows. I got up to 1780
entities and it just slowed to a crawl, even though I was uploading
less than 1 KB per request.


--- Carl Karsten <carl at personnelware.com> wrote:

> Ian Bicking wrote:
> > Feihong Hsu wrote:
> >> Argh. I can't use "line.encode('ascii', 'replace')" because many
> of
> >> the strings in my app are ALL Unicode, and there would be no
> >> distinction between them anymore.
> > 
> > There's several ASCII-safe encodings, like unicode_escape (which
> uses 
> > Python string-literal escapes).  They are listed in the codecs
> module. 
> > Of course, you might not want to store them in the datastore that
> way 
> > either.
> > 
> 
> Is the datastore on the other side of the IO barrier that requires
> Unicode data 
> to be encoded?
> 
> Carl K
> _______________________________________________
> Chicago mailing list
> Chicago at python.org
> http://mail.python.org/mailman/listinfo/chicago
>