[omaha] Dev Help
Wes Turner
wes.turner at gmail.com
Tue Jan 21 05:26:56 CET 2014
These links may be of help to you in your endeavor:
http://www.reddit.com/r/Python/comments/1qnbq3/webscraping_selenium_vs_conventional_tools/cdeq2t7
https://developers.google.com/appengine/docs/python/urlfetch/
https://developers.google.com/appengine/docs/python/taskqueue/
http://docs.celeryproject.org/en/latest/index.html
Multiprocess is probably what you're after. Celery and appengine task queue
have rate-limiting support. The praw reddit api shows how to work with
multiprocess and respectable levels of concurrent requests:
https://praw.readthedocs.org/en/latest/pages/multiprocess.html
Wes Turner
Greeting
s All.
My name
is Andy and I'm a new developer to Omaha
and the Python community. I'm also new to this list-serve so apologies if
this is a completely inappropriate question for the thread.
I'm
reaching out to see if anyone would be interested in collaborating on a
startup
idea. It's dealing with (in my opinion)
some pretty interesting stuff that I am (in everyone's opinion) very novice
with:
* Multi-threaded web-scraping (with Urllib)
* Natural Language processing (using NLTK)
* Pattern Recognition / Clustering Algorithms (using numpy and
matplotlib)
* Google App Engine back end using Web2Py framework (or maybe
Django if I continue to struggle)
At this point, I'm prototyping and looking for concept / development
help...it is very hard to find. If
anyone has a good chunk of extra time and a desire to collaborate, I
would love to sit down and talk.
Thanks
Andy
ajkrell at yahoo.com
_______________________________________________
Omaha Python Users Group mailing list
Omaha at python.org
https://mail.python.org/mailman/listinfo/omaha
http://www.OmahaPython.org
More information about the Omaha
mailing list