Curl and python httplib?

Chris Rebert clp2 at
Fri Mar 29 05:58:19 CET 2013

On Wed, Mar 27, 2013 at 7:54 PM, 小学园PHP <xxy-php at> wrote:
> Guys,
> I take a project that need send request to Hadoop by curl.
> But now, the curl and pycurl can't satisfy my project. So i need use the
> powerful httplib.

I would say that `requests`
( ) is generally preferable
to httplib these days.

> But failed.
> my curl request:
> curl -i -X PUT "http://localhost:50070/webhdfs/v1/levi/7?op=CREATE"
> my return:
> Content-Type: application/octet-stream
> Location:
> Content-Length: 0
> Server: Jetty(6.1.26)
> Now, i change the curl request to httplib:
> import httplib
> import urllib
> params=urllib.urlencode({"@op":"CREATE","":"levi"})
> headers={"Content-type": "application/x-www-form-urlencoded","Accept":
> "text/plain"}
> conn=httplib.HTTPConnection("localhost:50070")
> conn.request("PUT","/webhdfs/v1/levi/7.txt",params,headers)
> response=conn.getresponse()
> print response.status, response.reason
> print data
> conn.close()
> But it failed:
> #print response.status, response.reason
> 500 Internal Server Error
> #print data
> '{"RemoteException":{"exception":"WebApplicationException","javaClassName":"","message":null}}'
> Who knows why? It's OK when i use curl, so where is the problem in httplib
> method?
> Or some other reasons?

It's rather hard to say when neither the base URL, nor querystring
parameters, nor request body are the same between your curl example
and your httplib example, making them rather incomparable.
Part of the problem may be that you are passing what may have been
intended as querystring parameters (`params`) as the `body` argument
to HTTPConnection.request().
In any case, I would suggest trying to use the `requests` library instead.


More information about the Python-list mailing list