Mailman 3 May 2015 - pypy-dev

How to convert python string to C char*?
by Yicong Huang May 14, 2015

May 14, 2015

We had a python function that return a string value. The function will callback in C code. The below is an example of the code: @ffi.callback("char *(char *, char *)") def strconcat(x, y): x1 = ffi.string(x) y1 = ffi.string(y) print x1 + y1 return x1 + y1 The error messages are: Trying to convert the result back to C: TypeError: initializer for ctype 'char *' must be a cdata pointer, not str How could we convert the return python string value to C char*?

2 4

operror-value: ('Unknown character', ('c callback', 1, 1, '\x08\n', 0))
by Yicong Huang May 14, 2015

May 14, 2015

Hi, I followed the document ( http://pypy.readthedocs.org/en/latest/embedding.html), to call python function from C code. The program I wrote is simple: it read python code from a local file to char*, and pass char* to pypy_execute_source(). However, I met these errors when executing the program: debug: OperationError: debug: operror-type: SyntaxError debug: operror-value: ('Unknown character', ('c callback', 1, 1, '\x08\n', 0)) Error calling pypy_execute_source! I print out char* that … [View More]

2 2

Be on my podcast
by Michael Kennedy May 14, 2015

May 14, 2015

I'd love to have you guys on my podcast, Talk Python To Me. You can learn more here: http://www.talkpythontome.com/ Interested in being a guest? Or a couple of you even? Thanks! Michael

4 7

How to get the return value from pypy function for C code
by Yicong Huang May 14, 2015

May 14, 2015

>From the document " "Embedding Pypy", we got the method to call python function from C code. But there are no examples on how to get the function return value. Does pypy have this feature?

3 4

How to call the "same pypy function" from C for thousands of times?
by Yicong Huang May 14, 2015

May 14, 2015

Hi, I read the document "Embedding Pypy". It introduces the method to call pypy function from C. In our scenaro, we would like to call the same pypy function from C for thousands of times or even millions of times. Following the document, the code is like this: for(i = 0; i < count; i++){ res = pypy_execute_source(pyBuffer); if(res) break; } if (res || i < count) { printf("Error calling pypy_execute_source!\n"); } However, the code is quite slow … [View More]

3 4

pypy-2.5.1 source code compiled errors
by Yicong Huang May 12, 2015

May 12, 2015

Hi, I tired to compile pypy-2.5.1 source code on Redhat EL 5.7. After quite a long time, I observed final linking errors: [translation:info] Error: [translation:info] File "/home/yicong.hyc/test/pypy-2.5.1-src/rpython/translator/goal/translate.py", line 318, in main [translation:info] drv.proceed(goals) [translation:info] File "/home/yicong.hyc/test/pypy-2.5.1-src/rpython/translator/driver.py", line 539, in proceed [translation:info] return self._execute(goals, task_skip = self.… [View More]

1 1

Pycket: A Tracing JIT For a Functional Language
by Bengt Richter May 10, 2015

May 10, 2015

Further evidence of your good rpython effects beyond pypy: http://lambda-the-ultimate.org/node/5152 http://homes.soic.indiana.edu/samth/pycket-draft.pdf in case any of you hadn't seen it yet. Kudos.

1 0

Build pypy 2.5.1 source code on Redhat EL5.7
by Yicong Huang May 9, 2015

May 9, 2015

Hi, We would like to try latest pypy 2.5.1. However, we found out the downloaded binary was not compatible with our Linux enviroment (Redhat EL5.7, kernel 2.6.32). And for some reasons, we have no plans to upgrade Linux soon. I tried to build pypy 2.5.1 source code, and met some errors as below: [translation:ERROR] CompilationError: CompilationError(err=""" [translation:ERROR] /tmp/usession-release-2.5.1-23/platcheck_31.c: In function ‘dump_section_SSL_TLSEXT_ERR_ALERT_FATAL’: [translation:… [View More]

3 5

PyXxx_Malloc() in cpyext
by Armin Rigo May 9, 2015

May 9, 2015

Hi all (mostly Amaury :-), Some C extension modules don't compile with cpyext because it is missing some of the functions like PyObject_Malloc (it has got PyMem_Malloc). I'm thinking about adding them but also simplifying the indirections and having all PyObject_Malloc(), PyMem_Malloc(), etc. just directly call malloc(), i.e. never using pypy's own obmalloc implementation. Would there be any problem with that? (We should really at some point measure if using this obmalloc implementation for … [View More]

1 0

Re: [pypy-dev] [pypy-commit] pypy default: The gdbm library is not thread-safe. Add a global lock.
by Maciej Fijalkowski May 7, 2015

May 7, 2015

I was thinking, maybe instead we can add a feature to cffi "don't release the GIL" and use that there? (it would be faster for example) On Wed, May 6, 2015 at 9:39 PM, arigo <noreply(a)buildbot.pypy.org> wrote: > Author: Armin Rigo <arigo(a)tunes.org> > Branch: > Changeset: r77171:df44050e8e33 > Date: 2015-05-06 21:39 +0200 > http://bitbucket.org/pypy/pypy/changeset/df44050e8e33/ > > Log: The gdbm library is not thread-safe. Add a global lock. > > diff … [View More]--git a/lib_pypy/gdbm.py b/lib_pypy/gdbm.py > --- a/lib_pypy/gdbm.py > +++ b/lib_pypy/gdbm.py > @@ -1,4 +1,6 @@ > import cffi, os, sys > +import thread > +_lock = thread.allocate_lock() > > ffi = cffi.FFI() > ffi.cdef(''' > @@ -40,6 +42,7 @@ > > try: > verify_code = ''' > + #include <stdlib.h> > #include "gdbm.h" > > static datum pygdbm_fetch(GDBM_FILE gdbm_file, char *dptr, int dsize) { > @@ -86,102 +89,121 @@ > return {'dptr': ffi.new("char[]", key), 'dsize': len(key)} > > class gdbm(object): > - ll_dbm = None > + __ll_dbm = None > + > + # All public methods need to acquire the lock; all private methods > + # assume the lock is already held. Thus public methods cannot call > + # other public methods. > > def __init__(self, filename, iflags, mode): > - res = lib.gdbm_open(filename, 0, iflags, mode, ffi.NULL) > - self.size = -1 > - if not res: > - self._raise_from_errno() > - self.ll_dbm = res > + with _lock: > + res = lib.gdbm_open(filename, 0, iflags, mode, ffi.NULL) > + self.__size = -1 > + if not res: > + self.__raise_from_errno() > + self.__ll_dbm = res > > def close(self): > - if self.ll_dbm: > - lib.gdbm_close(self.ll_dbm) > - self.ll_dbm = None > + with _lock: > + if self.__ll_dbm: > + lib.gdbm_close(self.__ll_dbm) > + self.__ll_dbm = None > > - def _raise_from_errno(self): > + def __raise_from_errno(self): > if ffi.errno: > raise error(ffi.errno, os.strerror(ffi.errno)) > raise error(lib.gdbm_errno, lib.gdbm_strerror(lib.gdbm_errno)) > > def __len__(self): > - if self.size < 0: > - self.size = len(self.keys()) > - return self.size > + with _lock: > + if self.__size < 0: > + self.__size = len(self.__keys()) > + return self.__size > > def __setitem__(self, key, value): > - self._check_closed() > - self.size = -1 > - r = lib.gdbm_store(self.ll_dbm, _fromstr(key), _fromstr(value), > - lib.GDBM_REPLACE) > - if r < 0: > - self._raise_from_errno() > + with _lock: > + self.__check_closed() > + self.__size = -1 > + r = lib.gdbm_store(self.__ll_dbm, _fromstr(key), _fromstr(value), > + lib.GDBM_REPLACE) > + if r < 0: > + self.__raise_from_errno() > > def __delitem__(self, key): > - self._check_closed() > - self.size = -1 > - res = lib.gdbm_delete(self.ll_dbm, _fromstr(key)) > - if res < 0: > - raise KeyError(key) > + with _lock: > + self.__check_closed() > + self.__size = -1 > + res = lib.gdbm_delete(self.__ll_dbm, _fromstr(key)) > + if res < 0: > + raise KeyError(key) > > def __contains__(self, key): > - self._check_closed() > - key = _checkstr(key) > - return lib.pygdbm_exists(self.ll_dbm, key, len(key)) > + with _lock: > + self.__check_closed() > + key = _checkstr(key) > + return lib.pygdbm_exists(self.__ll_dbm, key, len(key)) > has_key = __contains__ > > def __getitem__(self, key): > - self._check_closed() > - key = _checkstr(key) > - drec = lib.pygdbm_fetch(self.ll_dbm, key, len(key)) > - if not drec.dptr: > - raise KeyError(key) > - res = str(ffi.buffer(drec.dptr, drec.dsize)) > - lib.free(drec.dptr) > - return res > + with _lock: > + self.__check_closed() > + key = _checkstr(key) > + drec = lib.pygdbm_fetch(self.__ll_dbm, key, len(key)) > + if not drec.dptr: > + raise KeyError(key) > + res = str(ffi.buffer(drec.dptr, drec.dsize)) > + lib.free(drec.dptr) > + return res > > - def keys(self): > - self._check_closed() > + def __keys(self): > + self.__check_closed() > l = [] > - key = lib.gdbm_firstkey(self.ll_dbm) > + key = lib.gdbm_firstkey(self.__ll_dbm) > while key.dptr: > l.append(str(ffi.buffer(key.dptr, key.dsize))) > - nextkey = lib.gdbm_nextkey(self.ll_dbm, key) > + nextkey = lib.gdbm_nextkey(self.__ll_dbm, key) > lib.free(key.dptr) > key = nextkey > return l > > + def keys(self): > + with _lock: > + return self.__keys() > + > def firstkey(self): > - self._check_closed() > - key = lib.gdbm_firstkey(self.ll_dbm) > - if key.dptr: > - res = str(ffi.buffer(key.dptr, key.dsize)) > - lib.free(key.dptr) > - return res > + with _lock: > + self.__check_closed() > + key = lib.gdbm_firstkey(self.__ll_dbm) > + if key.dptr: > + res = str(ffi.buffer(key.dptr, key.dsize)) > + lib.free(key.dptr) > + return res > > def nextkey(self, key): > - self._check_closed() > - key = lib.gdbm_nextkey(self.ll_dbm, _fromstr(key)) > - if key.dptr: > - res = str(ffi.buffer(key.dptr, key.dsize)) > - lib.free(key.dptr) > - return res > + with _lock: > + self.__check_closed() > + key = lib.gdbm_nextkey(self.__ll_dbm, _fromstr(key)) > + if key.dptr: > + res = str(ffi.buffer(key.dptr, key.dsize)) > + lib.free(key.dptr) > + return res > > def reorganize(self): > - self._check_closed() > - if lib.gdbm_reorganize(self.ll_dbm) < 0: > - self._raise_from_errno() > + with _lock: > + self.__check_closed() > + if lib.gdbm_reorganize(self.__ll_dbm) < 0: > + self.__raise_from_errno() > > - def _check_closed(self): > - if not self.ll_dbm: > + def __check_closed(self): > + if not self.__ll_dbm: > raise error(0, "GDBM object has already been closed") > > __del__ = close > > def sync(self): > - self._check_closed() > - lib.gdbm_sync(self.ll_dbm) > + with _lock: > + self.__check_closed() > + lib.gdbm_sync(self.__ll_dbm) > > def open(filename, flags='r', mode=0666): > if flags[0] == 'r': > _______________________________________________ > pypy-commit mailing list > pypy-commit(a)python.org > https://mail.python.org/mailman/listinfo/pypy-commit [View Less]

2 1