Mailman 3 September 2017 - pypy-issue

Issue #2670: Inconsistency between pypy and cpython in some obscure case involving assigning to __weakref__ (pypy/pypy)
by Nathaniel Smith 30 Sep '17

30 Sep '17

New issue 2670: Inconsistency between pypy and cpython in some obscure case involving assigning to __weakref__ https://bitbucket.org/pypy/pypy/issues/2670/inconsistency-between-pypy-and-… Nathaniel Smith: There's a messy and obscure case in the use of the `attrs` library where the officially recommended thing currently works on CPython but breaks on PyPy: https://github.com/python-attrs/attrs/issues/174#issuecomment-333335667 I really don't know whether this should be considered a bug in attrs or PyPy, but I figured you'd want to be aware in any case so you'd have the chance to work it out with them :-).

1 0

Issue #2669: Py_FileSystemDefaultEncoding always set to NULL for C extension modules (pypy/pypy)
by Ben Hoyt 27 Sep '17

27 Sep '17

New issue 2669: Py_FileSystemDefaultEncoding always set to NULL for C extension modules https://bitbucket.org/pypy/pypy/issues/2669/py_filesystemdefaultencoding-al… Ben Hoyt: Py_FileSystemDefaultEncoding is a CPython C extension value used for decoding bytes filenames to unicode in C extensions. For example, my scandir library uses this: https://github.com/benhoyt/scandir/blob/7dc415a81f36599cfce5c556bf28ba2b4d4… However, in PyPy in fileobject.h it's #define'd to be NULL, making it not very useful. I'm going to fix in scandir by basically doing: Py_FileSystemDefaultEncoding ? Py_FileSystemDefaultEncoding : "UTF-8" wherever I currently use it. Note that sys.getfilesystemencoding() does return "UTF-8" correctly. Would "UTF-8" (on Linux, or "mbcs" on Windows) be a better value for Py_FileSystemDefaultEncoding than NULL?

1 0

Issue #2668: ctypes.pythonapi not available (pypy/pypy)
by Stuart Axon 27 Sep '17

27 Sep '17

New issue 2668: ctypes.pythonapi not available https://bitbucket.org/pypy/pypy/issues/2668/ctypespythonapi-not-available Stuart Axon: Pygames unittests make use of ctypes.pythonapi The pypy branch here - https://github.com/stuaxo/pygame/ Has a couple of small fixes to compile under pypy. pythonapi is used in these two files - https://github.com/stuaxo/pygame/blob/pypy/test/test_utils/arrinter.py https://github.com/stuaxo/pygame/blob/pypy/test/mixer_test.py These were found by running all the pygame tests - ```python -m pygame.tests --exclude opengl```

1 0

Issue #2667: CAPI attribute differences (pypy/pypy)
by Stuart Axon 27 Sep '17

27 Sep '17

New issue 2667: CAPI attribute differences https://bitbucket.org/pypy/pypy/issues/2667/capi-attribute-differences Stuart Axon: With the fixes from here https://bitbucket.org/pypy/pypy/issues/2627/pythreadstate-missing-curexc_ty… Pygame now compiles and installs. Until now I've put the fixes here on the 'pypy' branch. https://github.com/stuaxo/pygame/tree/pypy ``` $ git clone https://github.com/stuaxo/pygame.git $ cd pygame $ git checkout pypy $ python setup.py install ``` Running the tests ``` $ python -m pygame.tests --exclude opengl ```

1 0

Issue #2666: lxml 4.0 fails to create XMLSyntaxError on Pypy (pypy/pypy)
by Alex Prengère 27 Sep '17

27 Sep '17

New issue 2666: lxml 4.0 fails to create XMLSyntaxError on Pypy https://bitbucket.org/pypy/pypy/issues/2666/lxml-40-fails-to-create-xmlsynt… Alex Prengère: Hello, I opened a bug on lxml regarding this, but since it does not happen on CPython I thought I would post it here too. https://bugs.launchpad.net/lxml/+bug/1719814

1 0

Issue #2665: python-config --libs fails under pypy3.5 (pypy/pypy)
by Stuart Axon 26 Sep '17

26 Sep '17

New issue 2665: python-config --libs fails under pypy3.5 https://bitbucket.org/pypy/pypy/issues/2665/python-config-libs-fails-under-… Stuart Axon: Under a virtualenv created for pypy3.5 nightly: ```bash $ python-config --libs Traceback (most recent call last): File "/mnt/data/home/stu/.virtualenvs/tmp-5ac51e31da917d04/bin/python-config", line 54, in <module> libs = ['-lpython' + pyver + abiflags] TypeError: unsupported operand type(s) for +: 'str' and 'NoneType' ``` Having a look inside, this is because pyver is None, that's because ```pyver = sysconfig.get_config_var('VERSION')``` which doesn't exist. py_version does exist, and in cpython3.5 it appears one is the same as the other. pypy3.5 - sysconfig.get_config_vars() ``` In [2]: sysconfig.get_config_vars() Out[2]: {'EXT_SUFFIX': '.pypy3-510-x86_64-linux-gnu.so', 'INCLUDEPY': '/home/stu/.virtualenvs/pypy-nightly-py3.5/include', 'SHLIB_SUFFIX': '.pypy3-510-x86_64-linux-gnu.so', 'SO': '.pypy3-510-x86_64-linux-gnu.so', 'SOABI': 'pypy3-510', 'abiflags': '', 'base': '/home/stu/.virtualenvs/pypy-nightly-py3.5', 'exec_prefix': '/home/stu/.virtualenvs/pypy-nightly-py3.5', 'installed_base': '/home/stu/.virtualenvs/pypy-nightly-py3.5', 'installed_platbase': '/home/stu/.virtualenvs/pypy-nightly-py3.5', 'platbase': '/home/stu/.virtualenvs/pypy-nightly-py3.5', 'prefix': '/home/stu/.virtualenvs/pypy-nightly-py3.5', 'projectbase': '/mnt/data/home/stu/.virtualenvs/pypy-nightly-py3.5/bin', 'py_version': '3.5.3', 'py_version_nodot': '35', 'py_version_short': '3.5', 'srcdir': '/mnt/data/home/stu/.virtualenvs/pypy-nightly-py3.5/lib-python/config-3.5', 'userbase': '/home/stu/.local'} ``` cpython3.5 - sysconfig.get_config_vars() ``` sysconfig.get_config_vars()) {'ABIFLAGS': 'm', 'AC_APPLE_UNIVERSAL_BUILD': 0, 'AIX_GENUINE_CPLUSPLUS': 0, 'AR': 'x86_64-linux-gnu-gcc-ar', 'ARFLAGS': 'rc', 'ASDLGEN': 'python3.5 ../Parser/asdl_c.py', 'ASDLGEN_FILES': '../Parser/asdl.py ../Parser/asdl_c.py', 'AST_ASDL': '../Parser/Python.asdl', 'AST_C': 'Python/Python-ast.c', 'AST_C_DIR': 'Python', 'AST_H': 'Include/Python-ast.h', 'AST_H_DIR': 'Include', 'BASECFLAGS': '-Wno-unused-result -Wsign-compare', 'BASECPPFLAGS': '-IObjects -IInclude -IPython', 'BASEMODLIBS': '', 'BINDIR': '/usr/bin', 'BINLIBDEST': '/usr/lib/python3.5', 'BLDLIBRARY': '-lpython3.5m', 'BLDSHARED': 'x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 ' '-Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro', 'BUILDEXE': '', 'BUILDPYTHON': 'python', 'BUILD_GNU_TYPE': 'x86_64-pc-linux-gnu', 'BYTESTR_DEPS': '\\', 'CC': 'x86_64-linux-gnu-gcc -pthread', 'CCSHARED': '-fPIC', 'CFLAGS': '-Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall ' '-Wstrict-prototypes -g ' '-fdebug-prefix-map=/build/python3.5-7CCmgg/python3.5-3.5.3=. ' '-fstack-protector-strong -Wformat -Werror=format-security -g ' '-flto -fuse-linker-plugin -ffat-lto-objects', 'CFLAGSFORSHARED': '-fPIC', 'CFLAGS_NODIST': '', 'CONFIGFILES': 'configure configure.ac acconfig.h pyconfig.h.in ' 'Makefile.pre.in', 'CONFIGURE_CFLAGS': '-g ' '-fdebug-prefix-map=/build/python3.5-7CCmgg/python3.5-3.5.3=. ' '-fstack-protector-strong -Wformat ' '-Werror=format-security', 'CONFIGURE_CFLAGS_NODIST': '-Werror=declaration-after-statement', 'CONFIGURE_CPPFLAGS': '-Wdate-time -D_FORTIFY_SOURCE=2', 'CONFIGURE_LDFLAGS': '-Wl,-Bsymbolic-functions -Wl,-z,relro', 'CONFIG_ARGS': "'--enable-shared' '--prefix=/usr' '--enable-ipv6' " "'--enable-loadable-sqlite-extensions' " "'--with-dbmliborder=bdb:gdbm' '--with-computed-gotos' " "'--without-ensurepip' '--with-system-expat' " "'--with-system-libmpdec' '--with-system-ffi' '--with-fpectl' " "'CC=x86_64-linux-gnu-gcc' 'CFLAGS=-g " '-fdebug-prefix-map=/build/python3.5-7CCmgg/python3.5-3.5.3=. ' "-fstack-protector-strong -Wformat -Werror=format-security ' " "'LDFLAGS=-Wl,-Bsymbolic-functions -Wl,-z,relro' " "'CPPFLAGS=-Wdate-time -D_FORTIFY_SOURCE=2'", 'CONFINCLUDEDIR': '/usr/include', 'CONFINCLUDEPY': '/usr/include/python3.5m', 'COREPYTHONPATH': ':plat-x86_64-linux-gnu', 'COVERAGE_INFO': '/build/python3.5-7CCmgg/python3.5-3.5.3/build-shared/coverage.info', 'COVERAGE_REPORT': '/build/python3.5-7CCmgg/python3.5-3.5.3/build-shared/lcov-report', 'COVERAGE_REPORT_OPTIONS': '--no-branch-coverage --title "CPython lcov ' 'report"', 'CPPFLAGS': '-IObjects -IInclude -IPython -I. -I../Include -Wdate-time ' '-D_FORTIFY_SOURCE=2', 'CXX': 'x86_64-linux-gnu-g++ -pthread', 'DESTDIRS': '/usr /usr/lib /usr/lib/python3.5 /usr/lib/python3.5/lib-dynload', 'DESTLIB': '/usr/lib/python3.5', 'DESTPATH': '', 'DESTSHARED': '/usr/lib/python3.5/lib-dynload', 'DIRMODE': 755, 'DIST': 'README ChangeLog configure configure.ac acconfig.h pyconfig.h.in ' 'Makefile.pre.in Include Lib Misc Ext-dummy', 'DISTDIRS': 'Include Lib Misc Ext-dummy', 'DISTFILES': 'README ChangeLog configure configure.ac acconfig.h ' 'pyconfig.h.in Makefile.pre.in', 'DLINCLDIR': '.', 'DLLLIBRARY': '', 'DOUBLE_IS_ARM_MIXED_ENDIAN_IEEE754': 0, 'DOUBLE_IS_BIG_ENDIAN_IEEE754': 0, 'DOUBLE_IS_LITTLE_ENDIAN_IEEE754': 1, 'DYNLOADFILE': 'dynload_shlib.o', 'ENABLE_IPV6': 1, 'ENSUREPIP': 'no', 'EXE': '', 'EXEMODE': 755, 'EXTRAMACHDEPPATH': '', 'EXTRATESTOPTS': '', 'EXT_SUFFIX': '.cpython-35m-x86_64-linux-gnu.so', 'FILEMODE': 644, 'FLOCK_NEEDS_LIBBSD': 0, 'GETPGRP_HAVE_ARG': 0, 'GETTIMEOFDAY_NO_TZ': 0, 'GNULD': 'yes', 'GRAMMAR_C': 'Python/graminit.c', 'GRAMMAR_H': 'Include/graminit.h', 'GRAMMAR_INPUT': '../Grammar/Grammar', 'HAVE_ACCEPT4': 1, 'HAVE_ACOSH': 1, 'HAVE_ADDRINFO': 1, 'HAVE_ALARM': 1, 'HAVE_ALIGNED_REQUIRED': 0, 'HAVE_ALLOCA_H': 1, 'HAVE_ALTZONE': 0, 'HAVE_ASINH': 1, 'HAVE_ASM_TYPES_H': 1, 'HAVE_ATANH': 1, 'HAVE_BIND_TEXTDOMAIN_CODESET': 1, 'HAVE_BLUETOOTH_BLUETOOTH_H': 1, 'HAVE_BLUETOOTH_H': 0, 'HAVE_BROKEN_MBSTOWCS': 0, 'HAVE_BROKEN_NICE': 0, 'HAVE_BROKEN_PIPE_BUF': 0, 'HAVE_BROKEN_POLL': 0, 'HAVE_BROKEN_POSIX_SEMAPHORES': 0, 'HAVE_BROKEN_PTHREAD_SIGMASK': 0, 'HAVE_BROKEN_SEM_GETVALUE': 0, 'HAVE_BROKEN_UNSETENV': 0, 'HAVE_BUILTIN_ATOMIC': 1, 'HAVE_C99_BOOL': 1, 'HAVE_CHFLAGS': 0, 'HAVE_CHOWN': 1, 'HAVE_CHROOT': 1, 'HAVE_CLOCK': 1, 'HAVE_CLOCK_GETRES': 1, 'HAVE_CLOCK_GETTIME': 1, 'HAVE_COMPUTED_GOTOS': 1, 'HAVE_CONFSTR': 1, 'HAVE_CONIO_H': 0, 'HAVE_COPYSIGN': 1, 'HAVE_CTERMID': 1, 'HAVE_CTERMID_R': 0, 'HAVE_CURSES_H': 1, 'HAVE_CURSES_IS_TERM_RESIZED': 1, 'HAVE_CURSES_RESIZETERM': 1, 'HAVE_CURSES_RESIZE_TERM': 1, 'HAVE_DECL_ISFINITE': 1, 'HAVE_DECL_ISINF': 1, 'HAVE_DECL_ISNAN': 1, 'HAVE_DECL_TZNAME': 0, 'HAVE_DEVICE_MACROS': 1, 'HAVE_DEV_PTC': 0, 'HAVE_DEV_PTMX': 1, 'HAVE_DIRECT_H': 0, 'HAVE_DIRENT_D_TYPE': 1, 'HAVE_DIRENT_H': 1, 'HAVE_DIRFD': 1, 'HAVE_DLFCN_H': 1, 'HAVE_DLOPEN': 1, 'HAVE_DUP2': 1, 'HAVE_DUP3': 1, 'HAVE_DYNAMIC_LOADING': 1, 'HAVE_ENDIAN_H': 1, 'HAVE_EPOLL': 1, 'HAVE_EPOLL_CREATE1': 1, 'HAVE_ERF': 1, 'HAVE_ERFC': 1, 'HAVE_ERRNO_H': 1, 'HAVE_EXECV': 1, 'HAVE_EXPM1': 1, 'HAVE_FACCESSAT': 1, 'HAVE_FCHDIR': 1, 'HAVE_FCHMOD': 1, 'HAVE_FCHMODAT': 1, 'HAVE_FCHOWN': 1, 'HAVE_FCHOWNAT': 1, 'HAVE_FCNTL_H': 1, 'HAVE_FDATASYNC': 1, 'HAVE_FDOPENDIR': 1, 'HAVE_FEXECVE': 1, 'HAVE_FINITE': 1, 'HAVE_FLOCK': 1, 'HAVE_FORK': 1, 'HAVE_FORKPTY': 1, 'HAVE_FPATHCONF': 1, 'HAVE_FSEEK64': 0, 'HAVE_FSEEKO': 1, 'HAVE_FSTATAT': 1, 'HAVE_FSTATVFS': 1, 'HAVE_FSYNC': 1, 'HAVE_FTELL64': 0, 'HAVE_FTELLO': 1, 'HAVE_FTIME': 1, 'HAVE_FTRUNCATE': 1, 'HAVE_FUTIMENS': 1, 'HAVE_FUTIMES': 1, 'HAVE_FUTIMESAT': 1, 'HAVE_GAI_STRERROR': 1, 'HAVE_GAMMA': 1, 'HAVE_GCC_ASM_FOR_MC68881': 0, 'HAVE_GCC_ASM_FOR_X64': 1, 'HAVE_GCC_ASM_FOR_X87': 1, 'HAVE_GCC_UINT128_T': 1, 'HAVE_GETADDRINFO': 1, 'HAVE_GETC_UNLOCKED': 1, 'HAVE_GETENTROPY': 0, 'HAVE_GETGROUPLIST': 1, 'HAVE_GETGROUPS': 1, 'HAVE_GETHOSTBYNAME': 0, 'HAVE_GETHOSTBYNAME_R': 1, 'HAVE_GETHOSTBYNAME_R_3_ARG': 0, 'HAVE_GETHOSTBYNAME_R_5_ARG': 0, 'HAVE_GETHOSTBYNAME_R_6_ARG': 1, 'HAVE_GETITIMER': 1, 'HAVE_GETLOADAVG': 1, 'HAVE_GETLOGIN': 1, 'HAVE_GETNAMEINFO': 1, 'HAVE_GETPAGESIZE': 1, 'HAVE_GETPEERNAME': 1, 'HAVE_GETPGID': 1, 'HAVE_GETPGRP': 1, 'HAVE_GETPID': 1, 'HAVE_GETPRIORITY': 1, 'HAVE_GETPWENT': 1, 'HAVE_GETRANDOM': 0, 'HAVE_GETRANDOM_SYSCALL': 1, 'HAVE_GETRESGID': 1, 'HAVE_GETRESUID': 1, 'HAVE_GETSID': 1, 'HAVE_GETSPENT': 1, 'HAVE_GETSPNAM': 1, 'HAVE_GETTIMEOFDAY': 1, 'HAVE_GETWD': 1, 'HAVE_GLIBC_MEMMOVE_BUG': 0, 'HAVE_GRP_H': 1, 'HAVE_HSTRERROR': 1, 'HAVE_HTOLE64': 1, 'HAVE_HYPOT': 1, 'HAVE_IEEEFP_H': 0, 'HAVE_IF_NAMEINDEX': 1, 'HAVE_INET_ATON': 1, 'HAVE_INET_PTON': 1, 'HAVE_INITGROUPS': 1, 'HAVE_INT32_T': 1, 'HAVE_INT64_T': 1, 'HAVE_INTTYPES_H': 1, 'HAVE_IO_H': 0, 'HAVE_IPA_PURE_CONST_BUG': 0, 'HAVE_KILL': 1, 'HAVE_KILLPG': 1, 'HAVE_KQUEUE': 0, 'HAVE_LANGINFO_H': 1, 'HAVE_LARGEFILE_SUPPORT': 0, 'HAVE_LCHFLAGS': 0, 'HAVE_LCHMOD': 0, 'HAVE_LCHOWN': 1, 'HAVE_LGAMMA': 1, 'HAVE_LIBDL': 1, 'HAVE_LIBDLD': 0, 'HAVE_LIBIEEE': 0, 'HAVE_LIBINTL_H': 1, 'HAVE_LIBREADLINE': 1, 'HAVE_LIBRESOLV': 0, 'HAVE_LIBSENDFILE': 0, 'HAVE_LIBUTIL_H': 0, 'HAVE_LINK': 1, 'HAVE_LINKAT': 1, 'HAVE_LINUX_CAN_BCM_H': 1, 'HAVE_LINUX_CAN_H': 1, 'HAVE_LINUX_CAN_RAW_FD_FRAMES': 1, 'HAVE_LINUX_CAN_RAW_H': 1, 'HAVE_LINUX_NETLINK_H': 1, 'HAVE_LINUX_RANDOM_H': 1, 'HAVE_LINUX_TIPC_H': 1, 'HAVE_LOCKF': 1, 'HAVE_LOG1P': 1, 'HAVE_LOG2': 1, 'HAVE_LONG_DOUBLE': 1, 'HAVE_LONG_LONG': 1, 'HAVE_LSTAT': 1, 'HAVE_LUTIMES': 1, 'HAVE_MAKEDEV': 1, 'HAVE_MBRTOWC': 1, 'HAVE_MEMMOVE': 1, 'HAVE_MEMORY_H': 1, 'HAVE_MEMRCHR': 1, 'HAVE_MKDIRAT': 1, 'HAVE_MKFIFO': 1, 'HAVE_MKFIFOAT': 1, 'HAVE_MKNOD': 1, 'HAVE_MKNODAT': 1, 'HAVE_MKTIME': 1, 'HAVE_MMAP': 1, 'HAVE_MREMAP': 1, 'HAVE_NCURSES_H': 1, 'HAVE_NDIR_H': 0, 'HAVE_NETPACKET_PACKET_H': 1, 'HAVE_NET_IF_H': 1, 'HAVE_NICE': 1, 'HAVE_OPENAT': 1, 'HAVE_OPENPTY': 1, 'HAVE_OSX105_SDK': 0, 'HAVE_PATHCONF': 1, 'HAVE_PAUSE': 1, 'HAVE_PIPE2': 1, 'HAVE_PLOCK': 0, 'HAVE_POLL': 1, 'HAVE_POLL_H': 1, 'HAVE_POSIX_FADVISE': 1, 'HAVE_POSIX_FALLOCATE': 1, 'HAVE_PREAD': 1, 'HAVE_PRLIMIT': 1, 'HAVE_PROCESS_H': 0, 'HAVE_PROTOTYPES': 1, 'HAVE_PTHREAD_ATFORK': 1, 'HAVE_PTHREAD_DESTRUCTOR': 0, 'HAVE_PTHREAD_H': 1, 'HAVE_PTHREAD_INIT': 0, 'HAVE_PTHREAD_KILL': 1, 'HAVE_PTHREAD_SIGMASK': 1, 'HAVE_PTY_H': 1, 'HAVE_PUTENV': 1, 'HAVE_PWRITE': 1, 'HAVE_READLINK': 1, 'HAVE_READLINKAT': 1, 'HAVE_READV': 1, 'HAVE_REALPATH': 1, 'HAVE_RENAMEAT': 1, 'HAVE_RL_APPEND_HISTORY': 1, 'HAVE_RL_CALLBACK': 1, 'HAVE_RL_CATCH_SIGNAL': 1, 'HAVE_RL_COMPLETION_APPEND_CHARACTER': 1, 'HAVE_RL_COMPLETION_DISPLAY_MATCHES_HOOK': 1, 'HAVE_RL_COMPLETION_MATCHES': 1, 'HAVE_RL_COMPLETION_SUPPRESS_APPEND': 1, 'HAVE_RL_PRE_INPUT_HOOK': 1, 'HAVE_RL_RESIZE_TERMINAL': 1, 'HAVE_ROUND': 1, 'HAVE_SCHED_GET_PRIORITY_MAX': 1, 'HAVE_SCHED_H': 1, 'HAVE_SCHED_RR_GET_INTERVAL': 1, 'HAVE_SCHED_SETAFFINITY': 1, 'HAVE_SCHED_SETPARAM': 1, 'HAVE_SCHED_SETSCHEDULER': 1, 'HAVE_SELECT': 1, 'HAVE_SEM_GETVALUE': 1, 'HAVE_SEM_OPEN': 1, 'HAVE_SEM_TIMEDWAIT': 1, 'HAVE_SEM_UNLINK': 1, 'HAVE_SENDFILE': 1, 'HAVE_SETEGID': 1, 'HAVE_SETEUID': 1, 'HAVE_SETGID': 1, 'HAVE_SETGROUPS': 1, 'HAVE_SETHOSTNAME': 1, 'HAVE_SETITIMER': 1, 'HAVE_SETLOCALE': 1, 'HAVE_SETPGID': 1, 'HAVE_SETPGRP': 1, 'HAVE_SETPRIORITY': 1, 'HAVE_SETREGID': 1, 'HAVE_SETRESGID': 1, 'HAVE_SETRESUID': 1, 'HAVE_SETREUID': 1, 'HAVE_SETSID': 1, 'HAVE_SETUID': 1, 'HAVE_SETVBUF': 1, 'HAVE_SHADOW_H': 1, 'HAVE_SIGACTION': 1, 'HAVE_SIGALTSTACK': 1, 'HAVE_SIGINTERRUPT': 1, 'HAVE_SIGNAL_H': 1, 'HAVE_SIGPENDING': 1, 'HAVE_SIGRELSE': 1, 'HAVE_SIGTIMEDWAIT': 1, 'HAVE_SIGWAIT': 1, 'HAVE_SIGWAITINFO': 1, 'HAVE_SNPRINTF': 1, 'HAVE_SOCKADDR_SA_LEN': 0, 'HAVE_SOCKADDR_STORAGE': 1, 'HAVE_SOCKETPAIR': 1, 'HAVE_SPAWN_H': 1, 'HAVE_SSIZE_T': 1, 'HAVE_STATVFS': 1, 'HAVE_STAT_TV_NSEC': 1, 'HAVE_STAT_TV_NSEC2': 0, 'HAVE_STDARG_PROTOTYPES': 1, 'HAVE_STDINT_H': 1, 'HAVE_STDLIB_H': 1, 'HAVE_STD_ATOMIC': 1, 'HAVE_STRDUP': 1, 'HAVE_STRFTIME': 1, 'HAVE_STRINGS_H': 1, 'HAVE_STRING_H': 1, 'HAVE_STRLCPY': 0, 'HAVE_STROPTS_H': 1, 'HAVE_STRUCT_STAT_ST_BIRTHTIME': 0, 'HAVE_STRUCT_STAT_ST_BLKSIZE': 1, 'HAVE_STRUCT_STAT_ST_BLOCKS': 1, 'HAVE_STRUCT_STAT_ST_FLAGS': 0, 'HAVE_STRUCT_STAT_ST_GEN': 0, 'HAVE_STRUCT_STAT_ST_RDEV': 1, 'HAVE_STRUCT_TM_TM_ZONE': 1, 'HAVE_SYMLINK': 1, 'HAVE_SYMLINKAT': 1, 'HAVE_SYNC': 1, 'HAVE_SYSCONF': 1, 'HAVE_SYSEXITS_H': 1, 'HAVE_SYS_AUDIOIO_H': 0, 'HAVE_SYS_BSDTTY_H': 0, 'HAVE_SYS_DEVPOLL_H': 0, 'HAVE_SYS_DIR_H': 0, 'HAVE_SYS_ENDIAN_H': 0, 'HAVE_SYS_EPOLL_H': 1, 'HAVE_SYS_EVENT_H': 0, 'HAVE_SYS_FILE_H': 1, 'HAVE_SYS_IOCTL_H': 1, 'HAVE_SYS_KERN_CONTROL_H': 0, 'HAVE_SYS_LOADAVG_H': 0, 'HAVE_SYS_LOCK_H': 0, 'HAVE_SYS_MKDEV_H': 0, 'HAVE_SYS_MODEM_H': 0, 'HAVE_SYS_NDIR_H': 0, 'HAVE_SYS_PARAM_H': 1, 'HAVE_SYS_POLL_H': 1, 'HAVE_SYS_RANDOM_H': 0, 'HAVE_SYS_RESOURCE_H': 1, 'HAVE_SYS_SELECT_H': 1, 'HAVE_SYS_SENDFILE_H': 1, 'HAVE_SYS_SOCKET_H': 1, 'HAVE_SYS_STATVFS_H': 1, 'HAVE_SYS_STAT_H': 1, 'HAVE_SYS_SYSCALL_H': 1, 'HAVE_SYS_SYS_DOMAIN_H': 0, 'HAVE_SYS_TERMIO_H': 0, 'HAVE_SYS_TIMES_H': 1, 'HAVE_SYS_TIME_H': 1, 'HAVE_SYS_TYPES_H': 1, 'HAVE_SYS_UIO_H': 1, 'HAVE_SYS_UN_H': 1, 'HAVE_SYS_UTSNAME_H': 1, 'HAVE_SYS_WAIT_H': 1, 'HAVE_SYS_XATTR_H': 1, 'HAVE_TCGETPGRP': 1, 'HAVE_TCSETPGRP': 1, 'HAVE_TEMPNAM': 1, 'HAVE_TERMIOS_H': 1, 'HAVE_TERM_H': 1, 'HAVE_TGAMMA': 1, 'HAVE_TIMEGM': 1, 'HAVE_TIMES': 1, 'HAVE_TMPFILE': 1, 'HAVE_TMPNAM': 1, 'HAVE_TMPNAM_R': 1, 'HAVE_TM_ZONE': 1, 'HAVE_TRUNCATE': 1, 'HAVE_TZNAME': 0, 'HAVE_UCS4_TCL': 0, 'HAVE_UINT32_T': 1, 'HAVE_UINT64_T': 1, 'HAVE_UINTPTR_T': 1, 'HAVE_UNAME': 1, 'HAVE_UNISTD_H': 1, 'HAVE_UNLINKAT': 1, 'HAVE_UNSETENV': 1, 'HAVE_USABLE_WCHAR_T': 0, 'HAVE_UTIL_H': 0, 'HAVE_UTIMENSAT': 1, 'HAVE_UTIMES': 1, 'HAVE_UTIME_H': 1, 'HAVE_WAIT3': 1, 'HAVE_WAIT4': 1, 'HAVE_WAITID': 1, 'HAVE_WAITPID': 1, 'HAVE_WCHAR_H': 1, 'HAVE_WCSCOLL': 1, 'HAVE_WCSFTIME': 1, 'HAVE_WCSXFRM': 1, 'HAVE_WMEMCMP': 1, 'HAVE_WORKING_TZSET': 1, 'HAVE_WRITEV': 1, 'HAVE_ZLIB_COPY': 1, 'HAVE__GETPTY': 0, 'HGBRANCH': '', 'HGTAG': '', 'HGVERSION': '', 'HOST_GNU_TYPE': 'x86_64-pc-linux-gnu', 'INCLDIRSTOMAKE': '/usr/include /usr/include /usr/include/python3.5m ' '/usr/include/python3.5m', 'INCLUDEDIR': '/usr/include', 'INCLUDEPY': '/usr/include/python3.5m', 'INSTALL': '/usr/bin/install -c', 'INSTALL_DATA': '/usr/bin/install -c -m 644', 'INSTALL_PROGRAM': '/usr/bin/install -c', 'INSTALL_SCRIPT': '/usr/bin/install -c', 'INSTALL_SHARED': '/usr/bin/install -c -m 555', 'INSTSONAME': 'libpython3.5m.so.1.0', 'IO_H': 'Modules/_io/_iomodule.h', 'IO_OBJS': '\\', 'LDCXXSHARED': 'x86_64-linux-gnu-g++ -pthread -shared -Wl,-O1 ' '-Wl,-Bsymbolic-functions', 'LDFLAGS': '-Wl,-Bsymbolic-functions -Wl,-z,relro', 'LDLAST': '', 'LDLIBRARY': 'libpython3.5m.so', 'LDLIBRARYDIR': '', 'LDSHARED': 'x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 ' '-Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro', 'LDVERSION': '3.5m', 'LIBC': '', 'LIBDEST': '/usr/lib/python3.5', 'LIBDIR': '/usr/lib', 'LIBFFI_INCLUDEDIR': '', 'LIBM': '-lm', 'LIBOBJDIR': 'Python/', 'LIBOBJS': '', 'LIBPC': '/usr/lib/x86_64-linux-gnu/pkgconfig', 'LIBPL': '/usr/lib/python3.5/config-3.5m-x86_64-linux-gnu', 'LIBRARY': 'libpython3.5m.a', 'LIBRARY_OBJS': '\\', 'LIBRARY_OBJS_OMIT_FROZEN': '\\', 'LIBS': '-lpthread -ldl -lutil', 'LIBSUBDIRS': 'tkinter tkinter/test tkinter/test/test_tkinter \\', 'LINKCC': 'x86_64-linux-gnu-gcc -pthread', 'LINKFORSHARED': '-Xlinker -export-dynamic -Wl,-O1 -Wl,-Bsymbolic-functions', 'LIPO_32BIT_FLAGS': '', 'LLVM_PROF_ERR': 'no', 'LLVM_PROF_FILE': '', 'LLVM_PROF_MERGER': 'true', 'LN': 'ln', 'LOCALMODLIBS': '-lexpat -L/usr/lib -lz -lexpat', 'LOG1P_DROPS_ZERO_SIGN': 0, 'MACHDEP': 'linux', 'MACHDEPPATH': ':plat-x86_64-linux-gnu', 'MACHDEPS': 'plat-x86_64-linux-gnu', 'MACHDEP_OBJS': '', 'MACHDESTLIB': '/usr/lib/python3.5', 'MACOSX_DEPLOYMENT_TARGET': '', 'MAINCC': 'x86_64-linux-gnu-gcc -pthread', 'MAJOR_IN_MKDEV': 0, 'MAJOR_IN_SYSMACROS': 0, 'MAKESETUP': '../Modules/makesetup', 'MANDIR': '/usr/share/man', 'MKDIR_P': '/bin/mkdir -p', 'MODLIBS': '-lexpat -L/usr/lib -lz -lexpat', 'MODNAMES': '_thread _signal array math _struct _random _elementtree _pickle ' '_datetime _bisect _heapq unicodedata fcntl spwd grp select ' '_socket _posixsubprocess _md5 _sha1 _sha256 _sha512 syslog ' 'binascii zlib pyexpat posix errno pwd _sre _codecs _weakref ' '_functools _operator _collections itertools atexit _stat time ' '_locale _io zipimport faulthandler _tracemalloc _symtable ' 'xxsubtype', 'MODOBJS': 'Modules/_threadmodule.o Modules/signalmodule.o ' 'Modules/arraymodule.o Modules/mathmodule.o Modules/_math.o ' 'Modules/_struct.o Modules/_randommodule.o ' 'Modules/_elementtree.o Modules/_pickle.o ' 'Modules/_datetimemodule.o Modules/_bisectmodule.o ' 'Modules/_heapqmodule.o Modules/unicodedata.o ' 'Modules/fcntlmodule.o Modules/spwdmodule.o Modules/grpmodule.o ' 'Modules/selectmodule.o Modules/socketmodule.o ' 'Modules/_posixsubprocess.o Modules/md5module.o ' 'Modules/sha1module.o Modules/sha256module.o ' 'Modules/sha512module.o Modules/syslogmodule.o ' 'Modules/binascii.o Modules/zlibmodule.o Modules/pyexpat.o ' 'Modules/posixmodule.o Modules/errnomodule.o ' 'Modules/pwdmodule.o Modules/_sre.o Modules/_codecsmodule.o ' 'Modules/_weakref.o Modules/_functoolsmodule.o ' 'Modules/_operator.o Modules/_collectionsmodule.o ' 'Modules/itertoolsmodule.o Modules/atexitmodule.o ' 'Modules/_stat.o Modules/timemodule.o Modules/_localemodule.o ' 'Modules/_iomodule.o Modules/iobase.o Modules/fileio.o ' 'Modules/bytesio.o Modules/bufferedio.o Modules/textio.o ' 'Modules/stringio.o Modules/zipimport.o Modules/faulthandler.o ' 'Modules/_tracemalloc.o Modules/hashtable.o ' 'Modules/symtablemodule.o Modules/xxsubtype.o', 'MODULE_OBJS': '\\', 'MULTIARCH': 'x86_64-linux-gnu', 'MVWDELCH_IS_EXPRESSION': 1, 'NO_AS_NEEDED': '-Wl,--no-as-needed', 'OBJECT_OBJS': '\\', 'OPCODETARGETGEN': '\\', 'OPCODETARGETGEN_FILES': '\\', 'OPCODETARGETS_H': '\\', 'OPCODE_H': '../Include/opcode.h', 'OPCODE_H_DIR': '../Include', 'OPCODE_H_GEN': 'python3.5 ../Tools/scripts/generate_opcode_h.py ' '../Lib/opcode.py ../Include/opcode.h', 'OPCODE_H_SCRIPT': '../Tools/scripts/generate_opcode_h.py', 'OPT': '-DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes', 'OTHER_LIBTOOL_OPT': '', 'PACKAGE_BUGREPORT': 0, 'PACKAGE_NAME': 0, 'PACKAGE_STRING': 0, 'PACKAGE_TARNAME': 0, 'PACKAGE_URL': 0, 'PACKAGE_VERSION': 0, 'PARSER_HEADERS': '\\', 'PARSER_OBJS': '\\ Parser/myreadline.o Parser/parsetok.o Parser/tokenizer.o', 'PGEN': 'Parser/pgen', 'PGENOBJS': '\\ \\', 'PGENSRCS': '\\ \\', 'PGOBJS': '\\', 'PGO_PROF_GEN_FLAG': '-fprofile-generate', 'PGO_PROF_USE_FLAG': '', 'PGSRCS': '\\', 'PLATDIR': 'plat-x86_64-linux-gnu', 'POBJS': '\\', 'POSIX_SEMAPHORES_NOT_ENABLED': 0, 'PROFILE_TASK': '-m test.regrtest --pgo -x test_asyncore test_gdb ' 'test_multiprocessing_fork test_multiprocessing_forkserver ' 'test_multiprocessing_main_handling ' 'test_multiprocessing_spawn test_subprocess', 'PSRCS': '\\', 'PTHREAD_SYSTEM_SCHED_SUPPORTED': 1, 'PURIFY': '', 'PY3LIBRARY': 'libpython3.so', 'PYLONG_BITS_IN_DIGIT': 0, 'PYTHON': 'python', 'PYTHONFRAMEWORK': '', 'PYTHONFRAMEWORKDIR': 'no-framework', 'PYTHONFRAMEWORKINSTALLDIR': '', 'PYTHONFRAMEWORKPREFIX': '', 'PYTHONPATH': ':plat-x86_64-linux-gnu', 'PYTHON_FOR_BUILD': './python -E', 'PYTHON_FOR_GEN': 'python3.5', 'PYTHON_HEADERS': '\\', 'PYTHON_OBJS': '\\', 'PY_CFLAGS': '-Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall ' '-Wstrict-prototypes -g ' '-fdebug-prefix-map=/build/python3.5-7CCmgg/python3.5-3.5.3=. ' '-fstack-protector-strong -Wformat -Werror=format-security -g ' '-flto -fuse-linker-plugin -ffat-lto-objects', 'PY_CFLAGS_NODIST': '-Werror=declaration-after-statement', 'PY_CORE_CFLAGS': '-Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 ' '-Wall -Wstrict-prototypes -g ' '-fdebug-prefix-map=/build/python3.5-7CCmgg/python3.5-3.5.3=. ' '-fstack-protector-strong -Wformat ' '-Werror=format-security ' '-Werror=declaration-after-statement -IObjects -IInclude ' '-IPython -I. -I../Include -Wdate-time -D_FORTIFY_SOURCE=2 ' '-fPIC -DPy_BUILD_CORE', 'PY_CPPFLAGS': '-IObjects -IInclude -IPython -I. -I../Include -Wdate-time ' '-D_FORTIFY_SOURCE=2', 'PY_FORMAT_LONG_LONG': '"ll"', 'PY_FORMAT_SIZE_T': '"z"', 'PY_LDFLAGS': '-Wl,-Bsymbolic-functions -Wl,-z,relro', 'Py_DEBUG': 0, 'Py_ENABLE_SHARED': 1, 'Py_HASH_ALGORITHM': 0, 'QUICKTESTOPTS': '-x test_subprocess test_io test_lib2to3 \\', 'RANLIB': 'x86_64-linux-gnu-gcc-ranlib', 'READELF': 'readelf', 'RESSRCDIR': 'Mac/Resources/framework', 'RETSIGTYPE': 'void', 'RUNSHARED': 'LD_LIBRARY_PATH=/build/python3.5-7CCmgg/python3.5-3.5.3/build-shared', 'SCRIPTDIR': '/usr/lib', 'SETPGRP_HAVE_ARG': 0, 'SGI_ABI': '', 'SHELL': '/bin/sh', 'SHLIBS': '-lpthread -ldl -lutil', 'SHLIB_SUFFIX': '.so', 'SIGNAL_OBJS': '', 'SIGNED_RIGHT_SHIFT_ZERO_FILLS': 0, 'SITEPATH': '', 'SIZEOF_DOUBLE': 8, 'SIZEOF_FLOAT': 4, 'SIZEOF_FPOS_T': 16, 'SIZEOF_INT': 4, 'SIZEOF_LONG': 8, 'SIZEOF_LONG_DOUBLE': 16, 'SIZEOF_LONG_LONG': 8, 'SIZEOF_OFF_T': 8, 'SIZEOF_PID_T': 4, 'SIZEOF_PTHREAD_T': 8, 'SIZEOF_SHORT': 2, 'SIZEOF_SIZE_T': 8, 'SIZEOF_TIME_T': 8, 'SIZEOF_UINTPTR_T': 8, 'SIZEOF_VOID_P': 8, 'SIZEOF_WCHAR_T': 4, 'SIZEOF__BOOL': 1, 'SO': '.cpython-35m-x86_64-linux-gnu.so', 'SOABI': 'cpython-35m-x86_64-linux-gnu', 'SRCDIRS': 'Parser Grammar Objects Python Modules Mac Programs', 'SRC_GDB_HOOKS': '../Tools/gdb/libpython.py', 'STDC_HEADERS': 1, 'STRICT_SYSV_CURSES': "/* Don't use ncurses extensions */", 'STRIPFLAG': '-s', 'SUBDIRS': '', 'SUBDIRSTOO': 'Include Lib Misc', 'SYSLIBS': '-lm', 'SYS_SELECT_WITH_SYS_TIME': 1, 'TANH_PRESERVES_ZERO_SIGN': 1, 'TCLTK_INCLUDES': '', 'TCLTK_LIBS': '', 'TESTOPTS': '', 'TESTPATH': '', 'TESTPYTHON': 'LD_LIBRARY_PATH=/build/python3.5-7CCmgg/python3.5-3.5.3/build-shared ' './python', 'TESTPYTHONOPTS': '', 'TESTRUNNER': 'LD_LIBRARY_PATH=/build/python3.5-7CCmgg/python3.5-3.5.3/build-shared ' './python ../Tools/scripts/run_tests.py', 'TESTTIMEOUT': 3600, 'THREADOBJ': 'Python/thread.o', 'TIMEMODULE_LIB': 0, 'TIME_WITH_SYS_TIME': 1, 'TM_IN_SYS_TIME': 0, 'UNICODE_DEPS': '\\', 'UNIVERSALSDK': '', 'USE_COMPUTED_GOTOS': 1, 'USE_INLINE': 1, 'VA_LIST_IS_ARRAY': 1, 'VERSION': '3.5', 'VPATH': '..', 'WANT_SIGFPE_HANDLER': 1, 'WINDOW_HAS_FLAGS': 1, 'WITH_DOC_STRINGS': 1, 'WITH_DYLD': 0, 'WITH_LIBINTL': 0, 'WITH_NEXT_FRAMEWORK': 0, 'WITH_PYMALLOC': 1, 'WITH_THREAD': 1, 'WITH_TSC': 0, 'WITH_VALGRIND': 0, 'X87_DOUBLE_ROUNDING': 0, 'XMLLIBSUBDIRS': 'xml xml/dom xml/etree xml/parsers xml/sax', 'abiflags': 'm', 'abs_builddir': '/build/python3.5-7CCmgg/python3.5-3.5.3/build-shared', 'abs_srcdir': '/build/python3.5-7CCmgg/python3.5-3.5.3/build-shared/..', 'base': '/mnt/data/home/stu/.virtualenvs/py3', 'datarootdir': '/usr/share', 'exec_prefix': '/usr', 'installed_base': '/mnt/data/home/stu/.virtualenvs/py3', 'installed_platbase': '/mnt/data/home/stu/.virtualenvs/py3', 'multiarchsubdir': '/x86_64-linux-gnu', 'platbase': '/mnt/data/home/stu/.virtualenvs/py3', 'prefix': '/usr', 'projectbase': '/mnt/data/home/stu/.virtualenvs/py3/bin', 'py_version': '3.5.3', 'py_version_nodot': '35', 'py_version_short': '3.5', 'srcdir': '/usr/lib/python3.5/config-3.5m-x86_64-linux-gnu', 'userbase': '/home/stu/.local'} ```

1 0

Issue #2664: panda3d - PyExc_ImportError (pypy/pypy)
by Stuart Axon 25 Sep '17

25 Sep '17

New issue 2664: panda3d - PyExc_ImportError https://bitbucket.org/pypy/pypy/issues/2664/panda3d-pyexc_importerror Stuart Axon: I built panda3d on pypy3.5 nightly - ``` $ git clone https://github.com/panda3d/panda3d $ cd panda3d $ python makepanda/makepanda.py --everything --wheel --no-egl --no-gles --no-gles2 --no-opencv --threads=8 ``` This generates a WHL but it needs to be renamed for pypy to install it: ``` $ pip install ./panda3d-1.10.0-cp35-cp35m-linux_x86_64.whl panda3d-1.10.0-cp35-cp35m-linux_x86_64.whl is not a supported wheel on this platform. ``` This lists compatible platforms: ``` $ python -c "import pip; print('\n'.join(['-'.join(platform) for platform in pip.pep425tags.get_supported()]))" | sort pp3510-none-any pp3510-none-linux_x86_64 pp3510-none-manylinux1_x86_64 pp3510-pypy3_510-linux_x86_64 pp3510-pypy3_510-manylinux1_x86_64 pp3-none-any py350-none-any py3510-none-any py351-none-any py352-none-any py353-none-any py354-none-any py355-none-any py356-none-any py357-none-any py358-none-any py359-none-any py3-none-any py3-none-linux_x86_64 py3-none-manylinux1_x86_64 ``` I made a copy (not fully knowing if the name was a good one) and installed: ``` $ cp panda3d-1.10.0-cp35-cp35m-linux_x86_64.whl panda3d-1.10.0-pp3510-pypy3_510-linux_x86_64.whl $ pip install ./panda3d-1.10.0-pp3510-pypy3_510-linux_x86_64.whl Processing ./panda3d-1.10.0-pp3510-pypy3_510-linux_x86_64.whl Installing collected packages: panda3d Successfully installed panda3d-1.10.0 ``` And then tried importing ``` $ python -c "from panda3d.core import *" Traceback (most recent call last): File "<string>", line 1, in <module> ImportError: /home/stu/.virtualenvs/pypy-nightly-py3.5/site-packages/panda3d/libp3interrogatedb.so.1.10: undefined symbol: PyExc_ImportError ``` The same PyExc_ImportError happens when trying to import any of the Panda3D native libraries that were built.

1 0

Issue #2663: regex package on python 3 uses PyUnicode_Substring and PyLong_FromUnicodeObject (pypy/pypy)
by Nathaniel Smith 22 Sep '17

22 Sep '17

New issue 2663: regex package on python 3 uses PyUnicode_Substring and PyLong_FromUnicodeObject https://bitbucket.org/pypy/pypy/issues/2663/regex-package-on-python-3-uses Nathaniel Smith: Trying to install the `regex` package on latest PyPy3 nightly gives: ``` cc -pthread -DNDEBUG -O2 -fPIC -I/home/njs/pypy/pypy-c-jit-92443-f368583e1d76-linux64/include -c regex_3/regex/_regex.c -o build/temp.linux-x86_64-3.5/regex_3/regex/_regex.o regex_3/regex/_regex.c: In function ‘unicode_slice’: regex_3/regex/_regex.c:17871:12: warning: implicit declaration of function ‘PyUnicode_Substring’; did you mean ‘_PyUnicode_AsString’? [-Wimplicit-function-declaration] return PyUnicode_Substring(string, start, end); ^~~~~~~~~~~~~~~~~~~ _PyUnicode_AsString regex_3/regex/_regex.c:17871:12: warning: return makes pointer from integer without a cast [-Wint-conversion] return PyUnicode_Substring(string, start, end); ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ regex_3/regex/_regex.c: In function ‘index_to_integer’: regex_3/regex/_regex.c:20194:19: warning: implicit declaration of function ‘PyLong_FromUnicodeObject’; did you mean ‘PyLong_FromUnicode’? [-Wimplicit-function-declaration] int_obj = PyLong_FromUnicodeObject(item, 0); ^~~~~~~~~~~~~~~~~~~~~~~~ PyLong_FromUnicode regex_3/regex/_regex.c:20194:17: warning: assignment makes pointer from integer without a cast [-Wint-conversion] int_obj = PyLong_FromUnicodeObject(item, 0); ^ ``` It looks like these are missing cpyext functions. See also: https://bitbucket.org/mrabarnett/mrab-regex/issues/253/run-into-error-under…

1 0

Issue #2662: Using memoryview to shift bytes is 18x slower than cPython (pypy/pypy)
by Taras Voynarovsky 22 Sep '17

22 Sep '17

New issue 2662: Using memoryview to shift bytes is 18x slower than cPython https://bitbucket.org/pypy/pypy/issues/2662/using-memoryview-to-shift-bytes… Taras Voynarovsky: I'm building a protocol and had a use case, where I prepare a moderate buffer (~16kb) and want to prepend a 4-byte integer before it for the size. Using memoryview to shift the buffer forward really slowed everything down. To reproduce I built a benchmark that moves 4 last bytes of a random string to beginning. ``` #!/usr/bin/env python3 import perf import random import hashlib MSG_LEN = 100000 md5_collect = hashlib.md5() def random_bytes(length): buffer = bytearray(length) for i in range(length): buffer[i] = random.randint(0, 255) return buffer def bench_copy(loops: int): msg = random_bytes(MSG_LEN) # Main benchmark code. t0 = perf.perf_counter() for _ in range(loops): msg = msg[-4:] + msg[:-4] res = perf.perf_counter() - t0 # Just to assert code is not optimized away md5_collect.update(msg) return res def bench_memview(loops: int): msg = random_bytes(MSG_LEN) # Main benchmark code. t0 = perf.perf_counter() for _ in range(loops): memview = memoryview(msg) end_bytes = memview[-4:].tobytes() memview[4:] = memview[:-4] memview[:4] = end_bytes memview.release() res = perf.perf_counter() - t0 # Just to assert code is not optimized away md5_collect.update(msg) return res runner = perf.Runner() runner.bench_time_func('batch_bytes', bench_copy) runner.bench_time_func('batch_memview', bench_memview) ``` CPython results: ``` (.aiokafka) vagrant@my-dev:/workspace/aiokafka$ python benchmark/test_pypy_memview.py ..................... batch_bytes: Mean +- std dev: 11.5 us +- 0.7 us ..................... batch_memview: Mean +- std dev: 4.64 us +- 0.28 us ``` PyPy results: ``` (.aiokafka-pypy3) vagrant@my-dev:/workspace/aiokafka$ python benchmark/test_pypy_memview.py ......... batch_bytes: Mean +- std dev: 15.9 us +- 1.1 us ......... batch_memview: Mean +- std dev: 83.2 us +- 4.9 us ``` To run the script install `perf`. `pip install perf` Versions: ``` PyPy 5.8.0-beta0 with GCC 6.2.0 cPython 3.5.2 [GCC 4.8.4] ```

1 0

Issue #2661: pypy3-5.8.0-with-lzma-fixes has slow xz decompression (pypy/pypy)
by strombrg 19 Sep '17

19 Sep '17

New issue 2661: pypy3-5.8.0-with-lzma-fixes has slow xz decompression https://bitbucket.org/pypy/pypy/issues/2661/pypy3-580-with-lzma-fixes-has-s… strombrg: pypy3-5.8.0-with-lzma-fixes appears to compress and decompress correctly, but decompression is slower than CPython 3.6's native lzma module's decompression. Compression is faster on Pypy3 with lzmafii than CPython 3.6 with its native lzma module. The decompression performance difference is a little over than 30%. Supporting detail: http://stromberg.dnsalias.org/svn/utime-performance-comparison/trunk/upc

1 0