How to avoid extra copying when forming an array from an iterator
24 Jun
2011
24 Jun
'11
7:35 a.m.
Hi, I have a iterator that yields a complex object. I want to make an array out of a numerical attribute that the yielded object possesses and that too very efficiently. My initial plan was to keep writing the numbers to a StringIO object and when done generate the numpy array using StringIO's buffer. But fromstring() method fails on the StringIO object, so does fromfile() or using the StringIO object as the initializer of an array object. After some digging I ran in to this ticket htt projects.scipy.org/numpy/ticket/1634 that has been assigned a low priority. Is there some other way to achieve what I am trying ? Efficiency is important because potentially millions of objects would be yielded. -- srean
4662
Age (days ago)
4662
Last active (days ago)
5 comments
2 participants
participants (2)
-
Robert Kern
-
srean