Python script seems to stop running when handling very large dataset
shishaozhong at gmail.com
Sat Oct 30 19:34:40 EDT 2021
On Saturday, 30 October 2021, Dieter Maurer <dieter at handshake.de> wrote:
> Shaozhong SHI wrote at 2021-10-29 23:42 +0100:
> >Python script works well, but seems to stop running at a certain point
> >handling very large dataset.
> >Can anyone shed light on this?
> Some algorithms have non linear runtime.
> For example, it is quite easy to write code with
> quadratic runtime in Python:
> s = ""
> for x in ...: s += f(x)
> You will see the problem only for large data sets.
Has anyone compared this with iterrow? which looping option is faster?
More information about the Python-list