Python script seems to stop running when handling very large dataset

Shaozhong SHI shishaozhong at gmail.com
Sat Oct 30 19:34:40 EDT 2021


On Saturday, 30 October 2021, Dieter Maurer <dieter at handshake.de> wrote:

> Shaozhong SHI wrote at 2021-10-29 23:42 +0100:
> >Python script works well, but seems to stop running at a certain point
> when
> >handling very large dataset.
> >
> >Can anyone shed light on this?
>
> Some algorithms have non linear runtime.
>
>
> For example, it is quite easy to write code with
> quadratic runtime in Python:
>           s = ""
>           for x in ...: s += f(x)
> You will see the problem only for large data sets.
>

Has anyone compared this with iterrow?  which looping option is faster?
Regards, David


More information about the Python-list mailing list