memory consumption
Alexey
zen.supagood at gmail.com
Tue Mar 30 04:23:15 EDT 2021
понедельник, 29 марта 2021 г. в 19:56:52 UTC+3, Stestagg:
> > > 2. Can you try a test with 16 or 32 active workers (i.e. number of
> > > workers=2x available memory in GB), do they all still end up with 1gb
> > > usage? or do you get any other memory-related issues running this?
> > Yes. They will consume 1Gb each. It doesn't matter how many workers I
> > have,
> > they behave exactly the same. We can even forget about Flask and Celery.
> > If I run this code in Python console, behavior will remain the same.
> >
> >
> Woah, funky, so you got to a situation where your workers were allocating
> 2x more ram than your system had available? and they were still working?
> Were you hitting lots of swap?
>
> If no big swap load, then it looks like no problem, it's just that the
> metrics you're looking at aren't saying what they appear to be.
>
>
>
> > --
> > https://mail.python.org/mailman/listinfo/python-list
> >
I'm sorry. I didn't understand your question right. If I have 4 workers, they require 4Gb
in idle state and some extra memory when they execute other tasks. If I increase workers
count up to 16, they`ll eat all the memory I have (16GB) on my machine and will crash as soon
as system get swapped.
More information about the Python-list
mailing list