Mailman 3 May 2023 - Pandas-dev

pandas new infrastructure (OVH donation)
by Marc Garcia Sept. 21, 2024

Sept. 21, 2024

Hi all, pandas has received a donation from OVHcloud <https://www.ovhcloud.com/> to support the project infrastructure, with OVHcloud public cloud credits (an initial amount of 10,000 EUR for a period of one year). OVH is open to sponsor longer term and also other projects of the ecosystem (or NumFOCUS as a whole), but we started with this to have feedback at a smaller scale first. The credits will be used initially for: - Hosting of the pandas website - Running the pandas benchmarks - Speeding up the project CI I detail next what I have in mind to set up for each. If anyone is interested in getting involved, or has ideas, comments... please let me know. I'll publish updates here as there is progress on this. Website: I'm planning to experiment on splitting the website in two (it'll be transparent for users). The website and the stable docs which receive most of the traffic can probably be stored in Cloudflare pages. We're already using Cloudflare as a CDN, so instead of using it as a cache, we can publish the documents there. The rest of the docs (old versions and the dev version) can be hosted in bucket storage of the OVHcloud. Response times may be a bit slower, but our website is bigger than the Cloudflare quota, and having old docs rarely accessed in a CDN seems unnecessary anyway. - Benchmarks: OVHcloud instances have guaranteed hardware, and we'll be checking if this is enough for the results of the benchmarks to be consistent over runs, or if there is too much variability and we need dedicated hardware. If consistency is good enough that would be great, since our benchmarks mostly use one core, and using dedicated hardware is likely to be a decent waste of resources, since most servers will likely have 16 cores or more. We'll discuss with OVH if dedicated hardware is needed, as at the moment their public cloud doesn't offer it (there is an alpha for providing dedicated instances, but we need to check with them). - Faster CI: Our GitHub runners are small, and most builds take around one hour or more to finish. We should be able to use bigger OVH instances for our existing CI pretty easily, via their OpenStack API and CIrun.

5 9

February 2023 bi-monthly community meeting (Wednesday February 8, UTC 18:00)
by Joris Van den Bossche Sept. 11, 2024

Sept. 11, 2024

Hi all, A late reminder that the next bi-monthly (twice a month) dev call is today in a bit more than 1 hour (Wednesday, February 8) at 18:00 UTC. Our calendar is at https://pandas.pydata.org/docs/development/meeting.html#calendar to check your local time. The pandas Community Meeting is a regular sync meeting for the project's maintainers which is open to the community. All are welcome to attend! Video Call: https://us06web.zoom.us/j/84484803210?pwd=TjUxNmcyNHcvcG9SNGJvbE53Y21GZz09 Meeting notes: https://docs.google.com/document/u/1/d/1tGbTiYORHiSPgVMXawiweGJlBw5dOkVJLY-… Joris

1 1

Is it time for a bi-weekly pandas call?
by Marco Gorelli May 13, 2024

May 13, 2024

Currently, there's a monthly pandas call, which has been in place for several years. Seeing as there's now more people working on pandas as part of their jobs, might it be time to increase the frequency? E.g. to meet every 2 weeks, instead of once a month?

6 11

PandasAI
by Gabriele Venturi May 29, 2023

May 29, 2023

Dear sirs, let me introduce myself. I’m Gabriele, author of PandasAI, a library that aims to wrap pandas in a conversational layer. I’m reaching out to you since yesterday a GitHub user pointed out that calling the repo “PandasAI” could be considered unethical or misleading. When I launched the library, I just picked the most obvious name: since I was adding AI on the top of the pandas library, PandasAI just made a lot of sense to me. However, I don’t want to offend anyone or being unethical, this has never been the idea. That’s why I’m reaching out to you. I’d love to get your feedback about it, and if you believe the name has to be changed, I can definitely rename it. Thanks a lot for your time. Best, Gabriele

2 2

ANN: pandas v2.0.2
by Marc Garcia May 29, 2023

May 29, 2023

We are pleased to announce the release of pandas v2.0.2. This is a patch release in the 2.0.x series and includes some regression fixes and bug fixes. We recommend that all users in the 2.0.x series upgrade to this version. See the release notes <https://pandas.pydata.org/docs/whatsnew/v2.0.2.html> for a list of all the changes. The release can be installed from PyPI python -m pip install --upgrade pandas==2.0.2 Or from conda-forge mamba install -c conda-forge pandas==2.0.2 Please report any issues with the release on the pandas issue tracker <https://github.com/pandas-dev/pandas/issues/new/choose>. Thanks to all the contributors <https://pandas.pydata.org/docs/whatsnew/v2.0.2.html#contributors> who made this release possible.

1 0

Typo in the documentation
by Bhavani Shankar May 24, 2023

May 24, 2023

Hi, In the section: “How do I select specific rows and columns from a DataFrame? In the following snippet the value 3 means 4th column.: In [26]: titanic.iloc[0:3, 3] = "anonymous" But in the sentence “When selecting specific rows and/or columns with loc or iloc, new values can be assigned to the selected data. For example, to assign the name anonymous to the first 3 elements of the third column:” . The word highlighted in bold talks about 3rd column. Please correct it. Thank you. Best Regards, Bhavani Shankar. Ref: How do I select a subset of a DataFrame? — pandas 2.0.1 documentation (pydata.org)<https://pandas.pydata.org/docs/getting_started/intro_tutorials/03_subset_da…>

2 1

Re: [Pandas-dev] Pandas-dev Digest, Vol 120, Issue 2
by Marco Gorelli May 4, 2023

May 4, 2023

Thanks all for your comments here, some good points have been raised! The maintainers' guide <https://pandas.pydata.org/docs/dev/development/maintaining.html> doesn't have any guidelines around "needs triage", so I'll put something together based on the points brought up here On Wed, May 3, 2023 at 2:19 PM <pandas-dev-request(a)python.org> wrote: > Send Pandas-dev mailing list submissions to > pandas-dev(a)python.org > > To subscribe or unsubscribe via the World Wide Web, visit > https://mail.python.org/mailman/listinfo/pandas-dev > or, via email, send a message with subject or body 'help' to > pandas-dev-request(a)python.org > > You can reach the person managing the list at > pandas-dev-owner(a)python.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Pandas-dev digest..." > > > Today's Topics: > > 1. Re: Triage (Richard Shadrach) > 2. Re: Triage (Simon Hawkins) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Wed, 3 May 2023 08:05:18 -0400 > From: Richard Shadrach <rhshadrach(a)gmail.com> > To: Dea Mar?a <deamarialeon(a)gmail.com> > Cc: Marc Garcia <garcia.marc(a)gmail.com>, pandas-dev > <pandas-dev(a)python.org> > Subject: Re: [Pandas-dev] Triage > Message-ID: > <CAJ= > 56RJxsvWn+zbh_RCExq7LeMPvxQCKahy2oEUhLBo0xPFNHQ(a)mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > I've always thought triage is more than labeling an issue. If it's a bug, I > consider triage as confirming it (a) exists on main (even if the user says > they did) and (b) confirming it is indeed undesired behavior. If it's > reported as a regression then in addition I think it should be confirmed it > does exist on the previous version of pandas. > > All of this can be time intensive. However, I can quickly go through the > recently reported issues and appropriately label them so that they are more > visible to other developers who specialize in those areas of the code. When > I do this but not the above steps, I leave the Needs Triage on. > > I'm interested to hear thoughts and feedback here, and if there is a more > desirable way. > > Best, > Richard > > > > On Wed, May 3, 2023, 06:07 Dea Mar?a <deamarialeon(a)gmail.com> wrote: > > > I just meant that in many cases people forget to remove the ?needs > triage? > > label after having done the triage. > > > > > > > > On Wed, May 3, 2023 at 11:43?AM Marc Garcia <garcia.marc(a)gmail.com> > wrote: > > > >> Not sure if other set the label manually, but I assumed in most cases > the > >> label is applied automatically by our issue templates. Regular users > can't > >> set labels themselves afaik. And if I set labels manually, I consider I > >> already did the triage so I don't set that label. > >> > >> Thanks for letting us know, this is helpful, if you still find the issue > >> after the message, it may be worth discussing the workflow with the > exact > >> person (in the issue log you should be able to see who changes the > labels. > >> > >> > >> > >> On Wed, May 3, 2023, 10:21 Dea Mar?a <deamarialeon(a)gmail.com> wrote: > >> > >>> Dear All, > >>> > >>> > >>> If you are helping with triage, it would be nice if you could also > >>> remove the ?needs triage? label after labelling the issue. > >>> > >>> > >>> Sometimes the person who reported the issue also sets the labels. So, > it > >>> is not obvious if the labeling was done by a core-dev or not until I > open > >>> the issue. > >>> > >>> Sure, it only takes a few seconds to find that my ?extremely important? > >>> help ;-) is not needed. But newcomers? time is also valuable. > >>> > >>> > >>> Please help us help you. :) > >>> > >>> > >>> Thanks, > >>> > >>> Dea > >>> _______________________________________________ > >>> Pandas-dev mailing list > >>> Pandas-dev(a)python.org > >>> https://mail.python.org/mailman/listinfo/pandas-dev > >>> > >> _______________________________________________ > > Pandas-dev mailing list > > Pandas-dev(a)python.org > > https://mail.python.org/mailman/listinfo/pandas-dev > > >

2 1

Triage
by Dea María May 3, 2023

May 3, 2023

Dear All, If you are helping with triage, it would be nice if you could also remove the “needs triage” label after labelling the issue. Sometimes the person who reported the issue also sets the labels. So, it is not obvious if the labeling was done by a core-dev or not until I open the issue. Sure, it only takes a few seconds to find that my “extremely important” help ;-) is not needed. But newcomers’ time is also valuable. Please help us help you. :) Thanks, Dea

5 5