Mailman 3 March 2020 - Pandas-dev

Domain and hosting
by Marc Garcia April 8, 2020

April 8, 2020

We've got a bit of a mess at the moment with the pandas domain and hosting. I'll try to leave things in a more reasonable way, but there are some decisions pending. My understanding from a thread in this list was that everybody was happy with using pandas.io, and we set up the domain for the new hosting, and also dev.pandas.io for the development version of the website (and the blog and anything published in our GitHub organization pages). >From the discussion in https://github.com/pandas-dev/pandas/issues/28528 seems like the preference is to keep the old pandas.pydata.org instead. Given that, I think we can get rid of the dev.pandas.io, and point pandas.pydata.org to the new server once it's ready. For the website, I think the agreement is to update it with the latest version from master. So, no dev.pandas.io. For the development (master) documentation, I think it can live in pandas.pydata.org/docs/dev/. The blog, I think the best is to have the posts as pages on the website, in a directory blog/, so we don't need to maintain separaterly, and it has the look and feel of the website. For the new hosting, I'll move everything (all old documentation versions) from the current server to the new one, and then set up that the website and the development docs are automatically updated. Tom, can you give me access to the current web server so I can fetch the data please? Once everything is working in the new server, we'll be able to see it in pandas.io, and when we're happy we can change the domain pandas.pydata.org to point to it, and disable pandas.io. Please let me know if there are objections to any of the above, otherwise I'll move forward. Cheers!

3 7

CSV Sniffer
by Gerrit van den Burg March 31, 2020

March 31, 2020

Dear pandas developers, I'm the author of CleverCSV, a drop-in replacement for the Python csv module with improved accuracy for dialect detection (compared to csv.Sniffer). CleverCSV achieves a 22% increase in accuracy over the Python Sniffer for non-standard csv files. See these links for more context: - https://towardsdatascience.com/handling-messy-csv-files-2ef829aa441d - https://github.com/alan-turing-institute/CleverCSV Since the pandas module uses the csv Sniffer to detect the dialect in the pd.read_csv function with sep=None, I was wondering whether there would be any interest in replacing this with CleverCSV. If so, I'd be happy to prepare a pull request. Kind regards, Gerrit van den Burg -- Gerrit J.J. van den Burg The Alan Turing Institute gertjanvandenburg.com The Alan Turing Institute is a limited liability company, registered in England with registered number 09512457. Our registered office is at British Library, 96 Euston Road, London, England, NW1 2DB. We are also a charity registered in England with charity number 1162533. DISCLAIMER: Although The Alan Turing Institute has taken reasonable precautions to ensure no viruses are present in this email, The Alan Turing Institute cannot accept responsibility for any loss or damage sustained as a result of computer viruses and the recipient must ensure that the email (and attachments) are virus free. While we take care to protect our systems from virus attacks and other harmful events, we give no warranty that this message (including attachments) is free of any virus or other harmful matter, and we accept no responsibility for any loss or damage resulting from the recipient receiving, opening or using it. E-mail transmission cannot be guaranteed to be secure or error-free as information could be intercepted, corrupted, lost, destroyed, arrive late or be incomplete. If you think someone may have interfered with this email, please contact the Alan Turing Institute by telephone only and speak to the person dealing with your matter or the Accounts Department. Fraudsters are increasingly targeting organisations and their affiliates, often requesting funds to be transferred to a different bank account. The Alan Turing’s bank details are contained within our terms of engagement. If you receive a suspicious or unexpected email from us, or purporting to have been sent on our behalf, particularly containing different bank details, please do not reply to the email, click on any links, open any attachments, or comply with any instructions contained within it, but contact our Accounts department by telephone. Our Transparency Notice found here - https://www.turing.ac.uk/transparency-notice sets out how and why we collect, store, use and share your personal data and it explains your rights and how to raise concerns with us.

3 2

ANN: Pandas 1.0.3 Released
by Tom Augspurger March 18, 2020

March 18, 2020

Hi all, I'm pleased to announce that pandas 1.0.3 is now available. This is a minor bug-fix release in the 1.0.x series and includes some regression fixes and bug fixes. We recommend that all users upgrade to this version. See the full whatsnew <https://pandas.pydata.org/docs/whatsnew/v1.0.3.html> for a list of all the changes. The release will be available on the defaults and conda-forge channels: conda install pandas Or via PyPI: python3 -m pip install --upgrade pandas Please report any issues with the release on the pandas issue tracker <https://github.com/pandas-dev/pandas/issues>. Thanks to all the contributors who made this release possible. - Tom

1 0

Discussion on standardized PyData "data frame protocol"
by Wes McKinney March 15, 2020

March 15, 2020

Input / feedback from the pandas development community on this thread that Gael (scikit-learn core developer) started would be useful https://discuss.ossdata.org/t/a-dataframe-protocol-for-the-pydata-ecosystem…

1 1

ANN: Pandas 1.0.2 released
by Tom Augspurger March 15, 2020

March 15, 2020

Hi all, I'm pleased to announce that pandas 1.0.2 is now available. This is a minor bug-fix release in the 1.0.x series and includes some regression fixes and bug fixes. We recommend that all users upgrade to this version. See the full whatsnew <https://pandas.pydata.org/docs/whatsnew/v1.0.2.html> for a list of all the changes. The release will be available on the defaults and conda-forge channels: conda install pandas Or via PyPI: python3 -m pip install --upgrade pandas Please report any issues with the release on the pandas issue tracker <https://github.com/pandas-dev/pandas/issues> Thanks to all the contributors who made this release possible. - Tom

1 0

March 2020 Dev Meeting
by Tom Augspurger March 10, 2020

March 10, 2020

The monthly dev meeting is tomorrow at 18:00 UTC. Note that your local time may be different than last month. The US had a DST transition last weekend, while Europe didn't. Our calendar is at https://pandas.pydata.org/docs/development/meeting.html#calendar Video Call: https://meet.google.com/hav-rmax-zjx Minutes: https://docs.google.com/document/u/1/d/1tGbTiYORHiSPgVMXawiweGJlBw5dOkVJLY-… Please add items you'd like to see discussed to the agenda. Tom

2 1

Use of __dunder__ methods in Pandas
by Abdur-Rahmaan Janhangeer March 5, 2020

March 5, 2020

Greetings list, I have a talk about dunder methods in Python (https://conference.mscc.mu/speaker/67604187-57c3-4be6-987c-ea4bef388ad3) I would like to also include a part about how Pandas makes use of dunder methods (if any). Would be grateful if i can get one or two cases / link to files that are relevent. Thank you!

1 0