Mailman 3 November 2020 - Pandas-dev

Re: [Pandas-dev] A case for a simplified (non-consolidating) BlockManager with 1D blocks
by Brock Mendel Dec. 17, 2021

Dec. 17, 2021

> We actually *have* prototypes: the prototype of the split-policy discussed AFAICT that is a 5 year old branch. Is there a version of this based off of master that you can show asv results for? > Also, if performance is in the end the decisive criterion, I repeat my earlier remark in this thread: we need to be clearer about what we want / expect. In principle, this is pretty much exactly what the asvs are supposed to represent. ---- You have demonstrated that you are willing to repeat yourself more than I am, to the point that I find pandas interactions more frustrating than fulfilling. I'm going to step away for a little while. On Thu, Jun 11, 2020 at 1:29 PM Daniel Scott <scottdaniel539(a)yahoo.com> wrote: > > > Sent from Yahoo Mail on Android > <https://go.onelink.me/107872968?pid=InProduct&c=Global_Internal_YGrowth_And…> > > On Thu, Jun 11, 2020 at 3:10 PM, Joris Van den Bossche > <jorisvandenbossche(a)gmail.com> wrote: > _______________________________________________ > Pandas-dev mailing list > Pandas-dev(a)python.org > https://mail.python.org/mailman/listinfo/pandas-dev > >

2 6

How to export Jupyter notebook to a .py file?
by Shaozhong SHI Nov. 24, 2020

Nov. 24, 2020

We would like to save Jupyter notebook and run it as a .py file. However, it appears not to be that simple. I did the following, and got errors such as the following. python cqc.py Traceback (most recent call last): File "cqc.py", line 4, in <module> import pandas as pd ImportError: No module named pandas What else should I ask our system administrator to do, so that we can simply save Jupyter Notebook content and run it as a .py file. Regards, David

2 1

Can a script developed in Jupyter Notebook be simply run as a .py file?
by Shaozhong SHI Nov. 23, 2020

Nov. 23, 2020

Hi, Can a script developed in Jupyter Notebook be simply run as a .py file? Can one copy and paste the content of a notebook and run as a .py file, once it is fully developed? Regarcs, David

1 0

Faster .apply natively
by Abdur-Rahmaan Janhangeer Nov. 23, 2020

Nov. 23, 2020

Greetings list, I would like to know if there are plans on working on a faster .apply . A normal NLP function of reducing a sentence to it's essential lowercase version in 10 lines of list-comprehension processing takes an eternity for the ten of thousands rows. There are some 6 solutions like pandarallel etc which allows faster processing. But any hints if there is ongoing works in that direction? Kind Regards, Abdur-Rahmaan Janhangeer about <https://compileralchemy.github.io/> | blog <https://abdur-rahmaanj.github.io/> github <https://github.com/Abdur-RahmaanJ> Mauritius

3 3

Additional Funding from CZI
by Tom Augspurger Nov. 20, 2020

Nov. 20, 2020

Hi all, I wanted to share that pandas has received additional funding from CZI, as part of the 3rd round of their EOSS program. We wrote a post at describing the proposal: http://dev.pandas.io/pandas-blog/pandas-receives-czi-funding.html <http://dev.pandas.io/pandas-blog/pandas-receives-czi-funding.html> Tom

1 0

NASA Funding opportunity
by Tom Augspurger Nov. 17, 2020

Nov. 17, 2020

Hi all, NASA has a new CFP that's focused on supporting existing open-source projects. https://nspires.nasaprs.com/external/solicitations/summary.do?solId=%7b958C… 1.1 Motivation Open source software tools, libraries, and frameworks play an increasingly prominent role in SMD-related science research and applications. As the adoption of open software accelerates the rate of scientific discovery, the National Academies’ has recognized the growing need among the NASA science community to provide sustained support and maintenance of these types of software in their 2018 report Open Source Software Policy Options for NASA Earth and Space Sciences. This program is designed to provide support to the sustainable development of open source software, tools, libraries, and framework that are critical for SMD scientific objectives. 1.2 Objectives SMD seeks proposals for the improvement and sustainment of high-value, open source tools, frameworks, and libraries that have made significant impacts to the SMD science community. We are seeking proposals that satisfy the following objectives: • Open source software tools, libraries, and frameworks that have significant usage in the NASA science community, developed following open and collaborative practices, and are aligned with the scientific vision and data strategic plan of SMD. • Proposals should look to improve the sustainability and utility of these packages through improvements to adding extensions, documentation, infrastructure, and maintenance of the software. This program seeks to support projects under active development and usage, and it does not support updating of legacy software that is no longer supported, which can be supported under other calls. We are not soliciting the development of new open source tools, frameworks, or libraries with this call. I'm not sure exactly what our chances to get funded will be compared to projects more squarely in the science domain, but this may be worth pursing. Is anyone interested in collaborating on a proposal? Timeline, we'd file a notice of intent by November 19th, and the proposal by January 19th. Tom Tom

4 5

Drop all columns which are not normal numeric nor text values
by Shaozhong SHI Nov. 16, 2020

Nov. 16, 2020

After applying myDF = json_normalize(result) We get brandId brandName careHome constituency currentRatings.overall.keyQuestionRatings currentRatings.overall.rating currentRatings.overall.reportDate currentRatings.overall.reportLinkId currentRatings.reportDate dormancy ... providerId region registrationDate registrationStatus regulatedActivities relationships reports specialisms type uprn 0 BD510 BRAND MACC Care Y Birmingham, Northfield [{u'reportDate': u'2020-10-01', u'rating': u'R... Requires improvement 2020-10-01 1157c975-c2f1-423e-a2b4-66901779e014 2020-10-01 N ... 1-101641521 West Midlands 2013-12-16 Registered [{u'code': u'RA2', u'name': u'Accommodation fo... [] [{u'reportDate': u'2020-10-01', u'linkId': u'1... [{u'name': u'Caring for adults over 65 yrs'}, ... Social Care Org 100070537642 How to replace or drop all columns which are neither numeric nor text values? What is the fastest way? Regards, David

2 1

Loop over and add new columns
by Shaozhong SHI Nov. 16, 2020

Nov. 16, 2020

Hi, I got a very strange error with such a simple loop. Can anyone explain why? x={u'brandId': u'BD398', u'brandName': u'BRAND Innomary', u'careHome': u'Y', u'constituency': u'Hastings and Rye', u'dormancy': u'N', u'inspectionAreas': [], u'inspectionDirectorate': u'Adult social care', u'localAuthority': u'East Sussex', u'locationId': u'1-1000210669', u'mainPhoneNumber': u'01424716303', u'name': u'Kingswood House Nursing Home', u'numberOfBeds': 22, u'odsCode': u'VM4G6', u'onspdCcgCode': u'E38000235', u'onspdCcgName': u'NHS East Sussex CCG', u'onspdLatitude': 50.857239, u'onspdLongitude': 0.561998, u'organisationType': u'Location', u'postalAddressCounty': u'East Sussex', u'postalAddressLine1': u'21-23 Chapel Park Road', u'postalAddressTownCity': u'St Leonards On Sea', u'postalCode': u'TN37 6HR', u'providerId': u'1-877912132', u'region': u'South East', u'registrationDate': u'2013-12-12', u'registrationStatus': u'Registered', u'type': u'Social Care Org', u'uprn': u'100062576733'} import pandas as pd my_df =pd.DataFrame() for col_name in x.items(): my_df[col_name]=x[col_name] my_df Much obliged. Regards, David

1 0

Pandas style guide and best practices
by Josh Levy-Kramer Nov. 9, 2020

Nov. 9, 2020

Hi all, I'm currently writing a Pandas style guide and excited to share it with you. It's an accumulation of ideas I have picked up from 5+ years of using Pandas at work in a variety of projects. I would love to get feedback, opinion and contributions from the wider Pandas community. Please have a read: https://github.com/joshlk/pandas_style_guide Josh

1 0