code-quality February 2018

code-quality@python.org

13 participants
7 discussions

Request to add project Bandit to the PyCQA

by Eric Brown

Hello, This is a formal request to add the Bandit security linter project to the PyCQA. It’s currently part of the OpenStack umbrella, but myself as a core maintainer and others have general agreement that it would better be suited under the PyCQA since this is a tool used to create more quality code and has very little to do with OpenStack. The code can be found on GitHub here: https://github.com/openstack/bandit But that repo is a mirror of: https://git.openstack.org/cgit/openstack/bandit Let me know if you have any more questions. Thanks!

3 years, 7 months

Training many large images on a GPU

by Hal P.

Hello, I hope you are doing fine. I just have a question, and thought you might have an idea on it. I have some large images (i.e. 1000x1000 pixels), and would like to train a convolutional neural network on those images. I used a GPU instance from Amazon Web Service (AWS), but the training takes much time, although I picked a kind of fast instance. My question is, would there be a better way to train such large images, especially that they will be increasing in number day after day, and thus expecting to have a kind of large dataset. At the moment, I'm feeding all my data to the network and waiting until all the epochs run on the dataset. I thought of may running the epochs on smaller numbers, saving the model, and building on that, but for the first small images I used, I got the accuracy of "0", and wasn't thus sure of the reliability of using this model for the next batch of images. Is there a way to train a large dataset with large images better than just feeding all the data in the network and waiting, which might sometimes take day, or that would be the normal case, and what I'm currently doing (feeding all the dataset) would be the correct way? Thanks so much, and apologize for my disturbance.

3 years, 8 months

Snekchek revision

by Martmists

Hello PyCQA members, As an update to my earlier email conversation, I'm happy to announce snekchek (IzunaDevs/SnekChek) is getting close to being stable enough to use for most users. I'm aware the discord-python org is already using it for most projects, and they've been a great source of errors and debugging, as well as possible issues that could be caused. Furthermore, a user has made a plugin for Atom to use snekchek, over at IzunaDevs/atom-snekchek I look forward to hearing from you, also regarding points from my first email (which was with Ian Stapleton) ~ Martmists

3 years, 8 months

E122 continuation line missing indentation or outdented

by Madeleine Thompson

I have what I think may be a bug in flake8. Consider this source file, test.py: open({ 'a': len([1, 2, 3]), 'b': [ 'c' ] }) open({ 'a': False, 'b': [ 'c' ] }) Notice that the two blocks only differ in the call to "len." If I run flake8 on it: $ flake8 test.py test.py:6:5: E122 continuation line missing indentation or outdented It passes without errors if I move the "]" on line 6 to under the open-quote in 'c'. I believe this file should pass flake8 without errors. But, if it doesn't, it should have two errors, not one. Version information: $ python -V Python 3.5.2 $ flake8 --version 3.5.0 (mccabe: 0.6.1, pycodestyle: 2.3.1, pyflakes: 1.6.0) CPython 3.5.2 on Linux Also replicated on a fresh Docker container based on ubuntu:bionic with Python 3.6.4 (nothing installed but the base image, python3, python3-pip, and the pypi version of flake8). Thanks!

3 years, 8 months

Flake8 "globals"

by Chris Norman

Hi everyone, I've been using pyflakes and now flake8 for a while and honestly it's probably the second-most used program on my computer, second only to Python. I am a very happy customer and want to extend my warmest gratitude to the creators and maintainers! I have a suggestion which I suspect is already implemented I just don't know how to find the option: Using Flake8, I want to be able to set up globals like you can with eslint. This should allow me to say that there are globals present in the file which aren't currently there. I get that the use case is kind of non standard: I am evaling code found in an arbitrary, and of coruse that code is inheriting the globals and locals from the main script. To this end, I want to be able to do more than just put # noqa: F821 at the end of each line that contains one of the locals.. that is very inconvenient and runs the high risk of suppressing a real live issue. Is this already done? If not should I open an issue on Gitlab? I'd be more than happy to dig in and try make a fix for this myself but I have no idea how flake8 works ETC, so if I could be given some pointers on where to start that would be awesome, even if those pointers are simply RTFM! :) Thank you all so much, and I hope everyone is having a wonderful day.

3 years, 8 months

by Chris Norman

3 years, 8 months

Pylint hosting on ReadTheDocs prevents successful searches

by Quantum Mechanic

Googling for "pylint pylintrc" gives me the first hit as https://docs.pylint.org/en/1.6.0/run.html. This lands me on https://docs.pylint.org/en/1.6.0/run.html, asking me to login. I have a login, and clicking "Login" sends me to https://readthedocs.org/dashboard/, spoiling the google search. In fact, searching on google only shows me that something might be there. I have to search *again* on ReadTheDocs, which isn't friendly at all. Poking around until I find a search box at https://pylint.readthedocs.io/en/latest/, I type in "pylintrc", which returns the *same bloody page* (OK, yes, it has this helpful bit: https://pylint.readthedocs.io/en/latest/?highlight=pylintrc, which does exactly...nothing.) So I'm stuck trolling around in the full docs there. Instead, I should just pull down the source code, and do my own grep -r. I feel like I've been violated. -- -QM Quantum Mechanics: The dreams stuff is made of

3 years, 8 months

2021

2020

2019

2018

2017

2016

2015

2014

2013

code-quality February 2018