[Python-ideas] Please consider skipping hidden directories in os.walk, os.fwalk, etc.
steve at pearwood.info
Tue May 8 03:05:23 EDT 2018
On Mon, May 07, 2018 at 06:05:15AM +0000, Steve Barnes wrote:
> In a lot of uses of os.walk it is desirable to skip version control
> directories, (which are usually hidden directories), to the point that
> almost all of the examples given look like:
> import os
> for root, dirs, files in os.walk(some_dir):
> if 'CVS' in dirs:
> dirs.remove('CVS') # or .svn or .hg etc.
> # do something...
I would write something like:
for root, dirs, files in filter(ignorable, os.walk(some_dir)):
where ignorable() is a function that returns False for whatever you want
I don't think we can possibly agree on a single definition of
"ignorable". This could include any combination of:
- dot files;
- files with the invisible bit set, for file systems which support that;
- files within certain directories;
- files ending in ~ (backup files);
- files with certain extensions;
Possibly this is a good use-case for composible functions, so we could
have a set of pre-built filters:
ignorable = invisible + dotfiles + directories('.git', '.hg') + extensions('~', '.pdf')
but that sounds like it ought to be a separate module, not built in.
More information about the Python-ideas