I just noticed an issue that arises when loading an ART simulation when using the yt.load() command. When I use the command ds = yt.load("VELA07/10MpcBox_csf512_a0.020.d"), I get this response yt : [INFO ] 2018-07-25 15:59:41,434 Using root level of 14 yt : [INFO ] 2018-07-25 15:59:41,460 Discovered 7 species of particles yt : [INFO ] 2018-07-25 15:59:41,461 Particle populations: 34930688 4943872 855040 139392 21776 2088309 0 yt : [INFO ] 2018-07-25 15:59:42,098 Max level is 06 yt : [INFO ] 2018-07-25 15:59:42,167 Parameters: current_time = 0.051136094792605884 Gyr yt : [INFO ] 2018-07-25 15:59:42,168 Parameters: domain_dimensions = [128 128 128] yt : [INFO ] 2018-07-25 15:59:42,168 Parameters: domain_left_edge = [0. 0. 0.] yt : [INFO ] 2018-07-25 15:59:42,169 Parameters: domain_right_edge = [1. 1. 1.] yt : [INFO ] 2018-07-25 15:59:42,170 Parameters: cosmological_simulation = True yt : [INFO ] 2018-07-25 15:59:42,170 Parameters: current_redshift = 48.70056421389564 yt : [INFO ] 2018-07-25 15:59:42,170 Parameters: omega_lambda = 0.7300000190734863 yt : [INFO ] 2018-07-25 15:59:42,170 Parameters: omega_matter = 0.27000001072883606 yt : [INFO ] 2018-07-25 15:59:42,171 Parameters: hubble_constant = 0.699999988079071 yt : [INFO ] 2018-07-25 15:59:42,350 discovered particle_header:/nobackupp2/sflarkin/VELA07/PMcrda0.410.DAT yt : [INFO ] 2018-07-25 15:59:42,351 discovered particle_data:/nobackupp2/sflarkin/VELA07/PMcrs0a0.320.DAT yt : [INFO ] 2018-07-25 15:59:42,352 discovered particle_stars:/nobackupp2/sflarkin/VELA07/stars_a0.390.dat The bottom three lines show that when I am loading the .020 snapshot, I am getting particle headers and data from entirely different snapshots. To address this, i used the file_particle_header specification, as listed her on the Loading Data page. http://yt-project.org/doc/examining/loading_data.html However, it appears that these commands do not support wildcards like * for reading multiple files, as when I changed my code to support this, I got this error. P002 yt : [ERROR ] 2018-07-25 15:43:39,114 FileNotFoundError: [Errno 2] No such file or directory: '/nobackupp2/sflarkin/VELA07test/PMcrda0*' Is there a way to specify the correct files that uses wildcards to load the proper data?
On Wed, Jul 25, 2018 at 6:03 PM,
I just noticed an issue that arises when loading an ART simulation when using the yt.load() command. When I use the command
ds = yt.load("VELA07/10MpcBox_csf512_a0.020.d"), I get this response
yt : [INFO ] 2018-07-25 15:59:41,434 Using root level of 14 yt : [INFO ] 2018-07-25 15:59:41,460 Discovered 7 species of particles yt : [INFO ] 2018-07-25 15:59:41,461 Particle populations: 34930688 4943872 855040 139392 21776 2088309 0 yt : [INFO ] 2018-07-25 15:59:42,098 Max level is 06 yt : [INFO ] 2018-07-25 15:59:42,167 Parameters: current_time = 0.051136094792605884 Gyr yt : [INFO ] 2018-07-25 15:59:42,168 Parameters: domain_dimensions = [128 128 128] yt : [INFO ] 2018-07-25 15:59:42,168 Parameters: domain_left_edge = [0. 0. 0.] yt : [INFO ] 2018-07-25 15:59:42,169 Parameters: domain_right_edge = [1. 1. 1.] yt : [INFO ] 2018-07-25 15:59:42,170 Parameters: cosmological_simulation = True yt : [INFO ] 2018-07-25 15:59:42,170 Parameters: current_redshift = 48.70056421389564 yt : [INFO ] 2018-07-25 15:59:42,170 Parameters: omega_lambda = 0.7300000190734863 yt : [INFO ] 2018-07-25 15:59:42,170 Parameters: omega_matter = 0.27000001072883606 yt : [INFO ] 2018-07-25 15:59:42,171 Parameters: hubble_constant = 0.699999988079071 yt : [INFO ] 2018-07-25 15:59:42,350 discovered particle_header:/nobackupp2/sflarkin/VELA07/PMcrda0.410.DAT yt : [INFO ] 2018-07-25 15:59:42,351 discovered particle_data:/nobackupp2/sflarkin/VELA07/PMcrs0a0.320.DAT yt : [INFO ] 2018-07-25 15:59:42,352 discovered particle_stars:/nobackupp2/sflarkin/VELA07/stars_a0.390.dat
The bottom three lines show that when I am loading the .020 snapshot, I am getting particle headers and data from entirely different snapshots.
To address this, i used the file_particle_header specification, as listed her on the Loading Data page. http://yt-project.org/doc/exam ining/loading_data.html
However, it appears that these commands do not support wildcards like * for reading multiple files, as when I changed my code to support this, I got this error.
P002 yt : [ERROR ] 2018-07-25 15:43:39,114 FileNotFoundError: [Errno 2] No such file or directory: '/nobackupp2/sflarkin/VELA07test/PMcrda0*'
Is there a way to specify the correct files that uses wildcards to load the proper data?
It looks like globbing like this isn't supported. It looks like it just opens the path that you pass in to the ARTDataset initializer directly and doesn't pass it through python's glob module: https://github.com/yt-project/yt/blob/master/yt/frontends/ art/data_structures.py#L317 For what it's worth, the code in the ART frontend hasn't been touched since 2015 and i'm sure there's lots of low-hanging fruit for improvement. I'd strongly encourage you to poke around inside, especially if you run into issues and are familiar with the ART data format. Pull requests are very welcome :) -Nathan
_______________________________________________ yt-users mailing list -- yt-users@python.org To unsubscribe send an email to yt-users-leave@python.org
Alright, will work on my currently pulled version, and will let the dev
channel know if I make any more finds/improvements.
On Wed, Jul 25, 2018 at 4:46 PM Nathan Goldbaum
On Wed, Jul 25, 2018 at 6:03 PM,
wrote: I just noticed an issue that arises when loading an ART simulation when using the yt.load() command. When I use the command
ds = yt.load("VELA07/10MpcBox_csf512_a0.020.d"), I get this response
yt : [INFO ] 2018-07-25 15:59:41,434 Using root level of 14 yt : [INFO ] 2018-07-25 15:59:41,460 Discovered 7 species of particles yt : [INFO ] 2018-07-25 15:59:41,461 Particle populations: 34930688 4943872 855040 139392 21776 2088309 0 yt : [INFO ] 2018-07-25 15:59:42,098 Max level is 06 yt : [INFO ] 2018-07-25 15:59:42,167 Parameters: current_time = 0.051136094792605884 Gyr yt : [INFO ] 2018-07-25 15:59:42,168 Parameters: domain_dimensions = [128 128 128] yt : [INFO ] 2018-07-25 15:59:42,168 Parameters: domain_left_edge = [0. 0. 0.] yt : [INFO ] 2018-07-25 15:59:42,169 Parameters: domain_right_edge = [1. 1. 1.] yt : [INFO ] 2018-07-25 15:59:42,170 Parameters: cosmological_simulation = True yt : [INFO ] 2018-07-25 15:59:42,170 Parameters: current_redshift = 48.70056421389564 yt : [INFO ] 2018-07-25 15:59:42,170 Parameters: omega_lambda = 0.7300000190734863 yt : [INFO ] 2018-07-25 15:59:42,170 Parameters: omega_matter = 0.27000001072883606 yt : [INFO ] 2018-07-25 15:59:42,171 Parameters: hubble_constant = 0.699999988079071 yt : [INFO ] 2018-07-25 15:59:42,350 discovered particle_header:/nobackupp2/sflarkin/VELA07/PMcrda0.410.DAT yt : [INFO ] 2018-07-25 15:59:42,351 discovered particle_data:/nobackupp2/sflarkin/VELA07/PMcrs0a0.320.DAT yt : [INFO ] 2018-07-25 15:59:42,352 discovered particle_stars:/nobackupp2/sflarkin/VELA07/stars_a0.390.dat
The bottom three lines show that when I am loading the .020 snapshot, I am getting particle headers and data from entirely different snapshots.
To address this, i used the file_particle_header specification, as listed her on the Loading Data page. http://yt-project.org/doc/examining/loading_data.html
However, it appears that these commands do not support wildcards like * for reading multiple files, as when I changed my code to support this, I got this error.
P002 yt : [ERROR ] 2018-07-25 15:43:39,114 FileNotFoundError: [Errno 2] No such file or directory: '/nobackupp2/sflarkin/VELA07test/PMcrda0*'
Is there a way to specify the correct files that uses wildcards to load the proper data?
It looks like globbing like this isn't supported. It looks like it just opens the path that you pass in to the ARTDataset initializer directly and doesn't pass it through python's glob module:
https://github.com/yt-project/yt/blob/master/yt/frontends/art/data_structure...
For what it's worth, the code in the ART frontend hasn't been touched since 2015 and i'm sure there's lots of low-hanging fruit for improvement. I'd strongly encourage you to poke around inside, especially if you run into issues and are familiar with the ART data format. Pull requests are very welcome :)
-Nathan
_______________________________________________ yt-users mailing list -- yt-users@python.org To unsubscribe send an email to yt-users-leave@python.org
_______________________________________________ yt-users mailing list -- yt-users@python.org To unsubscribe send an email to yt-users-leave@python.org
participants (3)
-
Nathan Goldbaum
-
Sean Larkin
-
sflarkin@ucsc.edu