Re: snapshot file problem

From: Volker Springel <vspringel_at_MPA-Garching.MPG.DE>
Date: Thu, 30 Sep 2021 17:55:55 +0200

Hi Weiguang,

> On 30. Sep 2021, at 15:57, Weiguang Cui <cuiweiguang_at_gmail.com> wrote:
>
> Hi Volker,
>
> Sorry, it is my bad, h5ls can open it. I may be in a different folder.
> But the snapshot file is definitely smaller than it should be. I guess it only saved part of the simulation particle data:
> ATTRIBUTE "NumPart_Total" {
> DATATYPE H5T_STD_U64LE
> DATASPACE SIMPLE { ( 6 ) / ( 6 ) }
> DATA {
> (0): 0, 61756984, 0, 0, 0, 0
> }
> }
> Which should be 2048^3.

No, not for the "prevmostboundonly" files. These are special partial snapshot dumps that will only occur if you activate SUBFIND_ORPHAN_TREATMENT, and which will only contain particles that have been a most-bound particle in a subhalo, either at the present time, or at any previous time where the group finder has been run. These files are there for semi-analytic galaxy formation purposes only (e.g. to locate the so-called orphaned type=2 galaxies in the L-Galaxies model), and contain at most a few percent of the particles.

If you do not have a snap_m200n2048_037.* files for the same output time, then a full snapshot dump wasn't activated in the output list for this time.

Best,
Volker



> Is it because I asked to SUBFIND_STORE_LOCAL_DENSITY?
> I thought that would only add additional fields to the snapshot.
>
> Best,
> Weiguang
>
> -------------------------------------------
> https://weiguangcui.github.io/
>
>
> On Thu, Sep 30, 2021 at 2:10 PM Volker Springel <vspringel_at_mpa-garching.mpg.de> wrote:
>
> Hi Weiguang,
>
> > On 30. Sep 2021, at 14:23, Weiguang Cui <cuiweiguang_at_gmail.com> wrote:
> >
> > Dear all,
> >
> > I recently encountered a problem of snapshot saving with this option on
> > SUBFIND_STORE_LOCAL_DENSITY in the Config.sh file
> >
> > The snapshot seems broken:
> > h5ls snapdir_037/snap_m200n2048-prevmostboundonly_037.0
> > snapdir_037/snap_m200n2048-prevmostboundonly_037.0: unable to open file
> >
>
> Are you sure the file isn't there? Try
>
> h5ls snapdir_037/snap_m200n2048-prevmostboundonly_037.0.hdf5
>
> Best,
> Volker
>
>
>
> > While the log file for this saving part seems fine:
> >
> > SUBFIND: Subgroup catalogues saved. took = 8.55254 sec
> > SUBFIND: Finished with SUBFIND. (total time=1354.58 sec)
> > SUBFIND: Total number of subhalos with at least 32 particles: 8194200
> > SUBFIND: Largest subhalo has 19083775 particles/cells.
> > SUBFIND: Total number of particles/cells in subhalos: 4322986506
> > FOF: preparing output order of particles took 101.057 sec
> > MERGERTREE: writing descendant information file: './/groups_038/subhalo_desc_038.0' (file 1 of 32)
> > MERGERTREE: writing descendant information block 0 (DescSubhaloNr)...
> > MERGERTREE: writing descendant information block 1 (FirstDescSubhaloNr)...
> > MERGERTREE: writing descendant information block 2 (NextProgSubhaloNr)..
> > MERGERTREE: writing descendant information block 3 (SubhaloNr)...
> > MERGERTREE: writing progenitor information file: './/groups_039/subhalo_prog_039.0' (file 1 of 32)
> > MERGERTREE: writing progenitor information block 0 (ProgSubhaloNr)...
> > MERGERTREE: writing progenitor information block 1 (FirstProgSubhaloNr)...
> > MERGERTREE: writing progenitor information block 2 (NextDescSubhaloNr)..
> > MERGERTREE: writing progenitor information block 3 (SubhaloNr)...
> > MERGERTREE: Was able to identify descendants for 8105748 out of 8266010 subhalos, i.e. for a fraction of 0.980612
> > MERGERTREE: We have found secondary descendants for 10600 halos out of 8194200 subhalos, i.e. for a fraction of 0.0012936
> >
> > SNAPSHOT: writing snapshot file #39 _at_ time 1 ...
> > SNAPSHOT: writing snapshot file: './/snapdir_039/snap_m200n2048-prevmostboundonly_039.0' (file 1 of 32)
> > SNAPSHOT: writing snapshot block 0 (Coordinates)...
> > SNAPSHOT: writing snapshot block 1 (Velocities)...
> > SNAPSHOT: writing snapshot block 2 (ParticleIDs)...
> > SNAPSHOT: writing snapshot block 7 (SubfindDensity)...
> > SNAPSHOT: writing snapshot block 8 (SubfindHsml)...
> > SNAPSHOT: writing snapshot block 9 (SubfindVelDisp)...
> > SNAPSHOT: done with writing snapshot. Took 20.3367 sec, total size 2591.43 MB, corresponds to effective I/O rate of 127.426 MB/sec
> >
> > SNAPSHOT: There is no valid time for a further snapshot file.
> >
> > Final time=1 reached. Simulation ends.
> > RESTART: Writing restart files.
> > RESTART: Backing up restart files...
> > RESTART: done renaming pre-existing restart files to bak files.
> > RESTART: Writing restart files group #1 out of 7...
> > RESTART: Writing restart files group #2 out of 7...
> > RESTART: Writing restart files group #3 out of 7..
> > RESTART: Writing restart files group #4 out of 7...
> > RESTART: Writing restart files group #5 out of 7...
> > RESTART: Writing restart files group #6 out of 7...
> > RESTART: Writing restart files group #7 out of 7...
> > RESTART: done. load/save took 201.084 sec, total size 1.34741e+06 MB, corresponds to effective I/O rate of 6700.74 MB/sec
> > endrun called, calling MPI_Finalize()
> > bye!
> >
> > Please let me know if this has only happened to me.
> >
> > Best,
> > Weiguang
> >
> > -------------------------------------------
> > https://weiguangcui.github.io/
> >
> > -----------------------------------------------------------
> >
> > If you wish to unsubscribe from this mailing, send mail to
> > minimalist_at_MPA-Garching.MPG.de with a subject of: unsubscribe gadget-list
> > A web-archive of this mailing list is available here:
> > http://www.mpa-garching.mpg.de/gadget/gadget-list
>
>
>
>
> -----------------------------------------------------------
>
> If you wish to unsubscribe from this mailing, send mail to
> minimalist_at_MPA-Garching.MPG.de with a subject of: unsubscribe gadget-list
> A web-archive of this mailing list is available here:
> http://www.mpa-garching.mpg.de/gadget/gadget-list
>
> -----------------------------------------------------------
>
> If you wish to unsubscribe from this mailing, send mail to
> minimalist_at_MPA-Garching.MPG.de with a subject of: unsubscribe gadget-list
> A web-archive of this mailing list is available here:
> http://www.mpa-garching.mpg.de/gadget/gadget-list
Received on 2021-09-30 17:56:33

This archive was generated by hypermail 2.3.0 : 2023-01-10 10:01:33 CET