Re: snapshot file problem

From: Volker Springel <vspringel_at_MPA-Garching.MPG.DE>
Date: Tue, 5 Oct 2021 23:35:08 +0200

Hi Weiguang,

> On 30. Sep 2021, at 22:49, Weiguang Cui <cuiweiguang_at_gmail.com> wrote:
>
> Hi Volker,
>
>
> If you do not have a snap_m200n2048_037.* files for the same output time, then a full snapshot dump wasn't activated in the output list for this time.
> I don't have the full snapshot files. But how can this happen? I simply updated to the latest version and added SUBFIND_ORPHAN_TREATMENT and excluded the lightcone options. I don't see why the simulation doesn't dump the snapshots.
> Thank you for your suggestions.
>
> Best,
> Weiguang
>
>
> Best,
> Volker
>
>
>
> > Is it because I asked to SUBFIND_STORE_LOCAL_DENSITY?
> > I thought that would only add additional fields to the snapshot.

Yes, this should not be resonsible for this.

How did you specify your output times? Have you done this with a list of output times? In this case, have you used a second column with a flag variable for each output time (0/1)? If you specify the flag, it needs to be 1 to get a full dump at the corresponding time, but if you specify a 0, you only get the snapshot with the most bound particles.

Cheers,
Volker




> >
> > Best,
> > Weiguang
> >
> > -------------------------------------------
> > https://weiguangcui.github.io/
> >
> >
> > On Thu, Sep 30, 2021 at 2:10 PM Volker Springel <vspringel_at_mpa-garching.mpg.de> wrote:
> >
> > Hi Weiguang,
> >
> > > On 30. Sep 2021, at 14:23, Weiguang Cui <cuiweiguang_at_gmail.com> wrote:
> > >
> > > Dear all,
> > >
> > > I recently encountered a problem of snapshot saving with this option on
> > > SUBFIND_STORE_LOCAL_DENSITY in the Config.sh file
> > >
> > > The snapshot seems broken:
> > > h5ls snapdir_037/snap_m200n2048-prevmostboundonly_037.0
> > > snapdir_037/snap_m200n2048-prevmostboundonly_037.0: unable to open file
> > >
> >
> > Are you sure the file isn't there? Try
> >
> > h5ls snapdir_037/snap_m200n2048-prevmostboundonly_037.0.hdf5
> >
> > Best,
> > Volker
> >
> >
> >
> > > While the log file for this saving part seems fine:
> > >
> > > SUBFIND: Subgroup catalogues saved. took = 8.55254 sec
> > > SUBFIND: Finished with SUBFIND. (total time=1354.58 sec)
> > > SUBFIND: Total number of subhalos with at least 32 particles: 8194200
> > > SUBFIND: Largest subhalo has 19083775 particles/cells.
> > > SUBFIND: Total number of particles/cells in subhalos: 4322986506
> > > FOF: preparing output order of particles took 101.057 sec
> > > MERGERTREE: writing descendant information file: './/groups_038/subhalo_desc_038.0' (file 1 of 32)
> > > MERGERTREE: writing descendant information block 0 (DescSubhaloNr)...
> > > MERGERTREE: writing descendant information block 1 (FirstDescSubhaloNr)...
> > > MERGERTREE: writing descendant information block 2 (NextProgSubhaloNr)..
> > > MERGERTREE: writing descendant information block 3 (SubhaloNr)...
> > > MERGERTREE: writing progenitor information file: './/groups_039/subhalo_prog_039.0' (file 1 of 32)
> > > MERGERTREE: writing progenitor information block 0 (ProgSubhaloNr)...
> > > MERGERTREE: writing progenitor information block 1 (FirstProgSubhaloNr)...
> > > MERGERTREE: writing progenitor information block 2 (NextDescSubhaloNr)..
> > > MERGERTREE: writing progenitor information block 3 (SubhaloNr)...
> > > MERGERTREE: Was able to identify descendants for 8105748 out of 8266010 subhalos, i.e. for a fraction of 0.980612
> > > MERGERTREE: We have found secondary descendants for 10600 halos out of 8194200 subhalos, i.e. for a fraction of 0.0012936
> > >
> > > SNAPSHOT: writing snapshot file #39 _at_ time 1 ...
> > > SNAPSHOT: writing snapshot file: './/snapdir_039/snap_m200n2048-prevmostboundonly_039.0' (file 1 of 32)
> > > SNAPSHOT: writing snapshot block 0 (Coordinates)...
> > > SNAPSHOT: writing snapshot block 1 (Velocities)...
> > > SNAPSHOT: writing snapshot block 2 (ParticleIDs)...
> > > SNAPSHOT: writing snapshot block 7 (SubfindDensity)...
> > > SNAPSHOT: writing snapshot block 8 (SubfindHsml)...
> > > SNAPSHOT: writing snapshot block 9 (SubfindVelDisp)...
> > > SNAPSHOT: done with writing snapshot. Took 20.3367 sec, total size 2591.43 MB, corresponds to effective I/O rate of 127.426 MB/sec
> > >
> > > SNAPSHOT: There is no valid time for a further snapshot file.
> > >
> > > Final time=1 reached. Simulation ends.
> > > RESTART: Writing restart files.
> > > RESTART: Backing up restart files...
> > > RESTART: done renaming pre-existing restart files to bak files.
> > > RESTART: Writing restart files group #1 out of 7...
> > > RESTART: Writing restart files group #2 out of 7...
> > > RESTART: Writing restart files group #3 out of 7..
> > > RESTART: Writing restart files group #4 out of 7...
> > > RESTART: Writing restart files group #5 out of 7...
> > > RESTART: Writing restart files group #6 out of 7...
> > > RESTART: Writing restart files group #7 out of 7...
> > > RESTART: done. load/save took 201.084 sec, total size 1.34741e+06 MB, corresponds to effective I/O rate of 6700.74 MB/sec
> > > endrun called, calling MPI_Finalize()
> > > bye!
> > >
> > > Please let me know if this has only happened to me.
> > >
> > > Best,
> > > Weiguang
> > >
> > > -------------------------------------------
> > > https://weiguangcui.github.io/
> > >
> > > -----------------------------------------------------------
> > >
> > > If you wish to unsubscribe from this mailing, send mail to
> > > minimalist_at_MPA-Garching.MPG.de with a subject of: unsubscribe gadget-list
> > > A web-archive of this mailing list is available here:
> > > http://www.mpa-garching.mpg.de/gadget/gadget-list
> >
> >
> >
> >
> > -----------------------------------------------------------
> >
> > If you wish to unsubscribe from this mailing, send mail to
> > minimalist_at_MPA-Garching.MPG.de with a subject of: unsubscribe gadget-list
> > A web-archive of this mailing list is available here:
> > http://www.mpa-garching.mpg.de/gadget/gadget-list
> >
> > -----------------------------------------------------------
> >
> > If you wish to unsubscribe from this mailing, send mail to
> > minimalist_at_MPA-Garching.MPG.de with a subject of: unsubscribe gadget-list
> > A web-archive of this mailing list is available here:
> > http://www.mpa-garching.mpg.de/gadget/gadget-list
>
>
>
>
> -----------------------------------------------------------
>
> If you wish to unsubscribe from this mailing, send mail to
> minimalist_at_MPA-Garching.MPG.de with a subject of: unsubscribe gadget-list
> A web-archive of this mailing list is available here:
> http://www.mpa-garching.mpg.de/gadget/gadget-list
>
> -----------------------------------------------------------
>
> If you wish to unsubscribe from this mailing, send mail to
> minimalist_at_MPA-Garching.MPG.de with a subject of: unsubscribe gadget-list
> A web-archive of this mailing list is available here:
> http://www.mpa-garching.mpg.de/gadget/gadget-list
Received on 2021-10-05 23:35:09

This archive was generated by hypermail 2.3.0 : 2022-09-01 14:03:43 CEST