Re: Gadget4 hangs with a zoomed-in IC

From: Volker Springel <vspringel_at_MPA-Garching.MPG.DE>
Date: Sun, 13 Feb 2022 14:45:38 +0100

Hi Weiguang,

I examined this issue and am positive that this is a bug in the intel_mpi/2018 module you are using (Intel Parallel_Studio_XE_2018, 2018.2.199).

The code works fine at this place with intel_mpi/2020 or OpenMPI (openmpi/4.1.1 tested 4.1.1) on your machine Cosma6. So either use the module intel_mpi/2020 or the module openmpi/4.1.1.

Best,
Volker



> On 9. Feb 2022, at 20:49, Weiguang Cui <cuiweiguang_at_gmail.com> wrote:
>
> Hi Volker,
>
> Sorry for this late reply, Cosma is just back online.
> I have turned off ALLOW_HDF5_COMPRESSION and given it a try, but this does not help.
> All simulation data is saved in the cosma6 disk: /cosma6/data/dp004/dc-cui3/group-zoom/G4-test/
> Please let me know if you can not access it.
>
> Best,
> Weiguang
>
> -------------------------------------------
> https://weiguangcui.github.io/
>
>
> On Sun, Feb 6, 2022 at 10:53 AM Volker Springel <vspringel_at_mpa-garching.mpg.de> wrote:
>
> Hi Weiguang,
>
> Hm, this is interesting. The group finding via FoF/Subfind has fully completed, but then the code appears to hang in writing the group catalogue to disk in the function subfind_save_final().
>
> Could you perhaps try to switch off ALLOW_HDF5_COMPRESSION? (just a guess)
>
> Otherwise, since the problem is reproducable, it could also be an issue in the code logic related to the different particle types you have. To examine this, could you make your restart files available to me somehow?
>
> Best regards,
> Volker
>
> > On 30. Jan 2022, at 00:00, Weiguang Cui <cuiweiguang_at_gmail.com> wrote:
> >
> > Dear all,
> >
> > My test run with a zoomed-in IC generated with MUSIC hangs, the job is running, but no outputs in the log file and no error is reported. It seems that the program can not write group catalogues for this particular output redshift. I have checked several things: previous outputs are fine; there is no problem with my disk space or the memory cost; I have tried to tune several parameters, but it always hangs at the same step; the zoomed-in IC runs fine with GIZMO.
> > I attached the abridged log file, please let me know if you spot anything that is set unreasonably. Any suggestions are welcome. Thank you.
> >
> > Best,
> > Weiguang
> >
> > -------------------------------------------
> > https://weiguangcui.github.io/
> > <slurm.4849371.out>
> > -----------------------------------------------------------
> >
> > If you wish to unsubscribe from this mailing, send mail to
> > minimalist_at_MPA-Garching.MPG.de with a subject of: unsubscribe gadget-list
> > A web-archive of this mailing list is available here:
> > http://www.mpa-garching.mpg.de/gadget/gadget-list
>
>
>
>
> -----------------------------------------------------------
>
> If you wish to unsubscribe from this mailing, send mail to
> minimalist_at_MPA-Garching.MPG.de with a subject of: unsubscribe gadget-list
> A web-archive of this mailing list is available here:
> http://www.mpa-garching.mpg.de/gadget/gadget-list
>
> -----------------------------------------------------------
>
> If you wish to unsubscribe from this mailing, send mail to
> minimalist_at_MPA-Garching.MPG.de with a subject of: unsubscribe gadget-list
> A web-archive of this mailing list is available here:
> http://www.mpa-garching.mpg.de/gadget/gadget-list
Received on 2022-02-13 14:45:40

This archive was generated by hypermail 2.3.0 : 2022-09-01 14:03:43 CEST