Shared memory islands host a minimum of 56 and a maximum of 56 MPI ranks. We shall use 32 MPI ranks in total for assisting one-sided communication (2 per shared memory node). ___ __ ____ ___ ____ ____ __ / __) /__\ ( _ \ / __)( ___)(_ _)___ /. | ( (_-. /(__)\ )(_) )( (_-. )__) )( (___)(_ _) \___/(__)(__)(____/ \___/(____) (__) (_) This is Gadget, version 4.0. Git commit unknown, unknown Code was compiled with the following compiler and flags: mpiicpc -std=c++11 -ggdb -O3 -march=native -Wall -Wno-format-security -I/sc/home/ken.osato/usr/include -I/sc/home/ken.osato/usr/include -I/sc/home/ken.osato/usr/include -Ibuild -Isrc Code was compiled with the following settings: CREATE_GRID DOUBLEPRECISION=2 FOF IDS_64BIT LEAN MPI_MESSAGE_SIZELIMIT_IN_MB=100 NGENIC=2048 NGENIC_2LPT NSOFTCLASSES=1 NTYPES=2 NUMBER_OF_MPI_LISTENERS_PER_NODE=2 PERIODIC PMGRID=2048 POSITIONS_IN_32BIT POWERSPEC_ON_OUTPUT PRESERVE_SHMEM_BINARY_INVARIANCE RANDOMIZE_DOMAINCENTER SELFGRAVITY SUBFIND SUBFIND_STORE_LOCAL_DENSITY TREEPM_NOTIMESPLIT Running on 1760 MPI tasks. BEGRUN: Size of particle structure 64 [bytes] BEGRUN: Size of sph particle structure 96 [bytes] BEGRUN: Size of gravity tree node 72 [bytes] BEGRUN: Size of neighbour tree node 112 [bytes] BEGRUN: Size of subfind auxiliary data 88 [bytes] ------------------------------------------------------------------------------------------------------------------------- AvailMem: Largest = 1529335.04 Mb (on task= 330), Smallest = 1528996.30 Mb (on task= 660), Average = 1529112.73 Mb Total Mem: Largest = 1544305.61 Mb (on task= 220), Smallest = 1544305.60 Mb (on task= 330), Average = 1544305.60 Mb Committed_AS: Largest = 15309.30 Mb (on task= 660), Smallest = 14970.56 Mb (on task= 330), Average = 15192.88 Mb SwapTotal: Largest = 8191.00 Mb (on task= 0), Smallest = 8191.00 Mb (on task= 0), Average = 8191.00 Mb SwapFree: Largest = 8191.00 Mb (on task= 0), Smallest = 8154.57 Mb (on task=1430), Average = 8179.50 Mb AllocMem: Largest = 15309.30 Mb (on task= 660), Smallest = 14970.56 Mb (on task= 330), Average = 15192.88 Mb avail /dev/shm: Largest = 1389864.82 Mb (on task= 330), Smallest = 1389856.71 Mb (on task=1126), Average = 1389860.32 Mb ------------------------------------------------------------------------------------------------------------------------- Task=0 has the maximum commited memory and is host: cn0098 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Obtaining parameters from file 'param.txt': InitCondFile ./dummy.dat OutputDir ./output SnapshotFileBase snapshot OutputListFilename outputs.txt ICFormat 1 SnapFormat 3 TimeLimitCPU 86400 CpuTimeBetRestartFile 7200 MaxMemSize 12000 TimeBegin 0.015625 TimeMax 1 ComovingIntegrationOn 1 Omega0 0.3089 OmegaLambda 0.6911 OmegaBaryon 0.0486 HubbleParam 0.6774 Hubble 100 BoxSize 2000 OutputListOn 1 TimeBetSnapshot 0 TimeOfFirstSnapshot 0 TimeBetStatistics 0.01 NumFilesPerSnapshot 256 MaxFilesWithConcurrentIO 64 ErrTolIntAccuracy 0.01 CourantFac 0.3 MaxSizeTimestep 0.03 MinSizeTimestep 0 TypeOfOpeningCriterion 1 ErrTolTheta 0.75 ErrTolThetaMax 1 ErrTolForceAcc 0.002 TopNodeFactor 3 ActivePartFracForNewDomainDecomp 0.01 ActivePartFracForPMinsteadOfEwald 0.05 DesNumNgb 64 MaxNumNgbDeviation 1 DesLinkNgb 20 UnitLength_in_cm 3.08568e+24 UnitMass_in_g 1.989e+43 UnitVelocity_in_cm_per_s 100000 GravityConstantInternal 0 SofteningComovingClass0 0.05 SofteningMaxPhysClass0 0.05 SofteningClassOfPartType0 0 SofteningClassOfPartType1 0 ArtBulkViscConst 1 MinEgySpec 0 InitGasTemp 0 NSample 2048 GridSize 2048 Seed 181170 SphereMode 1 PowerSpectrumType 1 ReNormalizeInputSpectrum 1 PrimordialIndex 0.9667 ShapeGamma 0.21 Sigma8 0.8159 PowerSpectrumFile TNG_powerspec.dat InputSpectrum_UnitLength_in_cm 3.08568e+24 MALLOC: Allocation of shared memory took 187.053 sec found 2 times in output-list. BEGRUN: Hubble (internal units) = 100 BEGRUN: h = 0.6774 BEGRUN: G (internal units) = 43.0187 BEGRUN: UnitMass_in_g = 1.989e+43 BEGRUN: UnitLenth_in_cm = 3.08568e+24 BEGRUN: UnitTime_in_s = 3.08568e+19 BEGRUN: UnitVelocity_in_cm_per_s = 100000 BEGRUN: UnitDensity_in_cgs = 6.76991e-31 BEGRUN: UnitEnergy_in_cgs = 1.989e+53 EWALD: initialize Ewald correction... EWALD: reading Ewald tables from file `ewald_table_1-1-1_64-64-64_precision8-order3.dat' EWALD: Initialization of periodic boundaries finished. NGENIC: generated grid of size 2048 NGENIC: computing displacement fields... NGENIC: vel_prefac1= 3557.04 hubble_a=28456.5 fom1=0.999995 NGENIC: vel_prefac2= 7114.08 hubble_a=28456.5 fom2=1.99999 NGENIC: Dplus=50.1933 NGENIC_2LPT: Computing secondary source term, derivatices 0 0 NGENIC: setting up modes in kspace...