EOS26

Description

All scripts to run the EOS26 simulation with 21cmFASTv4.2.

How to run

All scripts accept an optional --test flag to run a small test box (HII_DIM=200).

End-to-end test

• sbatch sbatch_scripts/full_test_job.sh — runs all three pipeline steps sequentially in test mode.

Production run (in order)

1. Initial conditions (ICs):
   • sbatch sbatch_scripts/ICs_job.sh [--test]
   • Writes EOS26.toml (full template with embedded node redshifts and random seed) and EOS26_minimal.toml, then runs run_scripts/run_ICs.py.
2. Perturbed fields (PFs):
   • bash sbatch_scripts/submit_PF_jobs.sh [--test] — submits one job per PF (indices 0–91).
   • sbatch sbatch_scripts/N_PF_job.sh <z_idx> [N] [--test] — runs a batch of N PFs (default N=10) starting from redshift index z_idx.
3. Perturbed halo fields (PHFs):
   • sbatch sbatch_scripts/PHFs_job.sh [--test] — runs run_scripts/run_PHFs.py.
4. Coevals:
   • sbatch sbatch_scripts/N_coeval_job.sh [N] [--test] — runs a batch of N coevals (default N=10) with run_scripts/run_N_coevals.py.

Table

EOS25 simulation step	Computation time [hrs]		Memory [Tb]		Storage [Tb]		SUs
	Estimated	Actual	Estimated	Actual	Estimated	Actual	Estimated	Actual
Initial conditions	13.5 + 2.75 for writing to disk		1.1	1.3	652 Gb	747 Gb		864 EM for ICs + PFs
One perturbed field	0.6		25 Gb	26 Gb	25Gb x 92 = 2.3Tb	2.4Tb
Perturbed halo fields	22 hrs		0.71	0.77	~330 G	33 G	720 EM	617 EM
Evolving astrophysics for one coeval	7		3.65		2.6Tb x 92 = 240 Tb 0.215 x 92 = 20Tb without XRS		672 EM x 92 = 62k

Scaling test results

Extrapolated using $a = 3$ from each test box. EOS-1: HII_DIM = 1400 (1.5 cMpc/cell, 2100 Mpc). EOS-2: HII_DIM = 1200 (1.667 cMpc/cell, 2000 Mpc). Storage for PFs and coevals is the total across all 92 node redshifts; coeval storage excludes IonizedBox.

EOS26 simulation step	Computation time [hrs]		Memory [TB]		Storage		SUs (96 cores)
	N=120	N=240	N=120	N=240	N=120	N=240	N=120	N=240
Scaling tests (measured)
Initial conditions	0.01	0.04	0.002	0.010	1 Gb	6 Gb	0.5	4.1
One perturbed field	<0.01	<0.01	0.001	0.007	<1 Gb	<1 Gb	<0.1	0.1
Perturbed halo fields	0.03	0.06	0.002	0.010	<1 Gb	<1 Gb	2.5	6.0
Evolving astrophysics for one coeval	<0.01	0.03	0.002	0.012	<1 Gb	1 Gb	0.3	2.5
Extrapolated to EOS-1 (HII_DIM = 1400, 1.5 cMpc/cell, 2100 Mpc)
Initial conditions	8.5 – 9.1		2.04 – 2.74		1.16 Tb		813 – 869
One perturbed field	0.14 – 0.17		1.30 – 1.98		0.043 Tb × 92 = 3.95 Tb		14 – 17
Perturbed halo fields	12.5 – 41		2.05 – 2.90		1.31 – 3.92 Tb		1200 – 3978
Evolving astrophysics for one coeval	4.9 – 5.2		2.44 – 3.52		0.13 – 0.16 Tb × 92 = 12.3 – 15.1 Tb		469 – 502
Extrapolated to EOS-2 (HII_DIM = 1200, 1.667 cMpc/cell, 2000 Mpc)
Initial conditions	5.3 – 5.7		1.28 – 1.72		0.73 Tb		512 – 547
One perturbed field	0.09 – 0.11		0.82 – 1.25		0.027 Tb × 92 = 2.49 Tb		9 – 11
Perturbed halo fields	7.9 – 26		1.29 – 1.82		0.83 – 2.47 Tb		756 – 2506
Evolving astrophysics for one coeval	3.1 – 3.3		1.54 – 2.22		0.08 – 0.10 Tb × 92 = 7.7 – 9.5 Tb		295 – 316