Getting an account

You can request an account on PACE by emailing pace-support@…. However, it is typically easier to just email Alex, since he will have to email PACE Support to get you the correct permissions for the steps below.

Running ISSM (Standard install) on PACE

How to run ISSM using the standard module on PACE (ISSM 4.16 as of 1-7-2021)

ISSM has been built on the PACE cluster at CODA as a module. This means that it is already "installed" and can be used by any PACE user without needing to configure anything (except what is needed for the specific simulation). A user with privileges in the eas-robel group can follow these directions:

To run ISSM from the standard install on PACE requires a batch script, the MATLAB ISSM run script, and any input files that ISSM requires.

1. In the Ice & Climate group shared directory, there is a test script including the correct input files and batch file that can be copied (PLEASE DON'T MIDFY THIS IN THE SHARED DIRECTORY) to your personal directory and run to learn how ISSM is run.

(a) To copy these files to your home directory, run the following commands:

cd ~
mkdir ISSM
cd ISSM
cp /storage/coda1/p-arobel3/0/shared/ISSM/ISSMintro/* .

(b) Then to run the test script on PACE, run the following command:

qsub batch_issm.pbs

(c) You can check the status of the run using the following command:

qstat -u YOURPACEUSERNAME

(d) An output text file should be created in the same directory as the batch file. You can have a quick look at the status of the run (which ISSM should output) using vi or less.

2. For other non-test ISSM runs, the batch script should generally look like:<br />

---

#PBS -N JOBNAME
#PBS -A GT-arobel3-atlas
#PBS -o output.$PBS_JOBID
#PBS -j oe
#PBS -l nodes=NNODES:ppn=NPROC[[BR]] #PBS -l walltime=DAYS:HOURS:MINS:00[[BR]]

cd $PBS_O_WORKDIR
module purge
module load intel/19.0.3
module load issm/4.16
source $ISSMROOT/etc/environment.sh

matlab -nodesktop -nosplash -r "NAMEOFSCRIPT; exit"

---

In this script, the only things that should be changed are lines 1, 5, 6, 14.

(Line 1) JOBNAME is just the name of the job you pick (whatever you like) in the scheduler system.

(Line 5) NNODES indicates the number of nodes and NPROC indicates the number of processors on each node to use. For very simple jobs, both can be 1. For more intensive jobs NNODES=1 and NPROC can be up to 28 (on the typical node architecture of phoenix). For very computationally intensive jobs, you can use more than one node, but talk to Alex first.

(Line 6) The maximum time to allocate for the job is specified here in units of DAYS:HOURS:MINS:00. The phoenix cluster has a maximum walltime of 21 days.<br />
(Line 14) NAMEOFSCRIPT is the file name of the MATLAB script that you are using to run ISSM.

For more details on how to specify jobs on the PACE phoenix cluster see here: ​http://docs.pace.gatech.edu/phoenix_cluster/submit_jobs_phnx/