Changes between Version 8 and Version 9 of frontera


Ignore:
Timestamp:
09/09/24 13:29:26 (5 months ago)
Author:
Cheng Gong
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • frontera

    v8 v9  
    3434== Environment ==
    3535
    36 On frontera, add the following lines to `~/.bash_login`:
     36On frontera, add the following lines to `~/.bashrc` or `~/.bash_login`:
    3737{{{
    3838#!sh
    3939export ISSM_DIR=PATHTOTRUNK
    4040source $ISSM_DIR/etc/environment.sh
    41 module load petsc/3.15
     41module load intel/23.1.0
     42module load impi/21.9.0
     43module load petsc/3.21
    4244}}}
    4345
     
    5355{{{
    5456#!sh
     57export CC=mpicc
     58export CXX=mpicxx
     59export FC=mpifort
     60
    5561./configure \
    5662   --prefix=$ISSM_DIR \
    5763   --with-wrappers=no \
    5864   --with-mpi-include="$TACC_IMPI_INC" \
    59    --with-mpi-libflags="-L$TACC_IMPI_LIB/release_mt -lmpi" \
     65   --with-mpi-libflags="-L$TACC_IMPI_LIB/release_mt -lmpi -lmpifort -lifcore" \
    6066   --with-petsc-dir="$TACC_PETSC_DIR" \
    6167   --with-petsc-arch=$ISSM_ARCH \
    62    --with-metis-dir="$TACC_PETSC_DIR/$PETSC_ARCH" \
    63    --with-mkl-libflags="-L$TACC_MKL_LIB -mkl=parallel" \
    64    --with-mumps-dir="$TACC_PETSC_DIR/$PETSC_ARCH" \
    65    --with-scalapack-dir="$TACC_PETSC_DIR/$PETSC_ARCH" \
     68   --with-metis-dir="$TACC_PETSC_DIR" \
     69   --with-mkl-libflags="-L$TACC_MKL_LIB -qmkl=parallel" \
     70   --with-mumps-dir="$TACC_PETSC_DIR" \
     71   --with-scalapack-dir="$TACC_PETSC_DIR" \
    6672   --with-m1qn3-dir="$ISSM_DIR/externalpackages/m1qn3/install" \
     73   --with-cxxoptflags="-g -O3 -std=c++11 -fp-model=precise" \
    6774   --enable-debugging \
    6875   --enable-development
     
    130137== Running jobs on frontera  ==
    131138
    132 On frontera, each node has 56 cores and you can use any multiple of 56 for the total number of processors. The more nodes and the longer the requested time, the more you will have to wait in the queue. So choose your settings wisely:
     139On frontera, each node has 56 cores and you can use any multiple of 56 for the total number of processors. The more nodes and the longer the requested time, the more you will have to wait in the queue.
     140The most commonly used queues are `normal`, `development`, and `flex`.
     141Check more details here: [https://docs.tacc.utexas.edu/hpc/frontera/#queues]
     142
     143**Note**: in order to use `normal` queue, you will have to request at least `3` nodes.
     144
     145
     146So choose your settings wisely:
    133147
    134148 {{{
    135149#!m
    136 md.cluster=frontera('numnodes',2);
     150md.cluster=frontera('numnodes',3);
    137151}}}
    138152