CCAPP Dedicated Compute

Dedicated compute services at OSC (also refered to as Condo model) involves users purchasing one or more compute nodes for the shared cluster while OSC provides the infrastructure, as well as maintenance and services. CCAPP Condo on Pitzer cluster is owned by the Center for Cosmology and AstroParticle Physics, at OSU. Prof. Annika Peter has been heavily involved in specifying requirements.

Hardware

Detailed system specifications:

  • 11 standard dense compute nodes

    • 40 cores per node @ 2.4GHz

    • 192 GB memory per node

    • 1 TB of local disk space per node

  • Dual Intel Xeon 6148s Skylakes CPUs

  • Mellanox EDR (100Gbps) Infiniband networking

Connecting

CCAPP Condo is only accessible by users under project account PCON0003. Condo users are guaranteed access to their nodes within 4 hours of a job submission to their respective queue on the cluster, provided that resources are available. 

Before getting access to the condo, you need to login to Pitzer at OSC by connecting to the following hostname:

pitzer.osc.edu

You can either use an ssh client application or execute ssh on the command line in a terminal window as follows:

ssh <username>@pitzer.osc.edu

From there, you can run programs interactively (only for short jobs and test jobs) or through batch requests. You get access to the condo by adding --account=PCON0003 in your request. You can also run programs out of the condo by adding --account=PAS1005 (or your project code, if it is different) in your request, which allows you to get access to the standard non-condo Pitzer compute nodes, which have Intel® Xeon® 'Skylake' or 'Cascade Lake' processors, Dual NVIDIA Volta V100, or Quad NVIDIA Volta V100s. For more info on Pitzer Cluster, please refer to Pitzer Documentation Page.

OSC clusters are utilizing Slurm for job scheduling and resource management. Slurm, which stands for Simple Linux Utility for Resource Management, is a widely used open-source HPC resource management and scheduling system that originated at Lawrence Livermore National Laboratory. Please refer to this page for instructions on how to prepare and submit Slurm job scripts. A compatibility layer that allows users to submit batch PBS job scripts is also available. However, we encourage users to convert their Torque/Moab PBS batch scripts to Slurm.

For example, specify your project code by:

#SBATCH --account=PCON0003

To request 2 full Pitzer nodes:

#SBATCH --nodes=2 --ntasks-per-node=40

 

File Systems

CCAPP's condo accesses the same OSC mass storage environment as our other clusters. Therefore, condo users have the same home directory as on the Ruby and Oakley clusters. Full details of the storage environment are available in our storage environment guide.

Software Environment

Users on the condo nodes have access to all software packages installed on Ruby Cluster. By default, you will have the batch scheduling software modules, the Intel compiler and an appropriate version of mvapich2 loaded. Use module load <package> to add a software package to your environment. Use module list to see what modules are currently loaded and module avail to see the modules that are available to load. To search for modules that may not be visible due to dependencies or conflicts, use module spider .

You can keep informed of the software packages that have been made available on Ruby by viewing the Software by System page and selecting the Ruby system.

Using OSC Resources

For more information about how to use OSC resources, please see our guide on batch processing at OSC. For specific information about modules and file storage, please see the Batch Execution Environment page.

Getting Support

Here are the presentations on Introduction to OSC Services, Projects & Condos at OSC and How to Bundle Jobs at OSC. These presentations were given in September, 2017.

 

Contact OSC Help or OSU Physics support if your have any other questions, or need assistance. 

Supercomputer: 
Pitzer