Introduction

The SCC provides users with access to 10 GPU Nodes, each equipped with 2 NVIDIA H100 96GB GPUs. These GPUs can be requested as so-called "Generic Resources" (GRES) when submitting jobs via Slurm.

Available GPU Types

Because the NVIDIA H100 offers lots of processing power and VRAM, we expect that lots of jobs actually need much less ressources. We therefore decided to split the GPUs into multiple "virtual GPUs" using NVIDIA's Multi-Instance GPU (MIG) technology. This allows us to provide GPU processing power to more users at the same time and increases the overall utilization of the GPUs.

Currently, the following GPU "types" are available on the SCC:

You can request any of these GPU types when submitting a job like this:

srun --gpus=1g.12gb:1 ...

Based on future actual usage patterns and user feedback, we might adjust the number and types of available GPUs.