Submit Jobs

3 Type Jobs

• srun is used to submit a job for execution or initiate job steps in real time.

  • Example
    1. run shell

    srun -N2 bin/hostname

    2. run script

    srun -N1 test.sh

    3. exec into slurmd node

    srun -w slurm-lensing-slurm-slurmd-cpu-2 --pty /bin/bash

• sbatch is used to submit a job script for later execution. The script will typically contain one or more srun commands to launch parallel tasks.

  • Example

    1. submit a batch job

    sbatch -N2 -w "compute[01-02]" -o job.stdout /data/jobs/batch-job.slurm

    batch-job.slurm

    #!/bin/bash
    
    #SBATCH -N 1
    #SBATCH --job-name=cpu-N1-batch
    #SBATCH --partition=compute
    #SBATCH --mail-type=end
    #SBATCH --mail-user=xxx@email.com
    #SBATCH --output=%j.out
    #SBATCH --error=%j.err
    
    srun -l /bin/hostname #you can still write srun <command> in here
    srun -l pwd
    

    2. submit a parallel task to process differnt data partition

    sbatch /data/jobs/parallel.slurm

    parallel.slurm

    #!/bin/bash
    #SBATCH -N 2 
    #SBATCH --job-name=cpu-N2-parallel
    #SBATCH --partition=compute
    #SBATCH --time=01:00:00
    #SBATCH --array=1-4  # 定义任务数组，假设有4个分片
    #SBATCH --ntasks-per-node=1 # 每个节点只运行一个任务
    #SBATCH --output=process_data_%A_%a.out
    #SBATCH --error=process_data_%A_%a.err
    
    TASK_ID=${SLURM_ARRAY_TASK_ID}
    
    DATA_PART="data_part_${TASK_ID}.txt" #make sure you have that file
    
    if [ -f ${DATA_PART} ]; then
        echo "Processing ${DATA_PART} on node $(hostname)"
        # python process_data.py --input ${DATA_PART}
    else
        echo "File ${DATA_PART} does not exist!"
    fi
    

    how to split file

    split -l 1000 data.txt data_part_ 
    && mv data_part_aa data_part_1 
    && mv data_part_ab data_part_2
    

• salloc is used to allocate resources for a job in real time. Typically this is used to allocate resources and spawn a shell. The shell is then used to execute srun commands to launch parallel tasks.

  • Example
    1. allocate resources (more like create an virtual machine)

    salloc -N2 bash

    This command will create a job which allocates 2 nodes and spawn a bash shell on each node. and you can execute srun commands in that environment. After your computing task is finsihs, remember to shutdown your job.

    scancel <$job_id>

    when you exit the job, the resources will be released.