When will my project be created?
When the allocations committee has reviewed and approved it. Check your request status via the CCS Portal under My Pegasus -> My Requests. Scratch requests over 2TB can take a month for the allocations committee to review as availability is limited.

Is there a limit on how many jobs I can run?
No. Users are limited by number of simultaneous CPUs used. Individual users can run on up to 512 CPUs at a time, projects on up to 1000 CPUs at a time.

How can I see pending and running job counts for Pegasus queues?
With bqueuescommand: LSF

Why is my job still pending?
Jobs wait for enough resources to satisfy requirements. When the cluster is under heavy user load, jobs will wait longer. Use $ bjobs -l jobID to see PENDING REASONS. Check your resource requirements for accuracy and feasibility.

If your job has been pending for more than 24 hours and is not requesting exclusive access or all cores on a node, you may e-mail hpc@ccs.miami.edu for assistance.

Are other users’ pending jobs slowing my job?
No. The number of pending jobs is irrelevant to job performance in LSF. The scheduler can handle hundres of thousands of jobs.

How do I submit an interactive job?
With the -Is -q interactive flags: LSF Interactive

How do I submit an interactive X11 job?
With the -Is -q interactive -XF flags: LSF X11

Why was my job killed?
Jobs are killed to protect the cluster and preserve system performance. Common reasons include:
– running on a login node
– using more memory than reserved
– using all the memory on a compute node
– using more CPUs than reserved
– needing more time to complete than reserved
– using more /tmp space than available on compute nodes

See LSF for assistance with appropriate resource reservations and Pegasus Queues for default wall times.

Office Hours

Advanced Computing offers office hours to provide assistance with usage issues on the Pegasus cluster. The team is able to provide onsite assistance with queuing inquiries, software installation, and technical troubleshooting. The team is also able to help answer questions regarding grant proposals and can provide resource information about the Advanced Computing environment.

Contact

Request help via email to hpc@ccs.miami.edu. Provide detailed descriptions of the problem, paths to your job file and any outputs, the software modules you have loaded, and your job ID when appropriate.

Suggestions:

computer and operating system you are using

your CCS account ID

complete path to your job script file, program, or job submission

complete path to output files (if any)

error message(s) received

module(s) loaded ($ module list)

whether this job ran previously and what has changed since it last worked