tutorial:torque
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
|
tutorial:torque [2017/04/08 15:03] sertalpbilal [Running Solvers (Gurobi/CPLEX/Mosek/AMPL/...)] |
tutorial:torque [2023/10/25 13:55] mjm519 [Submitting a Small or Large Memory Job] |
||
|---|---|---|---|
| Line 44: | Line 44: | ||
| #PBS -o / | #PBS -o / | ||
| #PBS -l nodes=1: | #PBS -l nodes=1: | ||
| + | #PBS -l pmem=2GB: | ||
| #PBS -q batch | #PBS -q batch | ||
| Line 61: | Line 62: | ||
| </ | </ | ||
| If you do not want to write the submission script you can do it just by calling | If you do not want to write the submission script you can do it just by calling | ||
| - | < | + | < |
| Now, we will run the code but we are setting the job parameters using '' | Now, we will run the code but we are setting the job parameters using '' | ||
| Line 86: | Line 87: | ||
| You can find detailed information [[http:// | You can find detailed information [[http:// | ||
| + | |||
| + | <note tip>You need to use option '' | ||
| ===== Monitoring and Removing jobs ===== | ===== Monitoring and Removing jobs ===== | ||
| Line 132: | Line 135: | ||
| ==== Submitting a Small or Large Memory Job ==== | ==== Submitting a Small or Large Memory Job ==== | ||
| - | You can use the option '' | + | You can use the option '' |
| <code bash limited.sh> | <code bash limited.sh> | ||
| - | qsub -l mem=4gb, | + | qsub -l pmem=4gb, |
| </ | </ | ||
| Sometimes your job needs more memory. You can choose a larger memory size with the same option: | Sometimes your job needs more memory. You can choose a larger memory size with the same option: | ||
| - | <code bash large.pbs> | + | <code bash large.pbs> |
| + | To see what resources have been assigned by the batch queuing system run the ulimit command (bash) or limit comamnd: | ||
| + | <code bash pbs job submission command> | ||
| + | <code bash ulimit> | ||
| + | core file size (blocks, -c) 0 | ||
| + | data seg size | ||
| + | scheduling priority | ||
| + | file size | ||
| + | pending signals | ||
| + | max locked memory | ||
| + | max memory size | ||
| + | open files (-n) 65536 | ||
| + | pipe size (512 bytes, -p) 8 | ||
| + | POSIX message queues | ||
| + | real-time priority | ||
| + | stack size (kbytes, -s) unlimited | ||
| + | cpu time | ||
| + | max user processes | ||
| + | virtual memory | ||
| + | file locks (-x) unlimited</ | ||
| + | |||
| + | **[[https:// | ||
| ==== Running MATLAB ==== | ==== Running MATLAB ==== | ||
| Line 150: | Line 174: | ||
| #PBS -o / | #PBS -o / | ||
| #PBS -l nodes=1: | #PBS -l nodes=1: | ||
| + | #PBS -l pmem=2GB: | ||
| #PBS -q batch | #PBS -q batch | ||
| Line 181: | Line 206: | ||
| However, first you have to have a permission to use GPU (given by Prof. Takac) -- this is just formality to allow to certain users to use video driver on polyp30 | However, first you have to have a permission to use GPU (given by Prof. Takac) -- this is just formality to allow to certain users to use video driver on polyp30 | ||
| + | |||
| + | If you are using TensorFlow in Python, you can set the limit on amount of GPU memory using: | ||
| + | < | ||
| + | config_tf.gpu_options.per_process_gpu_memory_fraction = p</ | ||
| + | in which **//p//** is the percent of GPU memory (a number between zero and one). | ||
| ==== Running MPI and Parallel Jobs ==== | ==== Running MPI and Parallel Jobs ==== | ||
tutorial/torque.txt ยท Last modified: 2024/02/28 13:12 by mjm519
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
