This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
tutorial:torque [2017/03/15 17:58] afo214 |
tutorial:torque [2021/04/14 15:22] mjm519 [Submitting a Small or Large Memory Job] |
||
---|---|---|---|
Line 61: | Line 61: | ||
</ | </ | ||
If you do not want to write the submission script you can do it just by calling | If you do not want to write the submission script you can do it just by calling | ||
- | < | + | < |
Now, we will run the code but we are setting the job parameters using '' | Now, we will run the code but we are setting the job parameters using '' | ||
===== Options ===== | ===== Options ===== | ||
- | * '' | + | ^ Option |
- | | + | | '' |
- | | + | | '' |
- | | + | | '' |
- | | + | | '' |
- | | + | | '' |
- | | + | | '' |
- | | + | | '' |
- | | + | | '' |
- | | + | | '' |
- | | + | | '' |
- | | + | | '' |
- | | + | | '' |
- | | + | | '' |
- | | + | | '' |
- | | + | | '' |
- | | + | | '' |
+ | | '' | ||
- | See [[http:// | + | You can find detailed information |
+ | <note tip>You need to use option '' | ||
===== Monitoring and Removing jobs ===== | ===== Monitoring and Removing jobs ===== | ||
Line 132: | Line 134: | ||
==== Submitting a Small or Large Memory Job ==== | ==== Submitting a Small or Large Memory Job ==== | ||
- | You can use the option '' | + | You can use the option '' |
<code bash limited.sh> | <code bash limited.sh> | ||
- | qsub -l mem=4gb, | + | qsub -l pmem=4gb, |
</ | </ | ||
Sometimes your job needs more memory. You can choose a larger memory size with the same option: | Sometimes your job needs more memory. You can choose a larger memory size with the same option: | ||
- | <code bash large.pbs> | + | <code bash large.pbs> |
==== Running MATLAB ==== | ==== Running MATLAB ==== | ||
Line 156: | Line 158: | ||
<note tip>Use **-singleCompThread** [[https:// | <note tip>Use **-singleCompThread** [[https:// | ||
+ | |||
+ | ==== Running Solvers ==== | ||
+ | |||
+ | In order to run solvers (such as Gurobi/ | ||
+ | |||
+ | < | ||
+ | |||
+ | This flag enables the solver to find necessary authentication information. | ||
==== Interactive Jobs ==== | ==== Interactive Jobs ==== | ||
Line 173: | Line 183: | ||
However, first you have to have a permission to use GPU (given by Prof. Takac) -- this is just formality to allow to certain users to use video driver on polyp30 | However, first you have to have a permission to use GPU (given by Prof. Takac) -- this is just formality to allow to certain users to use video driver on polyp30 | ||
+ | |||
+ | If you are using TensorFlow in Python, you can set the limit on amount of GPU memory using: | ||
+ | < | ||
+ | config_tf.gpu_options.per_process_gpu_memory_fraction = p</ | ||
+ | in which **//p//** is the percent of GPU memory (a number between zero and one). | ||
==== Running MPI and Parallel Jobs ==== | ==== Running MPI and Parallel Jobs ==== | ||
Line 298: | Line 313: | ||
+ | ==== Tensorflow with GPU ==== | ||
+ | To use tensorflow with a specific GPU, say GPU 1, you can simply set | ||
+ | <code bash> | ||
+ | export CUDA_VISIBLE_DEVICES=1 | ||
+ | </ | ||
+ | and then schedule your jobs with Torque to perform experiments on GPU 1. |