User Tools

Site Tools


tutorial:torque

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
tutorial:torque [2017/04/08 14:57]
sertalpbilal [Options] Exported options into a table
tutorial:torque [2021/04/14 15:22]
mjm519 [Submitting a Small or Large Memory Job]
Line 61: Line 61:
 </code> </code>
 If you do not want to write the submission script you can do it just by calling If you do not want to write the submission script you can do it just by calling
-<code>qsub -N JobName -q batch -l nodes=1:pnn=2  myscript.sh</code>+<code>qsub -N JobName -q batch -l nodes=1:ppn=2  myscript.sh</code>
 Now, we will run the code but we are setting the job parameters using ''-'' character (e.g. ''-N JobName'') Now, we will run the code but we are setting the job parameters using ''-'' character (e.g. ''-N JobName'')
  
Line 86: Line 86:
  
 You can find detailed information [[http://gridscheduler.sourceforge.net/htmlman/htmlman1/qsub.html|here]]. You can find detailed information [[http://gridscheduler.sourceforge.net/htmlman/htmlman1/qsub.html|here]].
 +
 +<note tip>You need to use option ''-V'' to pass environment variables, which is needed to run solvers such as (Cplex, Gurobi, MOSEK, etc..). [[tutorial:torque#running_solvers|See here]].</note>
 ===== Monitoring and Removing jobs ===== ===== Monitoring and Removing jobs =====
  
Line 132: Line 134:
 ==== Submitting a Small or Large Memory Job ==== ==== Submitting a Small or Large Memory Job ====
  
-You can use the option ''-l mem=size,vmem=size'' to limit memory usage of your job.+You can use the option ''-l pmem=size,vmem=size'' to limit memory usage of your job.
  
 <code bash limited.sh> <code bash limited.sh>
-qsub -l mem=4gb,vmem=4gb test.pbs+qsub -l pmem=4gb,vmem=4gb test.pbs
 </code> </code>
  
 Sometimes your job needs more memory. You can choose a larger memory size with the same option: Sometimes your job needs more memory. You can choose a larger memory size with the same option:
  
-<code bash large.pbs>qsub  -l mem=20gb  test.pbs</code>+<code bash large.pbs>qsub  -l pmem=20gb  test.pbs</code>
  
 ==== Running MATLAB ==== ==== Running MATLAB ====
Line 157: Line 159:
 <note tip>Use **-singleCompThread** [[https://www.mathworks.com/help/matlab/ref/maxnumcompthreads.html|option]] for Matlab to use a single thread. A similar option may be needed for the program/solver you're using.</note> <note tip>Use **-singleCompThread** [[https://www.mathworks.com/help/matlab/ref/maxnumcompthreads.html|option]] for Matlab to use a single thread. A similar option may be needed for the program/solver you're using.</note>
  
-==== Running Solvers (Gurobi/CPLEX/Mosek/AMPL/...) ====+==== Running Solvers ====
  
-In order to run solvers, you need to use "-V" (it is Upper case) option. i.e.:+In order to run solvers (such as Gurobi/CPLEX/Mosek/AMPL/...), you need to use "-V" (it is Upper case) option. i.e.:
  
 <code>qsub -V submitFile.pbs </code> <code>qsub -V submitFile.pbs </code>
Line 181: Line 183:
  
 However, first you have to have a permission to use GPU (given by Prof. Takac) -- this is just formality to allow to certain users to use video driver on polyp30 However, first you have to have a permission to use GPU (given by Prof. Takac) -- this is just formality to allow to certain users to use video driver on polyp30
 +
 +If you are using TensorFlow in Python, you can set the limit on amount of GPU memory using:
 +<code>config_tf = tf.ConfigProto()
 +config_tf.gpu_options.per_process_gpu_memory_fraction = p</code>
 +in which **//p//** is the percent of GPU memory (a number between zero and one). 
  
 ==== Running MPI and Parallel Jobs ==== ==== Running MPI and Parallel Jobs ====
tutorial/torque.txt ยท Last modified: 2024/02/28 13:12 by mjm519