qsub


Maui - preventing jobs from running on the same node


I have a number of jobs that I would like to submit to a cluster. Each job slows down significantly when running on the same node as another but is not significantly affected by others running different types of calculations on the node.
Is it possible to specify such a constraint to qsub with a Moab (Maui) scheduler?
To be clearer, here's a description:
nodes: node1, node2, node3 (each with 20 cores)
my jobs: my1, my2, my3, my4 (each requesting 10 cores)
other jobs: other1, other2 (each requesting 10 cores)
I'd like the following assignment (after submitting all jobs to the queue)
Running:
node1 <-- my1, other1
node2 <-- my2, other2
node3 <- my3
Held:
my4
One way you can do this is by configuring a generic resource locked to each individual node, and then requesting it when submitting a more resource-intensive job.
Example configuration:
NODECFG[node1] GRES=highdemand
NODECFG[node2] GRES=highdemand
NODECFG[node3] GRES=highdemand
Job submission:
$ qsub -l gres=highdemand -N my1 my.sh
This will restrict nodes to one "highdemand" job at a time, while still permitting other jobs to run on the remaining resources.

Related Links

Checking output from qsub : Sungrid cluster
qsub: get last job id submitted
Job summited with qsub does not write output and enters E status
Qsub job runs but doesn't write to file
Qsub job not running - possible issue in submission script
How do I know where my qsub job is running/being written
Pipe Symbol in qsub Job name
SLURM how to qsub a task when another task is finished?
Can multiple qsub submissions read the same group of files?
SGE faild to submit job, attribute is not a memory value
How do you submit a job on multiple queues with Torque?
Maui - preventing jobs from running on the same node
qsub: What is the standard when to get occasional updates on a submitted job?
Submitting a job to qsub generates an error, “Warning: no access to tty”
Running samtools from a qsub
How do I schedule a job on multiple nodes with qsub Univa 8.1.7?

Categories

HOME
shopify
checkbox
textwatcher
windows-7
wxwidgets
smartphone
cocos2d-x-3.0
search-engine
safari
rocketmq
user
vsftpd
keystore
x11
cartodb
spinnaker
public-key-encryption
cratedb
glpk
uisplitviewcontroller
arraylist
factor-analysis
off-canvas-menu
koa
spring-ws
extractor
scalajs-react
tampermonkey
unpack
mayavi
pcre
percentage
body-parser
rhino
openshift-enterprise
rider
mmdrawercontroller
forecasting
zero
code-behind
topic-modeling
fltk
restful-url
constants
fqdn
sapui
goquery
multi-agent
chrome-remote-desktop
tcserver
react-native-fbsdk
teiid
laravel-query-builder
libreadline
boost-hana
ng2-material
spring-lemon
picking
sun-codemodel
asymptote
java.util.calendar
ninject.web.mvc
mirrorlink
js-cookie
programming-paradigms
wif
cpu-cores
rspec3
searchkick
android-search
cpan
jcr-sql2
obfuscar
cloudpebble
node-inspector
mov
sid
magic-numbers
flash-cc
edit-in-place
leptonica
adomd.net
dwolla
xslkey
fieldset
sametime
gdataxml
javascriptserializer
symfony-2.0
caliper
cross-domain-policy
printing-web-page
executable-format
associative
j-interop
querypath
trampolines
outlook-form
msf
cots

Resources

Mobile Apps Dev
Database Users
javascript
java
csharp
php
android
MS Developer
developer works
python
ios
c
html
jquery
RDBMS discuss
Cloud Virtualization
Database Dev&Adm
javascript
java
csharp
php
python
android
jquery
ruby
ios
html
Mobile App
Mobile App
Mobile App