qsub


Maui - preventing jobs from running on the same node


I have a number of jobs that I would like to submit to a cluster. Each job slows down significantly when running on the same node as another but is not significantly affected by others running different types of calculations on the node.
Is it possible to specify such a constraint to qsub with a Moab (Maui) scheduler?
To be clearer, here's a description:
nodes: node1, node2, node3 (each with 20 cores)
my jobs: my1, my2, my3, my4 (each requesting 10 cores)
other jobs: other1, other2 (each requesting 10 cores)
I'd like the following assignment (after submitting all jobs to the queue)
Running:
node1 <-- my1, other1
node2 <-- my2, other2
node3 <- my3
Held:
my4
One way you can do this is by configuring a generic resource locked to each individual node, and then requesting it when submitting a more resource-intensive job.
Example configuration:
NODECFG[node1] GRES=highdemand
NODECFG[node2] GRES=highdemand
NODECFG[node3] GRES=highdemand
Job submission:
$ qsub -l gres=highdemand -N my1 my.sh
This will restrict nodes to one "highdemand" job at a time, while still permitting other jobs to run on the remaining resources.

Related Links

Can multiple qsub submissions read the same group of files?
SGE faild to submit job, attribute is not a memory value
How do you submit a job on multiple queues with Torque?
Maui - preventing jobs from running on the same node
qsub: What is the standard when to get occasional updates on a submitted job?
Submitting a job to qsub generates an error, “Warning: no access to tty”
Running samtools from a qsub
How do I schedule a job on multiple nodes with qsub Univa 8.1.7?
How to specify a fixed job name for jobs submitted by qsub
duplicate jobs in sun grid engine
SGE qsub define variable using bach?
Job chaining with qsub
Determine Load Status in qsub
How to avoid this error ?Unable to run job: error: no suitable queues
Silently submit a job with qsub to SGE
what is 'Gbytes seconds'?

Categories

HOME
python
dotnetrdf
google-cloud-bigtable
mql4
crate
drupal-7
puppet
jbehave
docker-swarm
command
windows-store-apps
jscript
appmaker
javamail
phonegap-cli
jrebel
gspread
yocto
triggers
sudo
currency
oclint
xamarin-studio
cosmicmind
pyephem
attask
excel-2010
piwik
memsql
csh
yosys
hanami
onesignal
continuous-deployment
spring-data-neo4j
classpath
chrome-native-messaging
positioning
vegan
oracle-xml-db
fabric-digits
transient
rhino
reactivemongo
forecasting
inkscape
parse-android-sdk
declare
fltk
stereo-3d
w3-total-cache
range-v3
production-environment
chunked-encoding
ti-basic
jenkins-jira-trigger
polar-coordinates
spyne
gulp-typescript
firepath
asteriskami
faraday
logcat
interactive-brokers
asp.net-mvc-2
altbeacon
approval-tests
acm
sourcegear-vault
stream-framework
calibration
bridge
debian-based
tilestache
proximity
gyroscope-framework
qtestlib
facebook-wall
system.web
level
kraken.js
httpcontext
visualstatemanager
svcutil.exe
json-patch
image-zoom
haskell-platform
carddav
qss
fortran77
bulbs
cadisplaylink
applicationcontext
path-manipulation
adobe-contribute
getresource
mvccontrib-grid
msn
visual-c++-2008-express
act
kpi
handheld

Resources

Mobile Apps Dev
Database Users
javascript
java
csharp
php
android
MS Developer
developer works
python
ios
c
html
jquery
RDBMS discuss
Cloud Virtualization
Database Dev&Adm
javascript
java
csharp
php
python
android
jquery
ruby
ios
html
Mobile App
Mobile App
Mobile App