qsub


Can multiple qsub submissions read the same group of files?


I would like to use a bash script and qsub to run 30-40 python programs at once.
Each python program reads and searches through the same set of files (~400 total) for a set of sequences.
Is there a problem where multiple python programs could be trying to read from the same file? If so, what are the consequences?
There are no problems with multiple jobs reading from the same files that are imposed by Torque. (I think that statement is likely to be true for any resource manager / scheduler.)
The main issue I can imagine would be your file system's performance and whether or not it can keep up with potentially concurrent accesses to those files.

Related Links

Qsub job runs but doesn't write to file
Qsub job not running - possible issue in submission script
How do I know where my qsub job is running/being written
Pipe Symbol in qsub Job name
SLURM how to qsub a task when another task is finished?
Can multiple qsub submissions read the same group of files?
SGE faild to submit job, attribute is not a memory value
How do you submit a job on multiple queues with Torque?
Maui - preventing jobs from running on the same node
qsub: What is the standard when to get occasional updates on a submitted job?
Submitting a job to qsub generates an error, “Warning: no access to tty”
Running samtools from a qsub
How do I schedule a job on multiple nodes with qsub Univa 8.1.7?
How to specify a fixed job name for jobs submitted by qsub
duplicate jobs in sun grid engine
SGE qsub define variable using bach?

Categories

HOME
cakephp-3.x
ember.js
semantic-ui
ibm-watson-cognitive
scipy
cpu-architecture
label
aem
ruby-on-rails-3
transparent
csvhelper
propertygrid
docker-windows
internet-explorer-11
actionscript-2
subquery
gimp
deeplearning4j
cartodb
onsen-ui2
intellij-plugin
finite-group-theory
data-analysis
cratedb
mod-pagespeed
scenebuilder
android-toolbar
kadanes-algorithm
npm-install
iis-10
samsung-mobile
non-deterministic
rhandsontable
chrome-native-messaging
ggmap
i3
aurelia-binding
bitcoin-testnet
autofill
android-vpn-service
strophe
preg-grep
hotmail
body-parser
threshold
windows-10-iot-core
boilerplate
nlb
coreclr
code-behind
s3cmd
soundjs
cgo
google-account
lftp
finite-element-analysis
ivona
worker
multi-agent
quintus
paas
c64
push-diffusion
glkit
galleriffic
easing
software-product-lines
unsatisfiedlinkerror
multifile-uploader
mongo-c-driver
jericho-html-parser
uialertview
wif
castle-windsor-3
adobe-indesign
low-level
chaining
utf-32
libsndfile
getimagedata
yahoo-boss-api
dynamic-proxy
modeshape
carddav
backbone-relational
icsharpcode
dynamic-data
bulbs
datarepeater
deploying
jpf
nsindexpath
scraperwiki
search-path
nagle
dirty-data
visual-studio-dbpro

Resources

Mobile Apps Dev
Database Users
javascript
java
csharp
php
android
MS Developer
developer works
python
ios
c
html
jquery
RDBMS discuss
Cloud Virtualization
Database Dev&Adm
javascript
java
csharp
php
python
android
jquery
ruby
ios
html
Mobile App
Mobile App
Mobile App