qsub


Can multiple qsub submissions read the same group of files?


I would like to use a bash script and qsub to run 30-40 python programs at once.
Each python program reads and searches through the same set of files (~400 total) for a set of sequences.
Is there a problem where multiple python programs could be trying to read from the same file? If so, what are the consequences?
There are no problems with multiple jobs reading from the same files that are imposed by Torque. (I think that statement is likely to be true for any resource manager / scheduler.)
The main issue I can imagine would be your file system's performance and whether or not it can keep up with potentially concurrent accesses to those files.

Related Links

Checking output from qsub : Sungrid cluster
qsub: get last job id submitted
Job summited with qsub does not write output and enters E status
Qsub job runs but doesn't write to file
Qsub job not running - possible issue in submission script
How do I know where my qsub job is running/being written
Pipe Symbol in qsub Job name
SLURM how to qsub a task when another task is finished?
Can multiple qsub submissions read the same group of files?
SGE faild to submit job, attribute is not a memory value
How do you submit a job on multiple queues with Torque?
Maui - preventing jobs from running on the same node
qsub: What is the standard when to get occasional updates on a submitted job?
Submitting a job to qsub generates an error, “Warning: no access to tty”
Running samtools from a qsub
How do I schedule a job on multiple nodes with qsub Univa 8.1.7?

Categories

HOME
jsf
cluster-computing
sass
vs-team-services
jbehave
laravel-5.2
angular2-directives
csvhelper
webdav
simpy
schemacrawler
requirejs
deeplearning4j
eclipse-cdt
rfid
game-physics
sql-tuning
dendrogram
uicollectionview
kadanes-algorithm
uiautomator
ghost-inspector
logarithm
badge
samsung-mobile
hanami
net-snmp
skmaps
osmdroid
guile
rhandsontable
excel-2013
data-conversion
gzip
sharp
spring-profiles
geopy
google-guava-cache
axis-labels
dql
ntfs-mft
cross-entropy
wcf-security
wsadmin
onbackpressed
exiftool
datalog
dojox.mobile
catia
asmx
taskmanager
bettercms
garrys-mod
gradle-script-kotlin
cfeclipse
c64
spring-ioc
activeweb
rstudio-server
foxit
scalar
nofollow
mercurial-hook
string-parsing
qt-linguist
fortran90
brackets-shell
sonarqube5.3
function-fitting
schtasks.exe
hornetq
affix
textkit
pyrocms
harp
ytplayerview
criteria-api
web-component-tester
musl
obfuscar
pgagent
rhel5
hidden-field
node-inspector
java-collections-api
valence
pyjade
bfd
java.util.date
windows-mobile-6
swrl
multiple-conditions
device-emulation
trailing-slash
couchdb-lucene
feof
n-layer
gdt
die
law-of-demeter
emacs23
selectonemenu
zookeeper
opengl-es-lighting
msn
j-interop
linfu
windows-controls
weborb

Resources

Mobile Apps Dev
Database Users
javascript
java
csharp
php
android
MS Developer
developer works
python
ios
c
html
jquery
RDBMS discuss
Cloud Virtualization
Database Dev&Adm
javascript
java
csharp
php
python
android
jquery
ruby
ios
html
Mobile App
Mobile App
Mobile App