qsub


How do I know where my qsub job is running/being written


A silly question, perhaps, about qsub on SGE.
I submit a job via a script
#PBS -V
#PBS -l select=1:ncpus=20:mpiprocs=20,walltime=01:00:00
#PBS -o /path/to/out.file
#PBS -e /path/to/errors.txt
#PBS -q smp
#PBS -m ae
#PBS -M myemail#address
#PBS -P Projectname
#PBS -I
#PBS -N Job
mpirun -np 20 mpiexecutable args input.file
The job of "mpiexecutable" is to act on input.file to minimise its parameters, and then write them to input.file again.
My job runs. But input.file remains unchanged. I think there is either
1) Something missing in my PATH, or
2) Some other reason why the cluster won't write to input.file.
In order to troubleshoot it, I need to know:
1) How do I find out where the job is running (i.e. what the path is wherever the job is running - should be the same as whatever the path is in the working directory, surely?)
2) How do I find out where the job is writing to?
Thanks so much for your help!
I just made some progress! I think the best way to proceed with a question like this is to be explicit about where the job is being run and written and where to find executables and input etc.
With this in mind, my new submission script is:
#PBS -V
#PBS -l select=1:ncpus=20:mpiprocs=20,walltime=01:00:00
#PBS -o /path/lfor/out.txt
#PBS -e /path/for/errors.txt
#PBS -q smp
#PBS -m ae
#PBS -M email#address
#PBS -P Project-name
#PBS -I
#PBS -N Job
module load importantmodules
SRCDIR=$SCRATCH/my_project/code
cp my_input_params.inp $RUNDIR
RUNDIR=$SCRATCH/my_project/run-${PBS_JOBID/.*}
mkdir -p $RUNDIR
mpirun -np 20 $SRCDIR/mpiexecutable args < my_input_file.inp
I haven't tried this yet, but I am crossing my fingers that it works. I got some great directives for improving the submission script like this from this website: https://wikis.nyu.edu/display/NYUHPC/Writing+and+submitting+a+job+-+content
Let's keep going! I feel marginally less lost now

Related Links

SGE Issue qstat qsub not working
Checking output from qsub : Sungrid cluster
qsub: get last job id submitted
Job summited with qsub does not write output and enters E status
Qsub job runs but doesn't write to file
Qsub job not running - possible issue in submission script
How do I know where my qsub job is running/being written
Pipe Symbol in qsub Job name
SLURM how to qsub a task when another task is finished?
Can multiple qsub submissions read the same group of files?
SGE faild to submit job, attribute is not a memory value
How do you submit a job on multiple queues with Torque?
Maui - preventing jobs from running on the same node
qsub: What is the standard when to get occasional updates on a submitted job?
Submitting a job to qsub generates an error, “Warning: no access to tty”
Running samtools from a qsub

Categories

HOME
bower
paramiko
angular2-directives
tomcat7
apollo
xtext
dataframe
pygame
shader
oclint
wordpress-theming
uiscrollview
flann
simple-injector
typeahead
mod-pagespeed
sendkeys
zope
scenebuilder
android-fragmentactivity
shippo
lync-2013
partial-application
pcre
jboss5.x
ifstream
viewstate
openpgp
windows-10-iot-core
shibboleth
text-files
broadleaf-commerce
strstr
fax
equivalence
onbackpressed
web-development-server
rkt
facebook-chatbot
asmx
3scale
lumen-5.3
range-v3
pinvoke
livescribe
jgraph
openh264
volume
heroku-postgres
pycurl
unity3d-editor
emoticons
ingres
pdfkit
payu
libreadline
activeweb
contour
remoteapp
eml
multinomial
anythingslider
function-fitting
optionbutton
app.xaml
site-prism
programming-paradigms
ubercart
hiera
jython-2.7
low-level
qtestlib
mov
author
argument-passing
picat
nuspec
tridion2009
pys60
jpf
jquery-selectbox
msgbox
serp
dcpu-16
svn-hooks
winverifytrust
code-design
windows-controls
lazy-c++
opcodes
gears

Resources

Mobile Apps Dev
Database Users
javascript
java
csharp
php
android
MS Developer
developer works
python
ios
c
html
jquery
RDBMS discuss
Cloud Virtualization
Database Dev&Adm
javascript
java
csharp
php
python
android
jquery
ruby
ios
html
Mobile App
Mobile App
Mobile App