Condor-G Example 3 - Stage An Executable and Input Files, Retrive Output Files



In this example we will submit a job that runs a user-supplied application that requires an input file and writes an output file.
We will use uberftp  to transfer the input file to the computer and retrive the file after the program has run.


Create a Condor submit file called example3.submit which contains the following lines:

executable = test-input-file
arguments=  number-list
Transfer_Executable = true
globusscheduler = beowulf2.dartmouth.edu/jobmanager
universe = grid
remote_initialdir=/home/grid1/grid-class/sas
output = test-input-file.out
error=test-input-file.error
log = test-input-file.log
queue



Next compile the application, ftp the input file,  submit the job to Condor, wait for the job to complete, ftp the output file back
to your computer.


sierra:~> gcc -m32 -static -o test-input-file test-input-file.c
sierra:~/Testing/VDT> file test-input-file
test-input-file: ELF 32-bit LSB executable, Intel 80386, version 1 (SYSV), for GNU/Linux 2.2.5,
statically linked, not stripped
sierra:> uberftp beowulf2.dartmouth.edu "mkdir grid-class/sas; cd grid-class/sas; put number-list"
220 beowulf2.dartmouth.edu GridFTP Server 1.17 CAS/SAML enabled GSSAPI type Globus/GSI wu-2.6.2 (gcc32dbg, 1083879869-52) ready.
230 User grid1 logged in.
521 "/home/grid1/grid-class/sas" directory exists
250 CWD command successful.
150 Opening BINARY mode data connection.
226 Transfer complete.
Transfer rate 16 bytes in 0.04 seconds. 0.40 KB/sec
sierra:~> condor_submit example3.submit
Submitting job(s).
Logging submit event(s).
1 job(s) submitted to cluster 19.
sierra:~/Testing/VDT> condor_q -globus


-- Submitter: sierra.dartmouth.edu : <129.170.16.93:33505> : sierra.dartmouth.edu
ID OWNER STATUS MANAGER HOST EXECUTABLE
19.0 sas UNSUBMITTED fork beowulf2.dartmouth /afs/northstar.dar
sierra:~> condor_q -globus


-- Submitter: sierra.dartmouth.edu : <129.170.16.93:33505> : sierra.dartmouth.edu
ID OWNER STATUS MANAGER HOST EXECUTABLE
19.0 sas ACTIVE fork beowulf2.dartmouth /afs/northstar.dar
sierra:~> condor_q -globus


-- Submitter: sierra.dartmouth.edu : <129.170.16.93:33505> : sierra.dartmouth.edu
ID OWNER STATUS MANAGER HOST EXECUTABLE
19.0 sas DONE fork beowulf2.dartmouth /afs/northstar.dar
sierra:~> uberftp beowulf2.dartmouth.edu "cd grid-class/sas; get number-list.output"
220 beowulf2.dartmouth.edu GridFTP Server 1.17 CAS/SAML enabled GSSAPI type Globus/GSI wu-2.6.2 (gcc32dbg, 1083879869-52) ready.
230 User grid1 logged in.
250 CWD command successful.
150 Opening BINARY mode data connection.
226 Transfer complete.
Transfer rate 59 bytes in 0.03 seconds. 1.81 KB/sec

sierra:~> more number-list.output
The sum of the numbers in file: number-list is 123.450005














Previous Top Next


CondorG_Example3.src  last modified Jun 8, 2005 Introduction Table of Contents
(frame/no frame)
Printable
(single file)
© Dartmouth College