Locked History Actions

Condor

How To Use Condor

The full manual is here.

Changing the configuration

Edit /etc/condor_config.local then sudo condor reconfig

Checking for normal operation

Try condor_status.

When condor is running normally on the server, the following processes should be present:

$ ps aux | egrep condor_
condor   10930  0.0  0.0  35692  4508 ?        Ss   14:53   0:02 /usr/sbin/condor_master
condor   10933  0.0  0.0  36440  4028 ?        Ss   14:53   0:00 condor_collector -f
condor   10941  0.1  0.0  35832  4888 ?        Ss   14:53   0:03 condor_startd -f
condor   10942  0.0  0.0  35140  4432 ?        Ss   14:53   0:00 condor_schedd -f
condor   10943  0.0  0.0  34260  3996 ?        Ss   14:53   0:00 condor_negotiator -f
root     10944  0.0  0.0  26804  5204 ?        S    14:53   0:00 condor_procd -A /var/lib/condor/log/procd_pipe.SCHEDD -S 60 -C 108
root     13939  0.2  0.0  26820  5236 ?        S    15:34   0:00 condor_procd -A /var/lib/condor/log/procd_pipe.STARTD -S 60 -C 108

Submitting jobs

Here is an example job submission. In this example, the ch10fit utility is run over a set of 200 images. The following script, "ch10fitset_submit", demonstrates:

  • using user's environment variables
  • passing arguments to executable
  • using condor Macros (See manual for details. Here ProcId is used to specify the image index argument)

  • setting the local directory for command execution
  • repeating job multiple times (Since ProcId is used the argument is incremented each time)

universe   = vanilla
getenv     = True
executable = /usr/local/bin/ch10fit
arguments  = --set 1 --image $$([ProcId+1])
log        = ch10fit.log
output     = ch10fit.$$([ProcId+1]).out
error      = ch10fit.$$([ProcId+1]).error
initialdir = /data/challenge10/likelihood/set_1
queue 200

To submit (make sure CHALLENGE_ROOT and CHALLENGE_VERSION environment variables are set!):

condor_submit ch10fitset_submit

To append or override options in the script at the the command line:

condor_submit -a "initialdir = /data/challenge10/likelihood/set_2" -a "arguments  = --set 2 --image \$\$([ProcId + 1])" ch10fitset_submit

Now to submit a range of sets (queue 4000 jobs!):

for i in {1..20}; do condor_submit -a "initialdir = /data/challenge10/likelihood/set_$i" -a "arguments  = --set $i --image \$\$([ProcId + 1])" ch10fitset_submit; done