MatrixRunner::MatrixRunner Class Reference

List of all members.

Public Member Functions
def	__init__
def	activeThreads
def	runTests
Public Attributes
	maxThreads
	runDirs
	threadList
	workFlows

---

Detailed Description

Definition at line 10 of file MatrixRunner.py.

---

Constructor & Destructor Documentation

def MatrixRunner::MatrixRunner::__init__	(		self,
			wfIn = None,
			nThrMax = 4
	)

Definition at line 12 of file MatrixRunner.py.

                                            :

        self.workFlows = wfIn

        self.threadList = []
        self.maxThreads = nThrMax

        #the directories in which it happened
        self.runDirs={}

---

Member Function Documentation

def MatrixRunner::MatrixRunner::activeThreads

(

self

)

Definition at line 22 of file MatrixRunner.py.

00023                            :
00024 
00025         nActive = 0
00026         for t in self.threadList:
00027             if t.isAlive() : nActive += 1
00028 
00029         return nActive
00030 
        

def MatrixRunner::MatrixRunner::runTests	(		self,
			opt
	)

Definition at line 31 of file MatrixRunner.py.

                           :

        testList=opt.testList
        dryRun=opt.dryRun
        cafVeto=opt.cafVeto
        
        startDir = os.getcwd()

        report=''
        noRun=(self.maxThreads==0)
        if noRun:
            print 'Not running the wf, only creating cfgs and logs'
            print 'resetting to default number of threads'
            self.maxThreads=4

        print 'Running in %s thread(s)' % self.maxThreads

            
        for wf in self.workFlows:

            if testList and float(wf.numId) not in [float(x) for x in testList]: continue

            item = wf.nameId
            if os.path.islink(item) : continue # ignore symlinks
            
            # make sure we don't run more than the allowed number of threads:
            while self.activeThreads() >= self.maxThreads:
                time.sleep(10)
                continue
            
            print '\nPreparing to run %s %s' % (wf.numId, item)
          
            current = WorkFlowRunner(wf,noRun,dryRun,cafVeto)
            self.threadList.append(current)
            current.start()
            if not dryRun:
                time.sleep(random.randint(1,5)) # try to avoid race cond by sleeping random amount of time [1,5] sec

        # wait until all threads are finished
        while self.activeThreads() > 0:
            time.sleep(0.5)


        #wrap up !
        totpassed=[]
        totfailed=[]
        def count(collect,result):
            #pad with zeros
            for i in range(len(collect),len(result)):
                collect.append(0)
            for i,c in enumerate(result):
                collect[i]+=c
                
        for pingle in self.threadList:
            pingle.join()
            try:
                count(totpassed,pingle.npass)
                count(totfailed,pingle.nfail)
                report+=pingle.report
                self.runDirs[pingle.wf.numId]=pingle.wfDir
            except Exception, e:
                msg = "ERROR retrieving info from thread: " + str(e)
                report += msg
                
        report+=' '.join(map(str,totpassed))+' tests passed, '+' '.join(map(str,totfailed))+' failed\n'
        print report

        runall_report_name='runall-report-step123-.log'
        runall_report=open(runall_report_name,'w')
        runall_report.write(report)
        runall_report.close()
        os.chdir(startDir)

        anyFail=sum(totfailed)
                                        
        return anyFail

---

Member Data Documentation

MatrixRunner::MatrixRunner::maxThreads

Definition at line 12 of file MatrixRunner.py.

MatrixRunner::MatrixRunner::runDirs

Definition at line 12 of file MatrixRunner.py.

MatrixRunner::MatrixRunner::threadList

Definition at line 12 of file MatrixRunner.py.

MatrixRunner::MatrixRunner::workFlows

Definition at line 12 of file MatrixRunner.py.