crabFunctions Namespace Reference

This module provides common functions for tasks with crab3. More...

Classes
class	CertInfo
class	CrabController
	The CrabController class. More...
class	CrabTask
	Class for a single CrabRequest e This class represents one crab3 task/request. More...
class	TaskStats
	Class holds job statistics for several Crab tasks. More...

Functions
def	crabCommandProcess (q, crabCommandArgs)
	Function to run crab command in a new process. More...

Detailed Description

This module provides common functions for tasks with crab3.

This module provides common functions for tasks with crab3. You need no create a CrabController object in order to use the functions

Function Documentation

def crabFunctions.crabCommandProcess	(		q,
			crabCommandArgs
	)

Function to run crab command in a new process.

Some CRAB commands (e.g. submit) create broken cmssw process objects when they are created in multiple calls of crabCommand via CRAB API Running them in a new process is a workaround, see https://twiki.cern.ch/twiki/bin/view/CMSPublic/CRAB3FAQ#Multiple_submission_fails_with_a

Definition at line 316 of file crabFunctions.py.

References edm.print().

def crabCommandProcess(q,crabCommandArgs):
    # give crab3 the chance for one server glitch
    i=0
    while True:
        i+=1
        try:
            res = crabCommand(*crabCommandArgs)
            break
        except HTTPException as e:
            print("crab error ---------------")
            print(e)
            print("end error ---------------")
            print("will try again!")
            import time
            time.sleep(5)
        except CachefileNotFoundException as e:
            print("crab error ---------------")
            print(e)
            print("end error ---------------")
            print(crabCommandArgs)
            res={ 'status':"CachefileNotFound",'jobs':{}}
            break
        if i>5:
            res={ 'status':"UnexpectedError",'jobs':{}}
            break
    q.put( res )