Reference Manual

Inheritance diagram for production_tasks.CleanJobFiles:

Public Member Functions
def	__init__

def	run

Public Member Functions inherited from production_tasks.Task
def	__init__

def	addOption

def	getname

def	run

Additional Inherited Members
Public Attributes inherited from production_tasks.Task
	dataset

	instance

	name

	options

	user

Detailed Description

Removes and compresses auto-generated files from the job directory to save space.

Definition at line 841 of file production_tasks.py.

Constructor & Destructor Documentation

def production_tasks.CleanJobFiles.__init__	(	self,
		dataset,
		user,
		options
	)

Definition at line 843 of file production_tasks.py.

843

844 def __init__(self, dataset, user, options):

Task.__init__(self,'CleanJobFiles', dataset, user, options)

production_tasks.CleanJobFiles.__init__

def __init__

Definition: production_tasks.py:843

def production_tasks.CleanJobFiles.run	(	self,
		input
	)

Definition at line 845 of file production_tasks.py.

References python.multivaluedict.append(), CalibratedPatElectronProducer.dataset, production_tasks.Task.dataset, CalibratedElectronProducer.dataset, edmIntegrityCheck.IntegrityCheck.dataset, genericValidation.GenericValidationData.dataset, FileExportPlugin.FileExportPlugin.options, cmsswPreprocessor.CmsswPreprocessor.options, DOTExport.DotProducer.options, confdb.HLTProcess.options, production_tasks.Task.options, edmIntegrityCheck.IntegrityCheck.options, dataset.BaseDataset.user, EcalTPGParamReaderFromDB.user, production_tasks.Task.user, popcon::RpcDataV.user, popcon::RpcObGasData.user, popcon::RPCObPVSSmapData.user, popcon::RpcDataT.user, popcon::RpcDataI.user, popcon::RpcDataFebmap.user, popcon::RpcDataUXC.user, popcon::RpcDataGasMix.user, popcon::RpcDataS.user, MatrixInjector.MatrixInjector.user, EcalDBConnection.user, and conddblib.TimeType.user.

 
     def run(self, input):
         
         jobdir = input['CreateJobDirectory']['JobDir']
         jobs = input['MonitorJobs']['LSFJobIDs']
         job_status = input['MonitorJobs']['LSFJobStatus']
         
         actions = {'FilesToCompress':{'Files':[]},'FilesToClean':{'Files':[]}}
         
         actions['FilesToClean']['Files'].append(input['ExpandConfig']['ExpandedFullCFG'])
         if input.has_key('RunTestEvents'):
             actions['FilesToClean']['Files'].append(input['RunTestEvents']['TestCFG'])
 
         for rt in glob.iglob('%s/*.root' % jobdir):
             actions['FilesToClean']['Files'].append(rt)
         for pyc in glob.iglob('%s/*.pyc' % jobdir):
             actions['FilesToClean']['Files'].append(pyc)
 
         for j in jobs:
             status = job_status[j]
             if os.path.exists(status) and not status.endswith('.gz'):
                 actions['FilesToCompress']['Files'].append(status)
                 
         compress = GZipFiles(self.dataset,self.user,self.options)
         compressed = compress.run(actions)
 
         clean = CleanFiles(self.dataset,self.user,self.options)
         removed = clean.run(actions)
         return {'Cleaned':removed,'Compressed':compressed}
     

Public Member Functions

Additional Inherited Members

Detailed Description

Constructor & Destructor Documentation

Member Function Documentation