Classes
class	BaseDataset

class	CMSDataset

class	Dataset

class	EOSDataset

class	IntegrityCheckError

class	LocalDataset

class	PrivateDataset

Functions
def	createDataset (user, dataset, pattern, readcache=False, basedir=None, run_range=None)

def	createMyDataset (user, dataset, pattern, dbsInstance, readcache=False)
	if user == 'CMS': data = CMSDataset( dataset ) elif user == 'LOCAL': if basedir is None: basedir = os.environ['CMGLOCALBASEDIR'] data = LocalDataset( dataset, basedir, pattern ) else: data = Dataset( user, dataset, pattern ) More...

def	getDatasetFromCache (cachename)

def	writeDatasetToCache (cachename, dataset)

Variables
	abspath

	action

	args

	data

	dataset = Dataset( datasetName )

string	datasetName = '/MinimumBias/Run2012D-TkAlMinBias-v1/ALCARECO'

	default

	dest

	end

	firstRun

	help

	info

	int

tuple	jsonFile

	jsonPath

	name

	options

	outName

	parser

	run_range

	type

	usage

	user

Function Documentation

def dataset.createDataset	(	user,
		dataset,
		pattern,
		readcache = `False`,
		basedir = `None`,
		run_range = `None`
	)

Definition at line 426 of file dataset.py.

References getDatasetFromCache(), and writeDatasetToCache().

Referenced by datasetToSource.datasetToSource(), production_tasks.CheckDatasetExists.run(), production_tasks.SourceCFG.run(), and writeDatasetToCache().

                    basedir = None, run_range = None):
     
     
     def cacheFileName(data, user, pattern):
         return '{user}%{name}%{pattern}.pck'.format( user = user, name = data.replace('/','_'), pattern = pattern)
 
     def writeCache(dataset):
         writeDatasetToCache( cacheFileName(dataset.name, dataset.user, dataset.pattern), dataset )
 
     def readCache(data, user, pattern):
         return getDatasetFromCache( cacheFileName(data, user, pattern) )
 
     if readcache:
         try:
             data = readCache(dataset, user, pattern)
         except IOError:
             readcache = False
     if not readcache:
         if user == 'CMS':
             data = CMSDataset( dataset , run_range = run_range)
             info = False
         elif user == 'LOCAL':
             data = LocalDataset( dataset, basedir, pattern)
             info = False
         elif user == 'EOS':
             data = EOSDataset(dataset, basedir, pattern)
             info = False
         else:
             data = Dataset( dataset, user, pattern)
         writeCache(data)

def dataset.createMyDataset	(	user,
		dataset,
		pattern,
		dbsInstance,
		readcache = `False`
	)

if user == 'CMS': data = CMSDataset( dataset ) elif user == 'LOCAL': if basedir is None: basedir = os.environ['CMGLOCALBASEDIR'] data = LocalDataset( dataset, basedir, pattern ) else: data = Dataset( user, dataset, pattern )

MM

Definition at line 467 of file dataset.py.

References join().

Referenced by datasetToSource.myDatasetToSource().

 def createMyDataset( user, dataset, pattern, dbsInstance, readcache=False):
 
     cachedir =  '/'.join( [os.environ['HOME'],'.cmgdataset'])
 
     def cacheFileName(data, user, dbsInstance, pattern):
         cf =  data.replace('/','_')
         name = '{dir}/{user}%{dbsInstance}%{name}%{pattern}.pck'.format(
             dir = cachedir,
             user = user,
             dbsInstance = dbsInstance,
             name = cf,
             pattern = pattern)
         return name
 
     def writeCache(dataset):
         if not os.path.exists(cachedir):
             os.mkdir(cachedir)
         cachename = cacheFileName(dataset.name,
                                   dataset.user,
                                   dataset.dbsInstance,
                                   dataset.pattern)
         pckfile = open( cachename, 'w')
         pickle.dump(dataset, pckfile)
 
     def readCache(data, user, dbsInstance, pattern):
         cachename = cacheFileName(data, user, dbsInstance, pattern)
         
         pckfile = open( cachename)
         dataset = pickle.load(pckfile)
         #print 'reading cache'                                                                                                                                                                   
         return dataset
 
     if readcache:
         try:
             data = readCache(dataset, user, dbsInstance, pattern)    
         except IOError:
             readcache = False
     if not readcache:
         if user == 'PRIVATE':
             data = PrivateDataset( dataset, dbsInstance )
             info = False
         writeCache(data)
     return data

def dataset.getDatasetFromCache ( cachename )

Definition at line 412 of file dataset.py.

References join().

Referenced by createDataset().

 def getDatasetFromCache( cachename ) :
     cachedir =  '/'.join( [os.environ['HOME'],'.cmgdataset'])
     pckfile = open( cachedir + "/" + cachename )
     dataset = pickle.load(pckfile)      
     return dataset
 

def dataset.writeDatasetToCache	(	cachename,
		dataset
	)

Definition at line 418 of file dataset.py.

References createDataset(), and join().

Referenced by createDataset().

 def writeDatasetToCache( cachename, dataset ):
     cachedir =  '/'.join( [os.environ['HOME'],'.cmgdataset'])
     if not os.path.exists(cachedir):
         os.mkdir(cachedir)
     pckfile = open( cachedir + "/" + cachename, 'w')
     pickle.dump(dataset, pckfile)
 

Variable Documentation

dataset.abspath

Definition at line 55 of file dataset.py.

dataset.action

Definition at line 20 of file dataset.py.

dataset.args

Definition at line 38 of file dataset.py.

dataset.data

Definition at line 49 of file dataset.py.

dataset.dataset = Dataset( datasetName )

Definition at line 931 of file dataset.py.

string dataset.datasetName = '/MinimumBias/Run2012D-TkAlMinBias-v1/ALCARECO'

Definition at line 927 of file dataset.py.

dataset.default

Definition at line 16 of file dataset.py.

dataset.dest

Definition at line 16 of file dataset.py.

dataset.end

Definition at line 934 of file dataset.py.

dataset.firstRun

Definition at line 933 of file dataset.py.

Referenced by MillePedeAlignmentAlgorithm.beginRun(), TkModuleGroupSelector.createModuleGroups(), SiPixelDcsInfo.dqmEndLuminosityBlock(), identity(), edm::SetRunHelper.setForcedRunOffset(), and SiPixelDcsInfo.SiPixelDcsInfo().

dataset.help

Definition at line 16 of file dataset.py.

dataset.info

Definition at line 46 of file dataset.py.

dataset.int

Definition at line 35 of file dataset.py.

Referenced by dataset.Dataset.__createSnippet(), dataset.Dataset.__datetime(), dataset.Dataset.__lumiSelectionSnippet(), dataset.CMSDataset.buildListOfFiles(), dataset.Dataset.convertTimeToRun(), dataset.CMSDataset.findPrimaryDatasetEntries(), dataset.PrivateDataset.findPrimaryDatasetEntries(), dataset.CMSDataset.findPrimaryDatasetNumFiles(), dataset.PrivateDataset.findPrimaryDatasetNumFiles(), dataset.Dataset.forcerunrange(), dataset.Dataset.getPrimaryDatasetEntries(), dataset.Dataset.getrunnumberfromfilename(), and dataset.BaseDataset.listOfGoodFilesWithPrescale().

tuple dataset.jsonFile

Initial value:

 = ( '/afs/cern.ch/cms/CAF/CMSCOMM/COMM_DQM/certification/'
                  'Collisions12/8TeV/Prompt/'
                  'Cert_190456-207898_8TeV_PromptReco_Collisions12_JSON.txt' )

Definition at line 928 of file dataset.py.

dataset.jsonPath

Definition at line 932 of file dataset.py.

dataset.name

Definition at line 45 of file dataset.py.

dataset.options

Definition at line 38 of file dataset.py.

dataset.outName

Definition at line 935 of file dataset.py.

Referenced by SiStripCorrelateNoise.DoPlots(), ZdcTBAnalysis.setup(), and JetMETDQMPostProcessor.~JetMETDQMPostProcessor().

dataset.parser

Definition at line 14 of file dataset.py.

dataset.run_range

Definition at line 48 of file dataset.py.

dataset.type

Definition at line 35 of file dataset.py.

dataset.usage

Definition at line 15 of file dataset.py.

dataset.user

Definition at line 44 of file dataset.py.

Referenced by EcalTPGParamReaderFromDB.analyze(), EcalTPGParamReaderFromDB.EcalTPGParamReaderFromDB(), StoreESCondition.fillHeader(), StoreEcalCondition.fillHeader(), amc::Header.Header(), InputTagDistributorService.init(), VariableHelperService.init(), VariableHelperService.set(), and SiStripConfigDb.usingDatabase().

Classes

Functions

Variables

Function Documentation

Variable Documentation