edmStreamStallGrapher.StallMonitorParser Class Reference

Inheritance diagram for edmStreamStallGrapher.StallMonitorParser:

Public Member Functions
def	__init__ (self, f)
def	processingSteps (self)

Public Attributes
	maxNameSize
	numStreams

Private Attributes
	_esModuleNames
	_f
	_moduleNames

Detailed Description

Definition at line 153 of file edmStreamStallGrapher.py.

Constructor & Destructor Documentation

__init__()

def edmStreamStallGrapher.StallMonitorParser.__init__	(		self,
			f
	)

Definition at line 154 of file edmStreamStallGrapher.py.

References createfilelist.int, submitPVValidationJobs.split(), and mkLumiAveragedPlots.tuple.

    def __init__(self,f):
        numStreams = 0
        numStreamsFromSource = 0
        moduleNames = {}
        esModuleNames = {}
        frameworkTransitions = False
        for rawl in f:
            l = rawl.strip()
            if l and l[0] == 'M':
                i = l.split(' ')
                if i[3] == '4':
                    #found global begin run
                    numStreams = int(i[1])+1
                    break
            if numStreams == 0 and l and l[0] == 'S':
                s = int(l.split(' ')[1])
                if s > numStreamsFromSource:
                  numStreamsFromSource = s
            if len(l) > 5 and l[0:2] == "#M":
                (id,name)=tuple(l[2:].split())
                moduleNames[id] = name
                continue
            if len(l) > 5 and l[0:2] == "#N":
                (id,name)=tuple(l[2:].split())
                esModuleNames[id] = name
                continue
            if len(l) > 40 and l[0:24] == "# preFrameworkTransition":
                frameworkTransitions = True

        self._f = f
        if numStreams == 0:
          numStreams = numStreamsFromSource +2
        self.numStreams =numStreams
        self._moduleNames = moduleNames
        self._esModuleNames = esModuleNames
        self.maxNameSize =0
        for n in moduleNames.items():
            self.maxNameSize = max(self.maxNameSize,len(n))
        for n in esModuleNames.items():
            self.maxNameSize = max(self.maxNameSize,len(n))
        self.maxNameSize = max(self.maxNameSize,len(kSourceDelayedRead))
        if frameworkTransitions:
            self.maxNameSize = max(self.maxNameSize, len('streamBeginLumi'))

Member Function Documentation

processingSteps()

def edmStreamStallGrapher.StallMonitorParser.processingSteps

(

self

)

Create a generator which can step through the file and return each processing step.
Using a generator reduces the memory overhead when parsing a large file.

Definition at line 198 of file edmStreamStallGrapher.py.

References edmStreamStallGrapher.StallMonitorParser._esModuleNames, edmStreamStallGrapher.StallMonitorParser._f, edmStreamStallGrapher.StallMonitorParser._moduleNames, and edmStreamStallGrapher.processingStepsFromStallMonitorOutput().

    def processingSteps(self):
        """Create a generator which can step through the file and return each processing step.
        Using a generator reduces the memory overhead when parsing a large file.
            """
        self._f.seek(0)
        return processingStepsFromStallMonitorOutput(self._f,self._moduleNames, self._esModuleNames)

#----------------------------------------------
# Utility to get time out of Tracer output text format

Member Data Documentation

_esModuleNames

edmStreamStallGrapher.StallMonitorParser._esModuleNames

private

Definition at line 188 of file edmStreamStallGrapher.py.

Referenced by edmStreamStallGrapher.StallMonitorParser.processingSteps(), edmTracerCompactLogViewer.TracerCompactFileParser.processingSteps(), and edmModuleAllocMonitorAnalyze.ModuleAllocCompactFileParser.processingSteps().

_f

edmStreamStallGrapher.StallMonitorParser._f

private

Definition at line 183 of file edmStreamStallGrapher.py.

Referenced by mergeLHE.DefaultLHEMerger.merge(), mergeLHE.DefaultLHEMerger.merge_init_blocks(), edmStreamStallGrapher.StallMonitorParser.processingSteps(), edmTracerCompactLogViewer.TracerCompactFileParser.processingSteps(), and edmModuleAllocMonitorAnalyze.ModuleAllocCompactFileParser.processingSteps().

_moduleNames

edmStreamStallGrapher.StallMonitorParser._moduleNames

private

Definition at line 187 of file edmStreamStallGrapher.py.

Referenced by edmStreamStallGrapher.StallMonitorParser.processingSteps(), edmTracerCompactLogViewer.TracerCompactFileParser.processingSteps(), and edmModuleAllocMonitorAnalyze.ModuleAllocCompactFileParser.processingSteps().

maxNameSize

edmStreamStallGrapher.StallMonitorParser.maxNameSize

Definition at line 189 of file edmStreamStallGrapher.py.

numStreams

edmStreamStallGrapher.StallMonitorParser.numStreams

Definition at line 186 of file edmStreamStallGrapher.py.