storeTreeInfo.TreeAnalyzer Class Reference

Inheritance diagram for storeTreeInfo.TreeAnalyzer:

Public Member Functions
def	__init__ (self, outFileName)
def	analyzePath (self, dirIn)
def	show (self)

Public Attributes
	dirSizes
	fileSizes
	outFileName

Detailed Description

Definition at line 8 of file storeTreeInfo.py.

Constructor & Destructor Documentation

__init__()

def storeTreeInfo.TreeAnalyzer.__init__	(		self,
			outFileName
	)

Definition at line 10 of file storeTreeInfo.py.

    def __init__(self, outFileName):
        self.dirSizes  = {}
        self.fileSizes = {}
        self.outFileName = outFileName
        print("going to write to:",self.outFileName)

Member Function Documentation

analyzePath()

def storeTreeInfo.TreeAnalyzer.analyzePath	(		self,
			dirIn
	)

Definition at line 16 of file storeTreeInfo.py.

References storeTreeInfo.TreeAnalyzer.dirSizes, storeTreeInfo.TreeAnalyzer.fileSizes, relativeConstraints.keys, storeTreeInfo.TreeAnalyzer.outFileName, print(), python.rootplot.root2matplotlib.replace(), and str.

    def analyzePath(self, dirIn) :

        for (path, dirs, files) in os.walk(dirIn):

            if 'CVS' in path: continue
            if '.glimpse_' in path: continue
            if 'Configuration/PyReleaseValidation/data/run/' in path: continue

            for file in files:
                if '.glimpse_index' in file: continue
                fileName = os.path.join(path, file)
                fileSize = os.path.getsize(fileName)
                if path in self.dirSizes.keys() :
                    self.dirSizes[path] += fileSize
                else:
                    self.dirSizes[path] =  fileSize
                if os.path.isfile(fileName):
                    self.fileSizes[fileName] = fileSize

        try:
            import json
            jsonFileName = self.outFileName
            jsonFile = open(jsonFileName, 'w')
            json.dump([os.path.abspath(dirIn), self.dirSizes, self.fileSizes], jsonFile)
            jsonFile.close()
            print('treeInfo info  written to ', jsonFileName)
        except Exception as e:
            print("error writing json file:", str(e))

        try:
            import pickle
            pklFileName = self.outFileName.replace('.json','.pkl')
            pickle.dump([os.path.abspath(dirIn), self.dirSizes, self.fileSizes], open(pklFileName, 'wb') )
            print('treeInfo info  written to ', pklFileName)
        except Exception as e:
            print("error writing pkl file:", str(e))

show()

def storeTreeInfo.TreeAnalyzer.show

(

self

)

Definition at line 53 of file storeTreeInfo.py.

References storeTreeInfo.TreeAnalyzer.dirSizes, storeTreeInfo.TreeAnalyzer.fileSizes, mps_monitormerge.items, print(), and FastTimerService_cff.range.

    def show(self):

        # for p,s in self.dirSizes.items():
        #     print p, s

        topDirs  = sorted(self.dirSizes.items() , key=itemgetter(1), reverse=True)
        topFiles = sorted(self.fileSizes.items(), key=itemgetter(1), reverse=True)

        emptyFiles = []
        for pair in topFiles:
            p, s = pair
            if s == 0:
                emptyFiles.append(p)
        print("found ",len(emptyFiles),"empty files. ")

        print("found ", len(self.dirSizes), 'directories, top 10 are:')
        for i in range(10):
            print(topDirs[i])

        print("found ", len(self.fileSizes), 'files, top 10 are:')
        for i in range(10):
            print(topFiles[i])

Member Data Documentation

dirSizes

storeTreeInfo.TreeAnalyzer.dirSizes

Definition at line 11 of file storeTreeInfo.py.

Referenced by storeTreeInfo.TreeAnalyzer.analyzePath(), and storeTreeInfo.TreeAnalyzer.show().

fileSizes

storeTreeInfo.TreeAnalyzer.fileSizes

Definition at line 12 of file storeTreeInfo.py.

Referenced by storeTreeInfo.TreeAnalyzer.analyzePath(), and storeTreeInfo.TreeAnalyzer.show().

outFileName

storeTreeInfo.TreeAnalyzer.outFileName

Definition at line 13 of file storeTreeInfo.py.

Referenced by storeTreeInfo.TreeAnalyzer.analyzePath().