storeTreeInfo.TreeAnalyzer Class Reference

Inheritance diagram for storeTreeInfo.TreeAnalyzer:

Public Member Functions
def	__init__ (self, outFileName)
def	analyzePath (self, dirIn)
def	show (self)

Public Attributes
	dirSizes
	fileSizes
	outFileName

Detailed Description

Definition at line 6 of file storeTreeInfo.py.

Constructor & Destructor Documentation

def storeTreeInfo.TreeAnalyzer.__init__	(		self,
			outFileName
	)

Definition at line 8 of file storeTreeInfo.py.

    def __init__(self, outFileName):
        self.dirSizes  = {}
        self.fileSizes = {}
        self.outFileName = outFileName
        print "going to write to:",self.outFileName
        

Member Function Documentation

def storeTreeInfo.TreeAnalyzer.analyzePath	(		self,
			dirIn
	)

Definition at line 14 of file storeTreeInfo.py.

References storeTreeInfo.TreeAnalyzer.dirSizes, storeTreeInfo.TreeAnalyzer.fileSizes, storeTreeInfo.TreeAnalyzer.outFileName, and harvestTrackValidationPlots.str.

    def analyzePath(self, dirIn) :

        for (path, dirs, files) in os.walk(dirIn):

            if 'CVS' in path: continue
            if '.glimpse_' in path: continue
            if 'Configuration/PyReleaseValidation/data/run/' in path: continue
            
            for file in files:
                if '.glimpse_index' in file: continue
                fileName = os.path.join(path, file)
                fileSize = os.path.getsize(fileName)
                if path in self.dirSizes.keys() :
                    self.dirSizes[path] += fileSize
                else:
                    self.dirSizes[path] =  fileSize
                if os.path.isfile(fileName):
                    self.fileSizes[fileName] = fileSize

        try:
            import json
            jsonFileName = self.outFileName
            jsonFile = open(jsonFileName, 'w')
            json.dump([os.path.abspath(dirIn), self.dirSizes, self.fileSizes], jsonFile)
            jsonFile.close()
            print 'treeInfo info  written to ', jsonFileName
        except Exception as e:
            print "error writing json file:", str(e)

        try:
            import pickle
            pklFileName = self.outFileName.replace('.json','.pkl')
            pickle.dump([os.path.abspath(dirIn), self.dirSizes, self.fileSizes], open(pklFileName, 'w') )
            print 'treeInfo info  written to ', pklFileName
        except Exception as e:
            print "error writing pkl file:", str(e)
        

def storeTreeInfo.TreeAnalyzer.show

(

self

)

Definition at line 51 of file storeTreeInfo.py.

Referenced by Vispa.Main.AboutDialog.AboutDialog.onScreen(), Vispa.Gui.BoxContentDialog.BoxContentDialog.onScreen(), and Vispa.Gui.FindDialog.FindDialog.onScreen().

    def show(self):

        # for p,s in self.dirSizes.items():
        #     print p, s

        topDirs  = sorted(self.dirSizes.items() , key=itemgetter(1), reverse=True)
        topFiles = sorted(self.fileSizes.items(), key=itemgetter(1), reverse=True)

        emptyFiles = []
        for pair in topFiles:
            p, s = pair
            if s == 0:
                emptyFiles.append(p)
        print "found ",len(emptyFiles),"empty files. "

        print "found ", len(self.dirSizes.keys()), 'directories, top 10 are:'
        for i in range(10):
            print topDirs[i]

        print "found ", len(self.fileSizes.keys()), 'files, top 10 are:'
        for i in range(10):
            print topFiles[i]

Member Data Documentation

storeTreeInfo.TreeAnalyzer.dirSizes

Definition at line 9 of file storeTreeInfo.py.

Referenced by storeTreeInfo.TreeAnalyzer.analyzePath().

storeTreeInfo.TreeAnalyzer.fileSizes

Definition at line 10 of file storeTreeInfo.py.

Referenced by storeTreeInfo.TreeAnalyzer.analyzePath().

storeTreeInfo.TreeAnalyzer.outFileName

Definition at line 11 of file storeTreeInfo.py.

Referenced by storeTreeInfo.TreeAnalyzer.analyzePath().