storeTreeInfo::TreeAnalyzer Class Reference

List of all members.

Public Member Functions
def	__init__
def	analyzePath
def	show
Public Attributes
	dirSizes
	fileSizes
	outFileName

---

Detailed Description

Definition at line 6 of file storeTreeInfo.py.

---

Constructor & Destructor Documentation

def storeTreeInfo::TreeAnalyzer::__init__	(		self,
			outFileName
	)

Definition at line 8 of file storeTreeInfo.py.

00009                                    :
00010         self.dirSizes  = {}
00011         self.fileSizes = {}
00012         self.outFileName = outFileName
00013         print "going to write to:",self.outFileName
        

---

Member Function Documentation

void HLTMuonValidator::analyzePath	(		self,
			dirIn
	)

Definition at line 14 of file storeTreeInfo.py.

00015                                  :
00016 
00017         for (path, dirs, files) in os.walk(dirIn):
00018 
00019             if 'CVS' in path: continue
00020             if '.glimpse_' in path: continue
00021             if 'Configuration/PyReleaseValidation/data/run/' in path: continue
00022             
00023             for file in files:
00024                 if '.glimpse_index' in file: continue
00025                 fileName = os.path.join(path, file)
00026                 fileSize = os.path.getsize(fileName)
00027                 if path in self.dirSizes.keys() :
00028                     self.dirSizes[path] += fileSize
00029                 else:
00030                     self.dirSizes[path] =  fileSize
00031                 if os.path.isfile(fileName):
00032                     self.fileSizes[fileName] = fileSize
00033 
00034         try:
00035             import json
00036             jsonFileName = self.outFileName
00037             jsonFile = open(jsonFileName, 'w')
00038             json.dump([os.path.abspath(dirIn), self.dirSizes, self.fileSizes], jsonFile)
00039             jsonFile.close()
00040             print 'treeInfo info  written to ', jsonFileName
00041         except Exception, e:
00042             print "error writing json file:", str(e)
00043 
00044         try:
00045             import pickle
00046             pklFileName = self.outFileName.replace('.json','.pkl')
00047             pickle.dump([os.path.abspath(dirIn), self.dirSizes, self.fileSizes], open(pklFileName, 'w') )
00048             print 'treeInfo info  written to ', pklFileName
00049         except Exception, e:
00050             print "error writing pkl file:", str(e)
        

def storeTreeInfo::TreeAnalyzer::show

(

self

)

Definition at line 51 of file storeTreeInfo.py.

                  :

        # for p,s in self.dirSizes.items():
        #     print p, s

        topDirs  = sorted(self.dirSizes.items() , key=itemgetter(1), reverse=True)
        topFiles = sorted(self.fileSizes.items(), key=itemgetter(1), reverse=True)

        emptyFiles = []
        for pair in topFiles:
            p, s = pair
            if s == 0:
                emptyFiles.append(p)
        print "found ",len(emptyFiles),"empty files. "

        print "found ", len(self.dirSizes.keys()), 'directories, top 10 are:'
        for i in range(10):
            print topDirs[i]

        print "found ", len(self.fileSizes.keys()), 'files, top 10 are:'
        for i in range(10):
            print topFiles[i]

---

Member Data Documentation

storeTreeInfo::TreeAnalyzer::dirSizes

Definition at line 8 of file storeTreeInfo.py.

storeTreeInfo::TreeAnalyzer::fileSizes

Definition at line 8 of file storeTreeInfo.py.

storeTreeInfo::TreeAnalyzer::outFileName

Definition at line 8 of file storeTreeInfo.py.