Functions
def	diff_igprof_analysis (profile_name, regression_profile_name, AnalysisType)

def	execute (command)

def	library_igprof_analysis (profile_name, AnalysisType)

def	simple_igprof_analysis (profile_name, AnalysisType, output_type)

Variables
	action

	AnalysisType

	args

	default

	dest

	help

	IgProfProfile

	options

	parser

	usage

Function Documentation

def cmsIgProf_Analysis.diff_igprof_analysis	(	profile_name,
		regression_profile_name,
		AnalysisType
	)

This function takes as arguments:
-a compressed (.gz) igprof output profile
-a second compressed (.gz) igprof output profile against which a regression analysis is intended to be done
-the output directory where to store the output of the regression analysis
Based on this information it automatically selects the igprof counter (PERF_TICKS, MEM_TOTAL or MEM_LIVE) to use
with igprof-analyse and it performs the regression analysis with SQLite3 output.

Definition at line 80 of file cmsIgProf_Analysis.py.

References execute(), python.rootplot.root2matplotlib.replace(), and split.

 def diff_igprof_analysis(profile_name,regression_profile_name,AnalysisType):
     
     """
     This function takes as arguments:
     -a compressed (.gz) igprof output profile
     -a second compressed (.gz) igprof output profile against which a regression analysis is intended to be done
     -the output directory where to store the output of the regression analysis
     Based on this information it automatically selects the igprof counter (PERF_TICKS, MEM_TOTAL or MEM_LIVE) to use
     with igprof-analyse and it performs the regression analysis with SQLite3 output.
     """
     #Following Giulio's filename convention:
     outfile=profile_name.split(".")[0].replace(IgProfProfile[AnalysisType],AnalysisType)+"_diff_"+regression_profile_name.split(".")[0].split("___")[-1]+".sql3"
     command='igprof-analyse --sqlite -d -v -g --diff-mode -b %s -r %s %s |sqlite3 %s'%(regression_profile_name, AnalysisType,profile_name,outfile)
     exit=execute(command)
 
     return exit

def cmsIgProf_Analysis.execute ( command )

Definition at line 18 of file cmsIgProf_Analysis.py.

References edm.print().

Referenced by DDAngular.DDAngular(), DDLinear.DDLinear(), diff_igprof_analysis(), library_igprof_analysis(), edm::SerialTaskQueue::QueuedTask< T >.QueuedTask(), edm::NoProcessProductResolver.setCache(), and simple_igprof_analysis().

 def execute(command):
     print('[IgAnalysis] %s ...' %command)
     sys.stdout.flush()
     exitstate=os.system(command)
     return exitstate
     

def cmsIgProf_Analysis.library_igprof_analysis	(	profile_name,
		AnalysisType
	)

This function takes as arguments:
-a compressed (.gz) igprof output profile
-the output directory where to store the output of the igprof-analysis merging the results by library
Based on this information it automatically selects the igprof counter (PERF_TICKS, MEM_TOTAL or MEM_LIVE) to use
with igprof-analyse and it performs the igprof-analyse analysis merging the results by library and saving the results
in the usual igprof-navigator browseable SQLite3 format.

Definition at line 96 of file cmsIgProf_Analysis.py.

References execute(), and python.rootplot.root2matplotlib.replace().

 def library_igprof_analysis(profile_name,AnalysisType):
 
     """
     This function takes as arguments:
     -a compressed (.gz) igprof output profile
     -the output directory where to store the output of the igprof-analysis merging the results by library
     Based on this information it automatically selects the igprof counter (PERF_TICKS, MEM_TOTAL or MEM_LIVE) to use
     with igprof-analyse and it performs the igprof-analyse analysis merging the results by library and saving the results
     in the usual igprof-navigator browseable SQLite3 format.
     """
     #Following Giulio's filename convention:
     outfile=profile_name.split(".")[0].replace(IgProfProfile[AnalysisType],AnalysisType)+"_merged"+".sql3"
     #Regular Expression supplied by Giulio:
     command="igprof-analyse --sqlite -d -v -g -r %s -ml -mr 's|.*/(.*)$|\\1|' %s |sqlite3 %s"%(AnalysisType,profile_name,outfile)
     exit=execute(command)
     
     return exit
 #-------------------------------------------------------------------------------
 
 # A procedure used for importing the function above with the import statement
 # or to run it if the script is called: power python..

def cmsIgProf_Analysis.simple_igprof_analysis	(	profile_name,
		AnalysisType,
		output_type
	)

This function takes as arguments:
-a compressed (.gz) igprof output profile
-the output directory where to store the output
-the type of output wanted
Based on this information it automatically selects the igprof counter
(PERF_TICKS, MEM_TOTAL or MEM_LIVE) to use with igprof-analyse and it
performs the analysis.
If ASCII output_type is given, it keeps only the first seven lines of
the output file (the report) allowing quick access to the totals for
the counters in order to put together summary tables.
If SQLite3 output_type is given, it simply dumps the full reports in
sqlite3 format, ready to be browsed by igprof-navigator GUI (standalone
or cgi-bin).

Definition at line 24 of file cmsIgProf_Analysis.py.

References execute(), edm.print(), and python.rootplot.root2matplotlib.replace().

 def simple_igprof_analysis(profile_name,AnalysisType,output_type):
     
     """This function takes as arguments:
     -a compressed (.gz) igprof output profile
     -the output directory where to store the output
     -the type of output wanted
     Based on this information it automatically selects the igprof counter
     (PERF_TICKS, MEM_TOTAL or MEM_LIVE) to use with igprof-analyse and it
     performs the analysis.
     If ASCII output_type is given, it keeps only the first seven lines of
     the output file (the report) allowing quick access to the totals for
     the counters in order to put together summary tables.
     If SQLite3 output_type is given, it simply dumps the full reports in
     sqlite3 format, ready to be browsed by igprof-navigator GUI (standalone
     or cgi-bin).
     """
     #Use profile input file to determine the name of the output file adding the counter to it:
     #outfile=profile_name[:-3]+"___"+AnalysisType+".res"
     outfile=profile_name.split(".")[0].replace(IgProfProfile[AnalysisType],AnalysisType)+".res"
     #Launch the 1 command:
     
     #command='igprof-analyse -d -v -g -r %s %s|tee -a \%s'%(AnalysisType,profile_name,outfile)
     #Replacing tee: it is polluting the log files...
 
     #igprof-analyse command depends on the output type desired:
     if output_type =="SQLite3":
         #Case of dumping the igprof-analyse report in sqlite format to be igprof-navigator browseable
         outfile= outfile[:-3]+"sql3" #NEED TO USE sql3 to be compatible with CGI-BIN igprof-navigator
         command='igprof-analyse --sqlite -d -v -g -r %s %s |sqlite3 %s'%(AnalysisType,profile_name,outfile)
         #Execute the igprof-analyse command
         exit=execute(command)
     elif output_type =="ASCII":
         #We can keep this part of the igprof-analysis, to create the html table with the totals at each dump
         command='igprof-analyse -d -v -g -r %s %s > %s'%(AnalysisType,profile_name,outfile)
         #Execute the igprof-analyse command
         exit=execute(command)
         #Let's manipulate the ASCII output to only keep the top 7 lines:
         # we open and read the txt ascii file
         print("Reading the res file")
         txt_file=open(outfile,'r')
         txt_file_content=txt_file.readlines()#again:everything is an object
         print("res file has %s lines!"%len(txt_file_content))
         txt_file.close()
         #overwrite the file to only save the first 7 lines:
         print("Overwriting the res file, to reduce it to 7 lines")
         out_file=open(outfile,'w')
         line_num=0
         for line in txt_file_content:
             out_file.write(line)
             line_num+=1
             if line_num == 7:
                 break
         out_file.close()
     
     return exit
     

Variable Documentation

cmsIgProf_Analysis.action

Definition at line 143 of file cmsIgProf_Analysis.py.

cmsIgProf_Analysis.AnalysisType

Definition at line 155 of file cmsIgProf_Analysis.py.

cmsIgProf_Analysis.args

Definition at line 146 of file cmsIgProf_Analysis.py.

cmsIgProf_Analysis.default

Definition at line 126 of file cmsIgProf_Analysis.py.

cmsIgProf_Analysis.dest

Definition at line 127 of file cmsIgProf_Analysis.py.

cmsIgProf_Analysis.help

Definition at line 125 of file cmsIgProf_Analysis.py.

cmsIgProf_Analysis.IgProfProfile

Definition at line 12 of file cmsIgProf_Analysis.py.

cmsIgProf_Analysis.options

Definition at line 146 of file cmsIgProf_Analysis.py.

cmsIgProf_Analysis.parser

Definition at line 123 of file cmsIgProf_Analysis.py.

cmsIgProf_Analysis.usage

Definition at line 122 of file cmsIgProf_Analysis.py.

Functions

Variables

Function Documentation

Variable Documentation