utils.StatisticalTest Class Reference

Inheritance diagram for utils.StatisticalTest:

Public Member Functions
def	__init__ (self, threshold)
def	do_test (self)
def	get_rank (self)
def	get_status (self)
def	set_operands (self, h1, h2)

Public Attributes
	h1
	h2
	is_init
	name
	rank
	2D! return test_codes["2D"] More...
	threshold

Detailed Description

Definition at line 111 of file utils.py.

Constructor & Destructor Documentation

__init__()

def utils.StatisticalTest.__init__	(		self,
			threshold
	)

Definition at line 112 of file utils.py.

  def __init__(self,threshold):
    self.name=""
    self.h1=None
    self.h2=None
    self.threshold=float(threshold)
    self.rank=-1
    self.is_init=False

Member Function Documentation

do_test()

def utils.StatisticalTest.do_test

(

self

)

Definition at line 174 of file utils.py.

Referenced by utils.StatisticalTest.get_rank().

  def do_test(self):
    pass

#-------------------------------------------------------------------------------

get_rank()

def utils.StatisticalTest.get_rank

(

self

)

Definition at line 124 of file utils.py.

References utils.StatisticalTest.do_test(), utils.getNbins(), ConfigurableHisto.h1, utils.StatisticalTest.h1, PlotAlignmentValidation::DMRPlotInfo.h1, FitSlicesYTool.h1, EgammaTowerIsolationNew< NC >::Sum.h2, ConfigurableHisto.h2, EgammaTowerIsolationNew< NC >.h2, utils.StatisticalTest.h2, PlotAlignmentValidation::DMRPlotInfo.h2, FitSlicesYTool.h2, utils.is_empty(), utils.StatisticalTest.is_init, utils.StatisticalTest.rank, l1t::EMTFTrack.rank, and dirstructure.Comparison.rank.

Referenced by utils.StatisticalTest.get_status().

  def get_rank(self):
    if not self.is_init:
      if self.rank < 0:
        type1=type(self.h1)
        type2=type(self.h2)
        if (type1 != type2):
          logger(1,"*** ERROR: object types in comparison don't match: %s!=%s" %(type1,type2))
          self.rank=test_codes["DIFF_TYPES"]
        elif not self.h2.InheritsFrom("TH1"):
          logger(1,"*** ERROR: object type is not histogram but a %s" %(type1))
          self.rank=test_codes["NO_HIST"]    
        # if histos are empty
        #elif self.h1.InheritsFrom("TH2") and not "BinToBin" in self.name:
          
        else:
          is_empty1=is_empty(self.h1)
          is_empty2=is_empty(self.h2)
          are_empty=is_empty1 and is_empty2
          one_empty=is_empty1 or is_empty2

          Nbins1= getNbins(self.h1)
          Nbins2= getNbins(self.h2)

          if are_empty:
            #return -103
            # Conversation with JeanRoch and David 5 April
            return 1
          elif one_empty:
            # Due conversation with Giovanni on 2015-09-10
            return 0

          # if histos have different number of bins
          if Nbins1!=Nbins2:
            return test_codes["DIFF_BIN"]

      self.rank=self.do_test()
    self.is_init=True
    return self.rank

get_status()

def utils.StatisticalTest.get_status

(

self

)

Definition at line 164 of file utils.py.

References utils.StatisticalTest.get_rank(), ElectronMVAID.ElectronMVAID.name, AlignableObjectId::entry.name, average.Average.name, counter.Counter.name, histograms.Histograms.name, TmModule.name, cond::persistency::RUN_INFO::RUN_NUMBER.name, cond::persistency::TAG::NAME.name, cond::persistency::GTEditorData.name, FWLite.ElectronMVAID.name, cond::persistency::GLOBAL_TAG::NAME.name, cond::persistency::TAG::TIME_TYPE.name, cond::persistency::RUN_INFO::START_TIME.name, cond::persistency::GLOBAL_TAG::VALIDITY.name, cond::persistency::RUN_INFO::END_TIME.name, core.autovars.NTupleVariable.name, cond::persistency::TAG::OBJECT_TYPE.name, cond::persistency::GLOBAL_TAG::DESCRIPTION.name, cond::persistency::TAG::SYNCHRONIZATION.name, cond::persistency::GLOBAL_TAG::RELEASE.name, DQMRivetClient::NormOption.name, cond::persistency::TAG::END_OF_VALIDITY.name, MEPSet.name, cond::persistency::GLOBAL_TAG::SNAPSHOT_TIME.name, cond::persistency::O2O_RUN::JOB_NAME.name, cond::persistency::TAG::DESCRIPTION.name, cms::dd::NameValuePair< T >.name, cond::persistency::GLOBAL_TAG::INSERTION_TIME.name, cond::persistency::O2O_RUN::START_TIME.name, cond::persistency::TAG::LAST_VALIDATED_TIME.name, cond::persistency::O2O_RUN::END_TIME.name, cond::persistency::TAG::INSERTION_TIME.name, FWTGeoRecoGeometry::Info.name, cond::persistency::O2O_RUN::STATUS_CODE.name, cond::persistency::TAG::MODIFICATION_TIME.name, cond::persistency::O2O_RUN::LOG.name, ParameterSet.name, nanoaod::MergeableCounterTable::SingleColumn< T >.name, cond::persistency::TAG::PROTECTION_CODE.name, OutputMEPSet.name, PixelDCSObject< T >::Item.name, dataset.BaseDataset.name, SummaryTableOutputBranches::NamedBranchPtr.name, AlignmentConstraint.name, cms::dd::ValuePair< T, U >.name, fit::RootMinuitCommand.name, HcalForwardLibWriter::FileHandle.name, personalPlayback.Applet.name, EventStringOutputBranches::NamedBranchPtr.name, Types._Untracked.name, MagCylinder.name, analyzer.Analyzer.name, production_tasks.Task.name, heppy::ParSet.name, DQMRivetClient::LumiOption.name, o2olib.O2OJob.name, cond::persistency::GTProxyData.name, TriggerOutputBranches::NamedBranchPtr.name, SingleObjectCondition.name, CharmTagger::MVAVar.name, TableOutputBranches::NamedBranchPtr.name, HeavyIonCSVTagger::MVAVar.name, edm::PathTimingSummary.name, DQMRivetClient::ScaleFactorOption.name, cms::DDAlgoArguments.name, EgHLTOfflineSummaryClient::SumHistBinData.name, RHStopTracer::StopPoint.name, Barrel.name, perftools::EdmEventSize::BranchRecord.name, cond::TimeTypeSpecs.name, core.autovars.NTupleObjectType.name, EcalLogicID.name, LumiOutputBranches::NamedBranchPtr.name, edm::PathSummary.name, lumi::TriggerInfo.name, XMLProcessor::_loaderBaseConfig.name, PixelEndcapLinkMaker::Item.name, MEtoEDM< T >::MEtoEDMObject.name, dirstructure.Weighted.name, FWTableViewManager::TableEntry.name, PixelBarrelLinkMaker::Item.name, ExpressionHisto< T >.name, DQMGenericClient::EfficOption.name, python.rootplot.utilities.Hist2D.name, TreeCrawler.Package.name, Supermodule.name, CaloTrkProcessing::Detector.name, cond::persistency::GLOBAL_TAG_MAP::GLOBAL_TAG_NAME.name, cond::persistency::GLOBAL_TAG_MAP::RECORD.name, options.ConnectionHLTMenu.name, cond::persistency::GLOBAL_TAG_MAP::LABEL.name, cms::DDParsingContext::CompositeMaterial.name, MVAVar.name, cond::persistency::GLOBAL_TAG_MAP::TAG_NAME.name, DisplayManager.DisplayManager.name, cond::Tag_t.name, DQMGenericClient::ProfileOption.name, FWLite.WorkingPoints.name, dqmoffline::l1t::HistDefinition.name, magneticfield::BaseVolumeHandle.name, nanoaod::MergeableCounterTable::VectorColumn< T >.name, FastHFShowerLibrary.name, emtf::Node.name, PhysicsTools::Variable::Value.name, h4DSegm.name, PrintMaterialBudgetInfo.name, DQMGenericClient::NormOption.name, BTagProbabilityToDiscriminator::Discriminator.name, core.TriggerMatchAnalyzer.TriggerMatchAnalyzer.name, DQMGenericClient::CDOption.name, CounterChecker.name, cond::TagInfo_t.name, TrackerSectorStruct.name, MuonGeometrySanityCheckPoint.name, PhysicsTools::Calibration::Variable.name, cond::persistency::PAYLOAD::HASH.name, EDMtoMEConverter.name, DQMGenericClient::NoFlowOption.name, looper.Looper.name, Mapper::definition< ScannerT >.name, cond::persistency::PAYLOAD::OBJECT_TYPE.name, RooUtil::CutTree.name, cond::persistency::PAYLOAD::DATA.name, cond::persistency::PAYLOAD::STREAMER_INFO.name, python.rootplot.tree2hists.Plot.name, cond::persistency::PAYLOAD::VERSION.name, cond::persistency::PAYLOAD::INSERTION_TIME.name, PhysicsTools::TreeReader::Value.name, classes.MonitorData.name, PhysicsTools::ProcessRegistry< Base_t, CalibBase_t, Parent_t >.name, HistogramManager.name, classes.OutputData.name, BPHDecayToResResBuilderBase::DZSelect.name, Crystal.name, h2DSegm.name, options.HLTProcessOptions.name, cond::persistency::IOV::TAG_NAME.name, cond::persistency::IOV::SINCE.name, cond::persistency::IOV::PAYLOAD_HASH.name, utils.StatisticalTest.name, cond::persistency::IOV::INSERTION_TIME.name, DQMNet::WaitObject.name, core.TriggerBitAnalyzer.TriggerBitAnalyzer.name, python.rootplot.utilities.Hist.name, AlpgenParameterName.name, config.Analyzer.name, geometry.Structure.name, hDigis.name, core.autovars.NTupleSubObject.name, Capsule.name, core.autovars.NTupleObject.name, Ceramic.name, SiStripMonitorDigi.name, PhysicsTools::Variable.name, config.Service.name, BulkSilicon.name, adaptToRunAtMiniAOD.adaptToRunAtMiniAOD.name, APD.name, core.autovars.NTupleCollection.name, BPHRecoBuilder::BPHRecoSource.name, CaloSD::Detector.name, nanoaod::FlatTable::Column.name, BPHRecoBuilder::BPHCompSource.name, StraightTrackAlignment::RPSetPlots.name, lutNN::LutNeuronLayerFixedPoint< input_I, input_F, inputSize, lut_I, lut_F, neurons, output_I >.name, cond::persistency::TAG_AUTHORIZATION::TAG_NAME.name, cond::persistency::TAG_AUTHORIZATION::ACCESS_TYPE.name, cond::persistency::TAG_AUTHORIZATION::CREDENTIAL.name, cond::persistency::TAG_AUTHORIZATION::CREDENTIAL_TYPE.name, InnerLayerVolume.name, cond::payloadInspector::TagReference.name, NanoAODDQM::SelGroupConfig.name, cond::persistency::TAG_LOG::TAG_NAME.name, cond::persistency::TAG_LOG::EVENT_TIME.name, cond::persistency::TAG_LOG::USER_NAME.name, cond::persistency::TAG_LOG::HOST_NAME.name, cond::persistency::TAG_LOG::COMMAND.name, cond::persistency::TAG_LOG::ACTION.name, cond::persistency::TAG_LOG::USER_TEXT.name, lutNN::LutNetworkFixedPointRegression2Outputs< input_I, input_F, inputSize, layer1_lut_I, layer1_lut_F, layer1_neurons, layer1_output_I, layer2_input_I, layer2_lut_I, layer2_lut_F, layer2_neurons, layer3_input_I, layer3_0_inputCnt, layer3_0_lut_I, layer3_0_lut_F, output0_I, output0_F, layer3_1_inputCnt, layer3_1_lut_I, layer3_1_lut_F, output1_I, output1_F >.name, personalPlayback.FrameworkJob.name, Grid.name, trklet::TrackletConfigBuilder::DTCinfo.name, Grille.name, BackPipe.name, plotscripts.SawTeethFunction.name, dqm_interfaces.DirID.name, dirstructure.Comparison.name, PatchPanel.name, BackCoolTank.name, DryAirTube.name, python.rootplot.utilities.RootFile.name, crabFunctions.CrabTask.name, MBCoolTube.name, hHits.name, MBManif.name, cscdqm::ParHistoDef.name, hDeltaR.name, hTMaxCell.name, dqm_interfaces.DirWalkerFile.name, hParam.name, hMuonStat.name, cxxopts::HelpGroupDetails.name, hTOF.name, hTDelay.name, hTimes< hTime >.name, SummaryOutputProducer::GenericSummary.name, utils.StatisticalTest.rank, l1t::EMTFTrack.rank, dirstructure.Comparison.rank, EcalTPGFineGrainStripEE::Item.threshold, MessageLogger.threshold, muonisolation::Cuts::CutSpec.threshold, SiGaussianTailNoiseAdder.threshold, JetVertexMain.threshold, SingleObjectCondition.threshold, HLTLogMonitorFilter::CategoryEntry.threshold, MatchJet.threshold, SingleObjectTrigger.threshold, FastLineRecognition.threshold, CondFormats_ESObjects::dictionary.threshold, TotemRPUVPatternFinder.threshold, MuIsolatorResultProducer< BT >::DepositConf.threshold, edm::service::MessageLoggerDefaults::Category.threshold, edm::service::MessageLoggerDefaults::Destination.threshold, edm::MessageLoggerQ.threshold, EcalEBTrigPrimTestAlgo.threshold, utils.StatisticalTest.threshold, edm::service::ELdestination.threshold, and EcalTrigPrimFunctionalAlgo.threshold.

  def get_status(self):
    status = SUCCESS
    if self.get_rank()<0:
      status=NULL
      logger(0,"+++ Test %s FAILED: rank is %s and threshold is %s ==> %s" %(self.name, self.rank, self.threshold, status))  
    elif self.get_rank() < self.threshold:
      status=FAIL
    logger(0,"+++ Test %s: rank is %s and threshold is %s ==> %s" %(self.name, self.rank, self.threshold, status))
    return status

set_operands()

def utils.StatisticalTest.set_operands	(		self,
			h1,
			h2
	)

Definition at line 120 of file utils.py.

References ConfigurableHisto.h1, utils.StatisticalTest.h1, PlotAlignmentValidation::DMRPlotInfo.h1, FitSlicesYTool.h1, EgammaTowerIsolationNew< NC >::Sum.h2, ConfigurableHisto.h2, EgammaTowerIsolationNew< NC >.h2, utils.StatisticalTest.h2, PlotAlignmentValidation::DMRPlotInfo.h2, and FitSlicesYTool.h2.

  def set_operands(self,h1,h2):
    self.h1=h1
    self.h2=h2

Member Data Documentation

h1

utils.StatisticalTest.h1

Definition at line 114 of file utils.py.

Referenced by utils.Chi2.absval(), utils.Chi2.check_filled_bins(), utils.BinToBin.checkBinningMatches(), utils.BinToBin1percent.checkBinningMatches(), utils.KS.do_test(), utils.Chi2.do_test(), utils.BinToBin.do_test(), utils.BinToBin1percent.do_test(), utils.StatisticalTest.get_rank(), and utils.StatisticalTest.set_operands().

h2

utils.StatisticalTest.h2

Definition at line 115 of file utils.py.

Referenced by utils.Chi2.absval(), utils.Chi2.check_filled_bins(), utils.BinToBin.checkBinningMatches(), utils.BinToBin1percent.checkBinningMatches(), utils.KS.do_test(), utils.Chi2.do_test(), utils.BinToBin.do_test(), utils.BinToBin1percent.do_test(), utils.StatisticalTest.get_rank(), and utils.StatisticalTest.set_operands().

is_init

utils.StatisticalTest.is_init

Definition at line 118 of file utils.py.

Referenced by utils.StatisticalTest.get_rank().

name

utils.StatisticalTest.name

Definition at line 113 of file utils.py.

Referenced by config.CFG.__str__(), validation.Sample.digest(), utils.StatisticalTest.get_status(), and VIDSelectorBase.VIDSelectorBase.initialize().

rank

utils.StatisticalTest.rank

2D! return test_codes["2D"]

Definition at line 117 of file utils.py.

Referenced by utils.StatisticalTest.get_rank(), and utils.StatisticalTest.get_status().

threshold

utils.StatisticalTest.threshold

Definition at line 116 of file utils.py.

Referenced by utils.StatisticalTest.get_status().