fileCollector Namespace Reference

Functions
def	convert (infile, ofile)
def	filecheck (rootfile)
def	logme (msg, args)
def	sendmail (body="Hello from visDQMZipCastorVerifier")

Variables
	cmp
	COLLECTDIR
	done
	donefile
	dqmfile
	DROPBOX
	EMAIL
	EMAILINTERVAL
	f
	files
	finalfile
	finalTdir
	finalTfile
	finalTMPfile
	fMatch
	HOSTNAME
	keeper
	lastEmailSent
	lFile
	md5Digest
	NEW
	NFOUND
	now
	NRUNS
	originFile
	originFileName
	originStr
	originTMPFile
	RETRIES
	reverse
	runnr
	runstr
	SBASEDIR
	seed
	SENDMAIL
	stdout
	subsystem
	TAGRUNEND
	TAGS
	Tfile
	TFILEDONEDIR
	Tfiles
	TMPDROPBOX
	version
	WAITTIME

Function Documentation

convert()

def fileCollector.convert	(		infile,
			ofile
	)

Definition at line 47 of file fileCollector.py.

Referenced by helper::CollectionStoreManager< OutputCollection, ClonePolicy >.cloneAndStore(), Herwig7Interface.convert(), EventMsgBuilder.EventMsgBuilder(), GlobalVariablesTableProducer::VariableT< ValType, ColType, Converter >.fill(), edm::EventItemGetter< RefType, EventType >.get(), edm::ParameterSet.getParameter(), Header.Header(), InitHeader.InitHeader(), InitMsgBuilder.InitMsgBuilder(), RunInfoTestESProducer.makeRunInfo(), MkFitSiStripHitConverter.produce(), InitMsgBuilder.setDataLength(), EventMsgBuilder.setEventLength(), CmsShowCommon.setFrom(), FWViewEnergyScale.SetFromCmsShowCommonConfig(), and EventMsgBuilder.setOrigDataSize().

def convert(infile, ofile):
  cmd = 'root -l -b -q %s/sistrip_reduce_file.C++"' \
        '(\\"%s\\", \\"%s\\")" >& /dev/null' % (SBASEDIR,infile, ofile)
  os.system(cmd)
  

filecheck()

def fileCollector.filecheck

(

rootfile

)

Definition at line 35 of file fileCollector.py.

References fileinputsource_cfi.read, and submitPVValidationJobs.split().

def filecheck(rootfile):
  cmd = 'root -l -b -q %s/filechk.C"(\\"%s\\")"' % (SBASEDIR,rootfile)
  a = os.popen(cmd).read().split()
  tag=a.pop()
  if tag == '(int)(-1)' or tag == '(int)0':
    return 0
      
  if tag == '(int)1':
    return 1
  
  return 0
     

logme()

def fileCollector.logme	(		msg,
			args
	)

Definition at line 31 of file fileCollector.py.

References print().

Referenced by DQMNet.losePeer(), DQMNet.onLocalNotify(), DQMNet.onMessage(), DQMNet.onPeerConnect(), DQMNet.onPeerData(), sendmail(), and DQMNet.updateMask().

def logme(msg, *args):
  procid = "[%s/%d]" % (__file__.rsplit("/", 1)[-1], os.getpid())
  print(datetime.now(), procid, msg % args)
  

sendmail()

def fileCollector.sendmail

(

body = "Hello from visDQMZipCastorVerifier"

)

Definition at line 52 of file fileCollector.py.

References logme().

def sendmail(body="Hello from visDQMZipCastorVerifier"):
  scall = Popen("%s -t" % SENDMAIL, shell=True, stdin=PIPE)
  scall.stdin.write("To: %s\n" % EMAIL)
  scall.stdin.write("Subject: File Collector on server %s has a Critical Error\n" %
                     HOSTNAME)
  scall.stdin.write("\n") # blank line separating headers from body
  scall.stdin.write("%s\n" % body)
  scall.stdin.close()
  rc = scall.wait()
  if rc != 0:
     logme("ERROR: Sendmail exit with status %s", rc)
  
# --------------------------------------------------------------------

Variable Documentation

cmp

fileCollector.cmp

Definition at line 125 of file fileCollector.py.

Referenced by combiner::helpers::NormalClone.addDaughter(), combiner::helpers::ShallowClone.addDaughter(), combiner::helpers::ShallowClonePtr.addDaughter(), CandCombiner< Selector, PairSelector, Cloner, OutputCollection, Setup >.addDaughter(), PFAnalysis.associateClusterToSimCluster(), cloneDecayTree(), EMTFSubsystemCollector.cluster_rpc(), NamedCandCombinerBase.combine(), CandCombinerBase< OutputCollection, Cloner::CandPtr >.combine(), geometryXMLparser.cscorder(), dqmMemoryStats.HistogramAnalyzer.difference(), geometryXMLparser.dtorder(), edmNew::DetSetVector< SiStripCluster >.equal_range(), CSCDigiValidator.filter(), cond::OMSServiceQuery.filter(), LocalMaximumSeedFinder.findSeeds(), makeCompositeCandidate(), makeCompositeCandidateWithRefsToMaster(), makeCompositePtrCandidate(), makeNamedCompositeCandidate(), makeNamedCompositeCandidateWithRefsToMaster(), CompositeCandSelector< Selector, T1, T2, nDau >.operator()(), TotemVFATStatus.operator<(), and L1Comparator.process().

COLLECTDIR

fileCollector.COLLECTDIR

Definition at line 14 of file fileCollector.py.

done

fileCollector.done

Definition at line 123 of file fileCollector.py.

Referenced by LMFDat.adjustParameters(), HcalIsoTrkSimAnalyzer.analyze(), HcalIsoTrkAnalyzer.analyze(), BaseParticlePropagator.backPropagate(), EcalCoder.encode(), SimG4FluxProducer.endOfEvent(), trklet::TrackletProcessor.execute(), HLTLogMonitorFilter.filter(), Thrust.finalAxis(), reco::PositiveSideGhostTrackFitter.fit(), for(), edm.loadExtraClasses(), DQMNet.onPeerData(), AlCaHcalIsotrkProducer.produce(), ParticlePropagator.propagateToBoundSurface(), BaseParticlePropagator.propagateToClosestApproach(), BaseParticlePropagator.propagateToEcalEntrance(), BaseParticlePropagator.propagateToHcalEntrance(), BaseParticlePropagator.propagateToHcalExit(), BaseParticlePropagator.propagateToHOLayer(), TrajectoryManager.propagateToLayer(), BaseParticlePropagator.propagateToPreshowerLayer1(), BaseParticlePropagator.propagateToPreshowerLayer2(), BaseParticlePropagator.propagateToVFcalEntrance(), edm::storage::DCacheFile.read(), edm::storage::DavixFile.read(), edm::storage::LStoreFile.read(), edm::storage::Storage.readv(), TPNPulse.setPulse(), TAPDPulse.setPulse(), edm::storage::LStoreFile.write(), edm::storage::DCacheFile.write(), edm::storage::Storage.writev(), edm::storage::Storage.xread(), edm::storage::Storage.xreadv(), edm::storage::Storage.xwrite(), and edm::storage::Storage.xwritev().

donefile

fileCollector.donefile

Definition at line 90 of file fileCollector.py.

dqmfile

fileCollector.dqmfile

Definition at line 162 of file fileCollector.py.

Referenced by get_filename(), read_badmodlist(), and read_runflag().

DROPBOX

fileCollector.DROPBOX

Definition at line 16 of file fileCollector.py.

EMAIL

fileCollector.EMAIL

Definition at line 13 of file fileCollector.py.

EMAILINTERVAL

fileCollector.EMAILINTERVAL

Definition at line 20 of file fileCollector.py.

f

fileCollector.f

Definition at line 91 of file fileCollector.py.

files

fileCollector.files

Definition at line 125 of file fileCollector.py.

finalfile

fileCollector.finalfile

Definition at line 191 of file fileCollector.py.

finalTdir

fileCollector.finalTdir

Definition at line 131 of file fileCollector.py.

finalTfile

fileCollector.finalTfile

Definition at line 130 of file fileCollector.py.

finalTMPfile

fileCollector.finalTMPfile

Definition at line 128 of file fileCollector.py.

fMatch

fileCollector.fMatch

Definition at line 82 of file fileCollector.py.

HOSTNAME

fileCollector.HOSTNAME

Definition at line 25 of file fileCollector.py.

keeper

fileCollector.keeper

Definition at line 124 of file fileCollector.py.

lastEmailSent

fileCollector.lastEmailSent

Definition at line 28 of file fileCollector.py.

lFile

fileCollector.lFile

Definition at line 181 of file fileCollector.py.

Referenced by l1tpf::corrector.init_(), l1tpf::corrector.initEmulation_(), and l1tpf::corrector.writeToFile().

md5Digest

fileCollector.md5Digest

Definition at line 173 of file fileCollector.py.

NEW

fileCollector.NEW

Definition at line 78 of file fileCollector.py.

NFOUND

fileCollector.NFOUND

Definition at line 77 of file fileCollector.py.

now

fileCollector.now

Definition at line 207 of file fileCollector.py.

NRUNS

fileCollector.NRUNS

Definition at line 76 of file fileCollector.py.

originFile

fileCollector.originFile

Definition at line 176 of file fileCollector.py.

originFileName

fileCollector.originFileName

Definition at line 192 of file fileCollector.py.

originStr

fileCollector.originStr

Definition at line 174 of file fileCollector.py.

originTMPFile

fileCollector.originTMPFile

Definition at line 175 of file fileCollector.py.

RETRIES

fileCollector.RETRIES

Definition at line 23 of file fileCollector.py.

reverse

fileCollector.reverse

Definition at line 104 of file fileCollector.py.

runnr

fileCollector.runnr

Definition at line 87 of file fileCollector.py.

Referenced by EnergyScaleCorrection.getScaleCorr(), EnergyScaleCorrection.getSmearCorr(), EnergyScaleCorrection::CorrectionCategory.inCategory(), L1MuGMTHWFileReader.readNextEvent(), L1MuGMTInputEvent.setRunNumber(), and EnergyScaleCorrection.smearingSigma().

runstr

fileCollector.runstr

Definition at line 89 of file fileCollector.py.

SBASEDIR

fileCollector.SBASEDIR

Definition at line 21 of file fileCollector.py.

seed

fileCollector.seed

Definition at line 127 of file fileCollector.py.

Referenced by egPM::AbsEtaNrClus.AbsEtaNrClus(), egPM::AbsEtaNrClusEt.AbsEtaNrClusEt(), egPM::AbsEtaNrClusPhi.AbsEtaNrClusPhi(), pat::TriggerPath.addL1Seed(), AlCaECALRecHitReducer.AddMiniRecHitCollection(), BaseCkfTrajectoryBuilder.addToResult(), SimTrackstersProducer.addTrackster(), GroupedCkfTrajectoryBuilder.advanceOneLayer(), ElectronMcSignalValidator.analyze(), EgammaSuperClusters.analyze(), MuonSeedsAnalyzer.analyze(), ElectronMcFakeValidator.analyze(), PhotonMVANtuplizer.analyze(), ElectronMVANtuplizer.analyze(), SeedMultiplicityAnalyzer.analyze(), EopElecTreeWriter.analyze(), reco::GraphMap.assignHighestScoreEdge(), TrackAssociatorByHitsImpl.associateRecoToSim(), TrackAssociatorByHitsImpl.associateSimToReco(), BaseCkfTrajectoryBuilder.backwardPropagator(), edm::BeamHaloProducer.beginLuminosityBlock(), ExternalLHEProducer.beginRunProduce(), trklet::Settings.bendcutTE(), heppy::BTagSF.BTagSF(), PFECALSuperClusterAlgo.buildAllSuperClustersDeepSC(), Basic2DGenericTopoClusterizer.buildClusters(), GenericSimClusterMapper.buildClusters(), PFClusterFromHGCalTrackster.buildClusters(), RealisticSimClusterMapper.buildClusters(), Phase1L1TJetProducer.buildJetFromSeed(), Phase1L1TJetProducer.buildJetsFromSeeds(), Phase1L1TJetProducer.buildJetsFromSeedsWithPUSubtraction(), PFECALSuperClusterAlgo.buildSuperClusterMustacheOrBox(), MuonSeedTrack.buildTrackAtPCA(), GroupedCkfTrajectoryBuilder.buildTrajectories(), CkfTrajectoryBuilder.buildTrajectories(), HLTElectronPixelMatchFilter.calDPhi1Sq(), HLTElectronPixelMatchFilter.calDPhi2Sq(), HLTElectronPixelMatchFilter.calDZ2Sq(), edm::BeamHaloProducer.call_ki_bhg_init(), EgammaHLTPixelMatchVarProducer.calS2(), L1TMuonBarrelKalmanAlgo.chain(), trklet::ChannelAssignment.ChannelAssignment(), MuonSeedSimpleCleaner.checkPt(), MuonSeedSimpleCleaner.clean(), RedundantSeedCleaner.clean(), L1TMuonBarrelKalmanAlgo.clean(), TrackerSeedCleaner.clean(), EcalClusterPUCleaningTools.CleanedSuperCluster(), EcalClusterSeverityLevelAlgo.closestProblematic(), HGCalHistoClusteringImplSA.clusterSeedMulticluster_SA(), SeedMvaEstimator.computeMva(), reco::EcalClustersGraph.computeVariables(), HGCalHistoClusteringWrapper.convertCMSSWInputs(), MkFitSeedConverter.convertSeeds(), CosmicTrajectoryBuilder.createStartingTrajectory(), BaseCkfTrajectoryBuilder.createStartingTrajectory(), CRackTrajectoryBuilder.createStartingTrajectory(), MuonTagger.discriminator(), OutsideInMuonSeeder.doLayer(), TICLTrackstersEdgesValidation.dqmAnalyze(), HGCalHistoClusteringImpl.dR(), L1SCJetEmu.emulateEvent(), EcalClusterSeverityLevelAlgo.etaphiDistanceClosestProblematic(), trklet::FitTrack.execute(), FastTSGFromL2Muon.FastTSGFromL2Muon(), big::bigEntry.fill(), PixelData.fill(), TrackingNtuple.fillSeeds(), trklet::TrackDerTable.fillTable(), LeptonSkimming.filter(), PFECALSuperClusterAlgo.finalizeSuperCluster(), mkfit::MkBuilder.find_tracks_load_seeds(), mkfit::MkBuilder.find_tracks_load_seeds_BH(), MuonCkfTrajectoryBuilder.findCompatibleMeasurements(), CkfTrajectoryBuilder.findCompatibleMeasurements(), HGCalImagingAlgo.findLocalMaximaInCluster(), BaseCkfTrajectoryBuilder.findStateAndLayers(), TrajectoryFitter.fit(), CosmicMuonSmoother.fit(), BaseCkfTrajectoryBuilder.forwardPropagator(), LaserBeamsTEC2.GeneratePrimaries(), LaserBeamsTEC1.GeneratePrimaries(), LaserBeamsBarrel.GeneratePrimaries(), L1TUtmTriggerMenu.getFirmwareUuidHashed(), reco::EcalClustersGraph.getGraphOutput(), trklet::PurgeDuplicate.getInventedCoordsExtended(), egamma.getRandomSeedFromObj(), egamma.getRandomSeedFromSC(), MTVHistoProducerAlgoForTracker.getSeedingLayerSetBin(), MuonHLTSeedMVAClassifier.getSeedMva(), MuonSeedTrack.getSeedTSOS(), MuonTrackAnalyzer.getSeedTSOS(), FakeTrackProducer< T >.getState(), CachingSeedCleanerBySharedInput.good(), GroupedCkfTrajectoryBuilder.groupedLimitedCandidates(), reco::GsfElectronCore.GsfElectronCore(), edm.hash_combine(), DTCombinatorialPatternReco::TriedPattern.hash_combine(), edm.hash_value(), mkfit::MkBuilder.import_seeds(), mkfit::CombCandidate.importSeed(), L1TauEmu.inCone(), L1SCJetEmu.inCone(), SeedFinder.insertHit(), mkfit::EventOfCombCandidates.insertSeed(), ElectronPFIsolationWithConeVeto.isInIsolationCone(), PhotonPFIsolationWithConeVeto.isInIsolationCone(), L1MuKBMTrack.L1MuKBMTrack(), LowPtGsfElectronSeedProducer.lightGsfTracking(), CkfTrajectoryBuilder.limitedCandidates(), AdaptiveVertexFitter.linearizeTracks(), ReducedEGProducer.linkCaloClusters(), LowPtGsfElectronSeedProducer.loop(), cond::auth::KeyGenerator.make(), ExternalLHEProducer.makeArgs(), CalibrationTrackSelectorFromDetIdList.makeCandidate(), reco::modules::CosmicTrackSplitter.makeCandidate(), reco::modules::TrackerTrackHitFilter.makeCandidate(), L1SCJetEmu.makeJet_HW(), L1SeedConePFJetProducer.makeJet_SW(), SETSeedFinder.makeSeed(), TSGForOIDNN.makeSeedsFromHitDoublets(), TSGForOIDNN.makeSeedsFromHits(), TSGForOIFromL2.makeSeedsFromHits(), HybridClusterAlgo.makeSuperClusters(), L1NNTauProducer.makeTau_HW(), cond::auth::KeyGenerator.makeWithRandomSize(), L1TMuonBarrelKalmanAlgo.match(), EgammaHLTExtraProducer.matchingGsfTrks(), SeedMatcher.matchRecHitCombinations(), TrackMerger.merge(), l1t::Stage2Layer2TauAlgorithmFirmwareImp1.merging(), EGRegressionModifierV2.modifyObject(), L1TUtmTriggerMenu.murmurHashNeutral2(), HiEgammaSCEnergyCorrectionAlgo.nCrystalsGT2Sigma(), EgammaSCEnergyCorrectionAlgo.nCrystalsGT2Sigma(), TracksClusteringFromDisplacedSeed.nearTracks(), trklet::Settings.NTC(), reco::tau::RecoTauPiZeroStripPlugin.operator()(), PixelHitMatcher.operator()(), TrajSeedMatcher.operator()(), CtfSpecialSeedGenerator.postCheck(), CSCCrosstalkConditions.prefillCrosstalk(), CSCFakeDBCrosstalk.prefillDBCrosstalk(), CSCFakeDBGains.prefillDBGains(), CSCFakeDBNoiseMatrix.prefillDBNoiseMatrix(), CSCFakeDBPedestals.prefillDBPedestals(), CSCGainsConditions.prefillGains(), reco::GraphMap.printGraphMap(), MultiVertexFitter.printWeights(), L1TMuonBarrelKalmanRegionModule.process(), EgammaHLTPixelMatchElectronAlgo.process(), L1NNTauProducer.process_HW(), l1t::Stage2Layer2EGammaAlgorithmFirmwareImp1.processEvent(), L1SeedConePFJetProducer.processEvent_SW(), TrajSeedMatcher.processSeed(), CalibratedPhotonProducerRun2T< T >.produce(), LowPtGsfElectronSeedValueMapsProducer.produce(), photonIsolationHIProducer.produce(), CalibratedElectronProducerRun2T< T >.produce(), LowPtGsfElectronSCProducer.produce(), TrackProducerWithSCAssociation.produce(), TSGFromL1Muon.produce(), MuonReSeeder.produce(), EcalBarrelClusterFastTimer.produce(), L3TkMuonProducer.produce(), MuonSeedMerger.produce(), SeedClusterRemoverPhase2.produce(), ElectronSeedProducer.produce(), CleanAndMergeProducer.produce(), SeedClusterRemover.produce(), PFTrackProducer.produce(), UncleanSCRecoveryProducer.produce(), SETMuonSeedProducer.produce(), CosmicMuonSeedGenerator.produce(), TrackTimeValueMapProducer.produce(), TrackCandidateProducer.produce(), EGMSeedGainProducer< T >.produce(), MuonHLTSeedMVAClassifier.produce(), TrackCandidateTopBottomHitFilter.produce(), HLTL1MuonNoL2Selector.produce(), HiSpikeCleaner.produce(), SimPFProducer.produce(), UnifiedSCCollectionProducer.produce(), pat::PATPhotonProducer.produce(), SeedToTrackProducer.produce(), TrackFromSeedProducer.produce(), TriggerObjectTableProducer.produce(), HLTScoutingEgammaProducer.produce(), IsolatedPixelTrackCandidateProducer.produce(), IsolatedPixelTrackCandidateL1TProducer.produce(), pat::PATElectronProducer.produce(), cms::CosmicTrackFinder.produce(), PhotonIDValueMapProducer.produce(), EgammaHLTPixelMatchVarProducer.produce(), SmearedJetProducerT< T >.produce(), HGCalIsoCalculator.produceHGCalIso(), mkfit::StdSeq::Quality.quality_process(), GroupedCkfTrajectoryBuilder.rebuildSeedingRegion(), GroupedCkfTrajectoryBuilder.rebuildTrajectories(), MuonTrackFinder.reconstruct(), AdaptiveVertexFitter.reLinearizeTracks(), AdaptiveVertexFitter.reWeightTracks(), heppy::RochCor.RochCor(), heppy::RochCor2012.RochCor2012(), edm::RootEmbeddedFileSequence.RootEmbeddedFileSequence(), ecaldqm::PiZeroTask.runOnEBRecHits(), MuonSeedCleaner.SeedChi2(), btagbtvdeep.seedingTracksToFeatures(), trklet::Settings.seedlayers(), MuonSeedCleaner.SeedLength(), CosmicTrajectoryBuilder.seedMeasurements(), BaseCkfTrajectoryBuilder.seedMeasurements(), CRackTrajectoryBuilder.seedMeasurements(), MuonSeedCleaner.SeedMomentum(), MuonSeedCleaner.SeedPosition(), MuonOverlapSeedFromRecHits.seeds(), MuonTrackAnalyzer.seedsAnalysis(), EcalMipGraphs.selectHits(), EcalDisplaysByEvent.selectHits(), GsfElectronAlgo.setCutBasedPreselectionFlag(), GsfElectronAlgo.setPixelMatchInfomation(), ParameterMgr.setRandomSeed(), QjetsPlugin.SetRandSeed(), Qjets.SetRandSeed(), edm::TRandomAdaptor.setSeed(), AlignableModifier.setSeed(), reco::HLTTau.setSeedEcalHitEt(), reco::HLTTau.setSeedHcalHitEt(), trigger::EgammaObject.setSeeds(), SmearedJetProducerT< T >.SmearedJetProducerT(), CosmicTrajectoryBuilder.SortHits(), CRackTrajectoryBuilder.SortHits(), CosmicTrajectoryBuilder.startingTSOS(), CRackTrajectoryBuilder.startingTSOS(), SurveyPxbDicer.SurveyPxbDicer(), trklet::Track.Track(), FastTSGFromIOHit.trackerSeeds(), ExhaustiveMuonTrajectoryBuilder.trajectories(), TrajectoryBuilder.trajectories(), DirectMuonTrajectoryBuilder.trajectories(), GroupedCkfTrajectoryBuilder.trajectories(), StandAloneMuonTrajectoryBuilder.trajectories(), CkfTrajectoryBuilder.trajectories(), CosmicMuonTrajectoryBuilder.trajectories(), CosmicMuonSmoother.trajectories(), GlobalCosmicMuonTrajectoryBuilder.trajectories(), TrackTransformerForGlobalCosmicMuons.transform(), TrackTransformerForCosmicMuons.transform(), TrackTransformer.transform(), GlobalMuonRefitter.transform(), CosmicMuonSeedGenerator.tsosToSeed(), MultiVertexFitter.updateSeeds(), MultiVertexFitter.updateWeights(), AdaptiveVertexFitter.vertex(), QuickTrackAssociatorByHitsImpl.weightedNumberOfTrackClusters(), and AdaptiveVertexFitter.weightTracks().

SENDMAIL

fileCollector.SENDMAIL

Definition at line 24 of file fileCollector.py.

stdout

fileCollector.stdout

Definition at line 11 of file fileCollector.py.

subsystem

fileCollector.subsystem

Definition at line 88 of file fileCollector.py.

TAGRUNEND

fileCollector.TAGRUNEND

Definition at line 110 of file fileCollector.py.

TAGS

fileCollector.TAGS

Definition at line 79 of file fileCollector.py.

Tfile

fileCollector.Tfile

Definition at line 170 of file fileCollector.py.

TFILEDONEDIR

fileCollector.TFILEDONEDIR

Definition at line 15 of file fileCollector.py.

Tfiles

fileCollector.Tfiles

Definition at line 125 of file fileCollector.py.

TMPDROPBOX

fileCollector.TMPDROPBOX

Definition at line 22 of file fileCollector.py.

version

fileCollector.version

Definition at line 180 of file fileCollector.py.

WAITTIME

fileCollector.WAITTIME

Definition at line 19 of file fileCollector.py.