|
|
|
Functions | |
| def | fill_time_info (mps_index, status, cpu_time) |
Variables | |
| condor_h | |
| condor_q | |
| cpu_time | |
| string | disabled = "DISABLED" |
| loop over remaining jobs to see whether they are done More... | |
| end | |
| check for orphaned jobs More... | |
| dictionary | htcondor_jobstatus |
| mapping of HTCondor status codes to MPS status More... | |
| job_id | |
| dictionary | job_status = {} |
| deal with submitted jobs by looking into output of shell (condor_q) More... | |
| lib = mpslib.jobdatabase() | |
| collect submitted jobs (use 'in' to handle composites, e.g. More... | |
| mps_index = submitted_jobs.get(job_id, -1) | |
| status = htcondor_jobstatus[status] | |
| bool | submitted = True |
| dictionary | submitted_jobs = {} |
| userlog = os.path.join("jobData", lib.JOBDIR[mps_index], "HTCJOB") | |
| def mps_update.fill_time_info | ( | mps_index, | |
| status, | |||
| cpu_time | |||
| ) |
Fill timing info in the database for `mps_index`. Arguments: - `mps_index`: index in the MPS database - `status`: job status - `cpu_time`: extracted CPU timing information
Definition at line 11 of file mps_update.py.
References createfilelist.int, and str.
| mps_update.condor_h |
Definition at line 101 of file mps_update.py.
| mps_update.condor_q |
Definition at line 65 of file mps_update.py.
| mps_update.cpu_time |
Definition at line 69 of file mps_update.py.
| string mps_update.disabled = "DISABLED" |
loop over remaining jobs to see whether they are done
Definition at line 76 of file mps_update.py.
| mps_update.end |
check for orphaned jobs
Definition at line 80 of file mps_update.py.
| dictionary mps_update.htcondor_jobstatus |
mapping of HTCondor status codes to MPS status
Definition at line 35 of file mps_update.py.
| mps_update.job_id |
Definition at line 69 of file mps_update.py.
| dictionary mps_update.job_status = {} |
deal with submitted jobs by looking into output of shell (condor_q)
Definition at line 64 of file mps_update.py.
| mps_update.lib = mpslib.jobdatabase() |
collect submitted jobs (use 'in' to handle composites, e.g.
DISABLEDFETCH)
Definition at line 46 of file mps_update.py.
| mps_update.mps_index = submitted_jobs.get(job_id, -1) |
Definition at line 74 of file mps_update.py.
| mps_update.status = htcondor_jobstatus[status] |
Definition at line 69 of file mps_update.py.
Referenced by XMLProcessor._toXMLCh(), addFilesWithFork(), ESTimingTask.analyze(), TKStatus.analyze(), CSCTFAnalyzer.analyze(), BeamSpotProblemMonitor.analyze(), DTNoiseCalibration.analyze(), BasicHepMCValidation.analyze(), TotemRPDQMSource.analyze(), MCEfficiencyAnalyzer.analyze(), WriteL1TriggerObjectsTxt.analyze(), L1TCSCTF.analyze(), L1Validator.analyze(), CTPPSDiamondDQMSource.analyze(), HLTriggerJSONMonitoring.analyze(), FWCaloDataHistProxyBuilder.assertCaloDataSlice(), gen::PhotosInterface.attachParticles(), AntiElectronDeadECAL.beginEvent(), edm::EventProcessor.beginLumiAsync(), EcalBoundaryInfoCalculator< EcalDetId >.boundaryRecHits(), gen::AMPTHadronizer.build_ampt(), TtSemiLepHypHitFit.buildHypo(), TtSemiLepHypKinFit.buildHypo(), TtFullHadHypKinFit.buildHypo(), CaloGeometryHelper.buildNeighbourArray(), PFMETBenchmark.calculateQuantities(), EcalRecHitWorkerRecover.checkChannelStatus(), pat::UserData.checkDictionaries(), QTestStatusChecker.checkGlobalStatus(), lhef::LHEEvent.checkHepMCTree(), HFTimingTrust.checkHFTimErr(), SiPixelFedCablingTree.checkNumbering(), EcalBoundaryInfoCalculator< EBDetId >.checkRecHitHasDeadNeighbour(), EgammaHLTNxNClusterProducer.checkStatusOfEcalRecHit(), HLTEcalResonanceFilter.checkStatusOfEcalRecHit(), HLTRegionalEcalResonanceFilter.checkStatusOfEcalRecHit(), tensorflow.closeSession(), NuclearVertexBuilder.closestApproach(), edm::service.cmssw_stacktrace_fork(), compare_l1candidate(), dtCalibration::DTVDriftSegment.compute(), HFShower.compute(), HDShower.compute(), EMShower.compute(), EcalHitMaker.configureGeometry(), edm::EventProcessor.continueLumiAsync(), ErrorChecker.conversionError(), ErrorCheckerPhase0.conversionError(), dtCalibration::DTTTrigFillWithAverage.correction(), dtCalibration::DTTTrigMatchRPhi.correction(), dtCalibration::DTT0FillDefaultFromDB.correction(), dtCalibration::DTTTrigConstantShift.correction(), dtCalibration::DTT0AbsoluteReferenceCorrection.correction(), dtCalibration::DTT0ChamberReferenceCorrection.correction(), dtCalibration::DTT0FEBPathCorrection.correction(), dtCalibration::DTT0FillChamberFromDB.correction(), dtCalibration::DTTTrigT0SegCorrection.correction(), dtCalibration::DTT0WireInChamberReferenceCorrection.correction(), dtCalibration::DTTTrigResidualCorrection.correction(), TMatacq.countBadPulses(), CounterChecker.CounterChecker(), tensorflow.createSession(), CSCDCCFormatStatusDigi.CSCDCCFormatStatusDigi(), DDIsValid(), gen::TauolappInterface.decay(), LzmaFile.DecodeAll(), LzmaFile.DecodeBuffer(), dtCalibration::DTT0AbsoluteReferenceCorrection.defaultT0(), dtCalibration::DTT0ChamberReferenceCorrection.defaultT0(), dtCalibration::DTT0FEBPathCorrection.defaultT0(), dtCalibration::DTT0WireInChamberReferenceCorrection.defaultT0(), Demangle.Demangle(), EcalHitMaker.diagonalEdge(), doBZ2Compression(), edm::EDLooperBase.doDuringLoop(), PulseChiSqSNNLS.DoFit(), SiPixelGainCalibrationAnalysis.doFits(), EmissionVetoHook1.doVetoFSREmission(), EmissionVetoHook1.doVetoISREmission(), doZlibCompression(), TKStatus.dumpTkDcsStatus(), PFECALHashNavigator.ecalNeighbArray(), DTVDriftWriter.endJob(), DTT0Correction.endJob(), DTTTrigCorrection.endJob(), edm::EventProcessor.endOfLoop(), TMatacq.enterdata(), ErrorChecker.errorDetId(), ErrorCheckerPhase0.errorDetId(), ESRecHitAnalyticAlgo.EvalAmplitude(), ESRecHitFitAlgo.EvalAmplitude(), ESRecHitSimAlgo.evalAmplitude(), PhysicsTools::MVAComputer.evalInternal(), ExternalLHEProducer.executeScript(), EcalHitMaker.fastInsideCell(), MuScleFitPlotter.fillGen(), Py8toJetInput.fillJetAlgoInput(), LHETablesProducer.fillLHEObjectTable(), PFElectronTranslator.fillMVAValueMap(), TrackingQualityChecker.fillTrackingStatus(), TrackingQualityChecker.fillTrackingStatusAtLumi(), PythiaFilterIsolatedTrack.filter(), PythiaFilterTTBar.filter(), EcalDeadCellBoundaryEnergyFilter.filter(), Phase2Tracker::Phase2TrackerFEDBuffer.findChannels(), HepMCValidationHelper.findFSRPhotons(), L1GtVhdlWriterCore.findObjectType(), GenParticlesHelper.findParticles(), edm::Path.finished(), UnbinnedLikelihoodFit.fit(), TtFullHadKinFitter::KinFit.fit(), BSFitter.Fit_d0phi(), reco::GenParticle.fromHardProcessFinalState(), Phase2Tracker::Phase2TrackerFEDHeader.frontendStatus(), EcalBoundaryInfoCalculator< EcalDetId >.gapRecHits(), GaussianTailNoiseGenerator.GaussianTailNoiseGenerator(), GaussNoiseProducerFP420.generate(), GaussianTailNoiseGenerator.generate(), gen::BaseHadronizer.generateLHE(), reco::GenParticle.GenParticle(), pat::PATObject< ObjectType >.genParticleById(), pat::PATObject< reco::Muon >.genParticleRef(), DTTtrig.get(), DTMtime.get(), XrdAdaptor::ClientRequest.get_future(), Py8toJetInput.getAncestor(), dtCalibration::DTTTrigFillWithAverage.getAverage(), ESTrivialConditionRetriever.getChannelStatusFromConfiguration(), EcalTrivialConditionRetriever.getChannelStatusFromConfiguration(), EcalDeadCellTriggerPrimitiveFilter.getChannelStatusMaps(), EcalDeadCellDeltaRFilter.getChannelStatusMaps(), FWGUIManager.getContext(), pat::EventHypothesis.getDemangledSymbol(), cscdqm::Summary.GetEfficiencyHW(), PixelSLinkDataInputSource.getEventNumberFromFillWords(), HLTTauMCProducer.getGenDecayProducts(), XrdAdaptor::RequestManager.getInstance(), SiPixelInformationExtractor.getItemValue(), CrossingPtBasedLinearizationPointFinder.getLinearizationPoint(), TrackingUtility.getMEStatus(), SiStripUtility.getMEStatus(), DTDeadFlagHandler.getNewObjects(), DTPerformanceHandler.getNewObjects(), DTRangeT0Handler.getNewObjects(), DTReadOutMappingHandler.getNewObjects(), DTStatusFlagHandler.getNewObjects(), DTT0Handler.getNewObjects(), DTTPGParametersHandler.getNewObjects(), FedRawDataInputSource.getNextEvent(), cscdqm::Summary.GetReportingArea(), SiPixelUtility.getStatus(), DQMStore.getStatus(), SiPixelUtility.getStatusColor(), EcalTrivialConditionRetriever.getTrgChannelStatusFromConfiguration(), edm::EventProcessor.globalEndLumiAsync(), XrdAdaptor::Source.handle(), edm::Path.handleEarlyFinish(), edm::EventProcessor.handleNextEventForStreamAsync(), MakerResponseHandler.HandleResponse(), XrdAdaptor::ClientRequest.HandleResponse(), SendMonitoringInfoHandler.HandleResponse(), DelayedClose.HandleResponseWithHosts(), XrdAdaptor::RequestManager::OpenHandler.HandleResponseWithHosts(), EgammaHadTower.hasActiveHcal(), GenParticlesHelper.hasAncestor(), CalorimetryManager.HDShowerSimulation(), Generator.HepMC2G4(), HcalHFStatusBitFromRecHits.hfSetFlagFromRecHits(), InduceChargeFP420.induce(), PFBadHcalPseudoClusterProducer.init(), fireworks::Context.initEveElements(), RBCBasicConfig.initialise(), TTUBasicConfig.initialise(), RBCEmulator.initialise(), RPCWheel.initialise(), LogicTool< GenLogic >.initialise(), TTUEmulator.initialise(), XrdAdaptor::RequestManager.initialize(), Pythia8Hadronizer.initializeForExternalPartons(), Pythia8Hadronizer.initializeForInternalPartons(), edm::ParameterDescriptionCases< T >.insert(), edm::ParameterSwitchBase.insertAndCheckLabels(), MBUEandQCDValidation.isCharged(), HepMCValidationHelper.isChargedLepton(), EcalDeadCellDeltaRFilter.isCloseToBadEcalChannel(), AnomalousECALVariables.isDeadEcalCluster(), GenParticlesHelper.isDirect(), reco::GenParticle.isDirectHardProcessTauDecayProductFinalState(), reco::GenParticle.isDirectPromptTauDecayProductFinalState(), MBUEandQCDValidation.isNeutral(), HepMCValidationHelper.isNeutrino(), MBUEandQCDValidation.isNeutrino(), npstat.isNonDecreasing(), npstat.isNonIncreasing(), cscdqm::Summary.IsPhysicsReady(), reco::GenParticle.isPromptFinalState(), npstat.isStrictlyDecreasing(), AbsHcalFunctor.isStrictlyDecreasing(), npstat.isStrictlyIncreasing(), AbsHcalFunctor.isStrictlyIncreasing(), FFTJetProducer.iterateJetReconstruction(), reco::PFCandidateElectronExtra.kfTrackRef(), tensorflow.loadGraphDef(), tensorflow.loadMetaGraph(), main(), lhef::LHEEvent.makeHepMCParticle(), gen.GeneratorAnalyzer.GeneratorAnalyzer.makeMCInfo(), EcalUncalibRecHitMultiFitAlgo.makeRecHit(), reco::MCMatchSelector< T1, T2 >.MCMatchSelector(), MergeRootfile(), PulseChiSqSNNLS.Minimize(), CaloGeometryHelper.move(), FedRawDataInputSource.nextEvent(), tensorflow::NTSession.NTSession(), ESRecHitSimAlgo.oldEvalAmplitude(), ESRecHitSimAlgo.oldreconstruct(), XrdFile.open(), XrdAdaptor::RequestManager::OpenHandler.open(), TEcnaRead.OpenRootFile(), TEcnaRun.OpenRootFile(), TSCBLBuilderNoMaterial.operator()(), GenJetParticleSelector.operator()(), FastTimerService::ResourcesPerPath.operator+=(), trigger::TriggerObject.particle(), FFTJetCorrectionProducer.performPileupSubtraction(), pos::PixelDetectorConfig.PixelDetectorConfig(), PixelTemplateSmearerBase.PixelTemplateSmearerBase(), SymmetryFit.pol2_from_pol2(), SymmetryFit.pol2_from_pol3(), edm::OccurrenceTraits< EventPrincipal, BranchActionStreamBegin >.postPathSignal(), EPOS::EPOS_Wrapper.print_hepcom_particle(), HepMCFileReader.printEvent(), TMatacq.printitermatacqData(), RBCChamberORLogic.process(), RPCWheel.process(), edm::EventProcessor.processEventWithLooper(), WeakEffectsWeightProducer.produce(), PseudoTopProducer.produce(), TtSemiLepKinFitProducer< LeptonCollection >.produce(), ISRGammaWeightProducer.produce(), ISRWeightProducer.produce(), PdfWeightProducer.produce(), PFElectronTranslator.produce(), RPCUnpackingModule.produce(), CSCTFUnpacker.produce(), Onia2MuMuPAT.produce(), PFPhotonTranslator.produce(), FlavorHistoryProducer.produce(), l1t::GenToInputProducer.produce(), RPCTechnicalTrigger.produce(), FFTJetProducer.produce(), HcalHardcodeCalibrations.produceChannelQuality(), EcalTrivialConditionRetriever.produceEcalDAQTowerStatus(), EcalTrivialConditionRetriever.produceEcalDCSTowerStatus(), ecaldqm::CalibrationSummaryClient.producePlots(), ecaldqm::SummaryClient.producePlots(), Herwig6Hadronizer.pythiaStatusCode(), StoreEcalCondition.readEcalChannelStatusFromFile(), StoreESCondition.readESChannelStatusFromFile(), DTReadOutMapping.readOutToGeometry(), FedRawDataInputSource.readSupervisor(), IOInput.readv(), EcalDAQTowerStatusXMLTranslator.readXML(), EcalDCSTowerStatusXMLTranslator.readXML(), ESRecHitAnalyticAlgo.reconstruct(), ESRecHitSimAlgo.reconstruct(), ESRecHitFitAlgo.reconstruct(), XrdAdaptor::RequestManager.requestFailure(), FastTimerService::ResourcesPerPath.reset(), gen::Cascade2Hadronizer.residualDecay(), gen::Pythia6Hadronizer.residualDecay(), TEcnaRootFile.ReStart(), L1GtVhdlWriterCore.returnConditionsOfOneClass(), dqmservices::TriggerSelector::TreeElement.returnStatus(), Pythia8PartonSelector.run(), tensorflow.run(), run_script(), ecaldqm::RawDataTask.runOnRawData(), DQMStore.saveMonitorElementRangeToROOT(), HcalSourcePositionData.set(), DTStatusFlag.setCellDead(), DTDeadFlag.setCellDead_HV(), DTDeadFlag.setCellDead_RO(), DTDeadFlag.setCellDead_TP(), DTDeadFlag.setCellDiscCat(), DTStatusFlag.setCellFEMask(), DTStatusFlag.setCellNoHV(), DTStatusFlag.setCellNoise(), DTStatusFlag.setCellTDCMask(), DTStatusFlag.setCellTrigMask(), ESRecHitSimAlgo.setChannelStatus(), ESRecHitAnalyticAlgo.setChannelStatus(), ESRecHitFitAlgo.setChannelStatus(), FWLegoViewBase.setContext(), EcalDeadCellTriggerPrimitiveFilter.setEvtRecHitstatus(), EcalDeadCellTriggerPrimitiveFilter.setEvtTPstatus(), ESDigitizer.setGain(), EcalTBHodoscopePlaneRawHits.setHit(), reco::CSCHaloData.SetHLTBit(), FFTJetProducer.setJetStatusBit(), gen::TauolappInterface.setRandomEngine(), MonDelaysTTDat.setTaskStatus(), MonPedestalsOnlineDat.setTaskStatus(), MonPedestalOffsetsDat.setTaskStatus(), MonLaserRedDat.setTaskStatus(), MonLaserGreenDat.setTaskStatus(), MonPNPedDat.setTaskStatus(), MonLed2Dat.setTaskStatus(), MonLaserIRedDat.setTaskStatus(), MonLed1Dat.setTaskStatus(), MonLaserBlueDat.setTaskStatus(), MonMemChConsistencyDat.setTaskStatus(), MonCrystalConsistencyDat.setTaskStatus(), MonPedestalsDat.setTaskStatus(), MonTestPulseDat.setTaskStatus(), MonMemTTConsistencyDat.setTaskStatus(), MonTTConsistencyDat.setTaskStatus(), MonPNRedDat.setTaskStatus(), MonPNIRedDat.setTaskStatus(), MonPNBlueDat.setTaskStatus(), MonPNMGPADat.setTaskStatus(), MonPNLed2Dat.setTaskStatus(), MonPNGreenDat.setTaskStatus(), MonPNLed1Dat.setTaskStatus(), ITimingDat.setTaskStatus(), HBHETimingShapedFlagSetter.SetTimingShapedFlags(), reco::PFCandidateEGammaExtra.singleLegConversionRef(), XrdStorageMaker.stagein(), edm::EventProcessor.streamEndLumiAsync(), SymmetryFit.symmetryChi2(), tensorflow::TBBSession.TBBSession(), TEcnaRootFile.TEcnaRootFile(), CSCFitAFEBThr.ThresholdNoise(), HBHETimingShapedFlagSetter.timingStatus(), TMatacq.TMatacq(), HLTPerformanceInfo.totalPathCPUTime(), HLTPerformanceInfo.totalPathTime(), edm.typeDemangle(), pat::UserData.typeNameFor(), edm::UnscheduledProductResolver.unscheduledWasNotRun_(), HcaluLUTTPGCoder.update(), edm::service::CondorStatusService.updateChirpImpl(), PulseChiSqSNNLS.updateCov(), CrossingPtBasedLinearizationPointFinder.useAllTracks(), tensorflow::TBBSession.WaitForNotification(), tensorflow::NTSession.WaitForNotification(), PixelDataFormatter.word2digi(), cscdqm::Summary.Write(), npstat::LinInterpolatedTableND< Numeric, Axis >.write(), EPOS::IO_EPOS.write_event(), gs.writeCompressedStringArchive(), gs.writeStringArchive(), CrystalWindowMap.~CrystalWindowMap(), and ErrorCheckerBase.~ErrorCheckerBase().
| bool mps_update.submitted = True |
Definition at line 51 of file mps_update.py.
| dictionary mps_update.submitted_jobs = {} |
Definition at line 49 of file mps_update.py.
| mps_update.userlog = os.path.join("jobData", lib.JOBDIR[mps_index], "HTCJOB") |
Definition at line 100 of file mps_update.py.
1.8.11
