CMS 3D CMS Logo

List of all members | Classes | Public Types | Public Member Functions | Protected Member Functions | Private Attributes
edm::JobReport Class Reference

#include <JobReport.h>

Inheritance diagram for edm::JobReport:
edm::service::JobReportService

Classes

class  AtomicLongLong
 
struct  InputFile
 
struct  JobReportImpl
 
struct  OutputFile
 
struct  RunReport
 

Public Types

typedef unsigned int RunNumber
 
typedef std::size_t Token
 

Public Member Functions

std::string dumpFiles (void)
 debug/test util More...
 
void eventReadFromFile (InputType inputType, Token fileToken)
 
void eventWrittenToFile (Token fileToken, RunNumber_t run, EventNumber_t event)
 
void inputFileClosed (InputType inputType, Token fileToken)
 
Token inputFileOpened (std::string const &physicalFileName, std::string const &logicalFileName, std::string const &catalog, std::string const &inputType, std::string const &inputSourceClassName, std::string const &moduleLabel, std::string const &guid, std::vector< std::string > const &branchNames)
 
 JobReport ()
 
 JobReport (std::ostream *outputStream)
 
 JobReport (JobReport const &)=delete
 
JobReportoperator= (JobReport const &)=delete
 
void outputFileClosed (Token fileToken)
 
Token outputFileOpened (std::string const &physicalFileName, std::string const &logicalFileName, std::string const &catalog, std::string const &outputModuleClassName, std::string const &moduleLabel, std::string const &guid, std::string const &dataType, std::string const &branchHash, std::vector< std::string > const &branchNames)
 
void reportAnalysisFile (std::string const &fileName, std::map< std::string, std::string > const &fileData)
 
void reportDataType (Token fileToken, std::string const &dataType)
 
void reportError (std::string const &shortDesc, std::string const &longDesc, int const &exitCode)
 
void reportFallbackAttempt (std::string const &pfn, std::string const &lfn, std::string const &err)
 
void reportFastClonedBranches (std::set< std::string > const &fastClonedBranches, long long nEvents)
 Inform the job report that branches have been fast Cloned. More...
 
void reportFastCopyingStatus (Token t, std::string const &inputFileName, bool fastCopying)
 
void reportInputLumiSection (unsigned int run, unsigned int lumiSectId)
 
void reportInputRunNumber (unsigned int run)
 
void reportLumiSection (JobReport::Token token, unsigned int run, unsigned int lumiSectId, unsigned long nEvents=0)
 
void reportMemoryInfo (std::vector< std::string > const &memoryData)
 
void reportMessageInfo (std::map< std::string, double > const &messageData)
 
void reportPerformanceForModule (std::string const &metricClass, std::string const &moduleName, std::map< std::string, std::string > const &metrics)
 
void reportPerformanceSummary (std::string const &metricClass, std::map< std::string, std::string > const &metrics)
 
void reportRandomStateFile (std::string const &name)
 
void reportReadBranch (InputType inputType, std::string const &branchName)
 Inform the job report that a branch has been read. More...
 
void reportReadBranches ()
 
void reportRunNumber (JobReport::Token token, unsigned int run)
 
void reportSkippedEvent (RunNumber_t run, EventNumber_t event)
 
void reportSkippedFile (std::string const &pfn, std::string const &lfn)
 
 ~JobReport ()
 

Protected Member Functions

edm::propagate_const< std::unique_ptr< JobReportImpl > > & impl ()
 

Private Attributes

edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
 
std::mutex write_mutex
 

Detailed Description

Description: A service that collections job handling information.

Usage: The JobReport service collects 'job handling' information (currently file handling) from several sources, collates the information, and at appropriate intervals, reports the information to the job report, through the MessageLogger.

CMS-THREADING Some notes about thread safety:

  1. It is assumed non-experts will turn the job report on and look at the XML output and NOT call the available public functions. Many of the available service functions can be called at times that are not thread safe (causing data races or interleaved output). The following notes are for Framework experts and detail the assumptions made when modifying JobReport to run in the multithreaded Framework.
  2. We assume the primary input source performs its activity serially. There can be multiple secondary input sources running concurrently.
  3. We assume the following sequence of activities where the lines of asterisks indicate synchronization points:

open primary input file nothing else running concurrently Also respondToOpenInputFiles serially

open output files serially nothing else running concurrently

The primary source runs its other tasks concurrently with the secondary sources running their tasks and modules running their tasks.

close primary input file nothing else running concurrently

close output files serially nothing else running concurrently

repeat the above (the output file opens and closes are optional except for the first and last)

All endJob and postEndJob activities occur serially not concurrently

  1. We assume that a single instance of an OutputModule will only be running on one thread at a time. Other instances of that type of OutputModule may be running concurrently. There are several functions where this is an issue. We have discussed that in the future we might decide to run the OutputModule for multiple events concurrently. That would require further modifications of either the JobReport or the OutputModule.
  2. For Primary and SecondaryFile input sources (not SecondarySource) the calls to reportBranchName from the delayed reader need to be serialized.

Definition at line 103 of file JobReport.h.

Member Typedef Documentation

typedef unsigned int edm::JobReport::RunNumber

Definition at line 106 of file JobReport.h.

typedef std::size_t edm::JobReport::Token

Definition at line 107 of file JobReport.h.

Constructor & Destructor Documentation

edm::JobReport::JobReport ( )

Definition at line 330 of file JobReport.cc.

330  :
331  impl_(new JobReportImpl(nullptr)) {
332  }
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
edm::JobReport::JobReport ( std::ostream *  outputStream)

Definition at line 334 of file JobReport.cc.

References impl_.

334  : impl_(new JobReportImpl(iOstream)) {
335  if(impl_->ost_) {
336  *(impl_->ost_) << "<FrameworkJobReport>\n";
337  }
338  }
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
edm::JobReport::JobReport ( JobReport const &  )
delete
edm::JobReport::~JobReport ( )

Definition at line 323 of file JobReport.cc.

References impl_.

323  {
324  impl_->flushFiles();
325  if(impl_->ost_) {
326  *(impl_->ost_) << "</FrameworkJobReport>\n" << std::flush;
327  }
328  }
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434

Member Function Documentation

std::string edm::JobReport::dumpFiles ( void  )

debug/test util

Definition at line 725 of file JobReport.cc.

References f, edm::findOrDefault(), impl_, and mps_check::msg.

725  {
726  std::ostringstream msg;
727 
728 
729  for(auto const& f :impl_->outputFiles_) {
730 
731  msg << "\n<File>";
732  msg << f;
733 
734  msg << "\n<LumiSections>";
735  msg << "\n<Inputs>";
736  typedef std::vector<JobReport::Token>::iterator iterator;
737  for(auto const& iInput : f.contributingInputs) {
738  auto const& inpFile = impl_->inputFiles_[iInput];
739  msg << "\n<Input>";
740  msg << "\n <LFN>" << TiXmlText(inpFile.logicalFileName) << "</LFN>";
741  msg << "\n <PFN>" << TiXmlText(inpFile.physicalFileName) << "</PFN>";
742  msg << "\n <FastCopying>" << findOrDefault(f.fastCopyingInputs, inpFile.physicalFileName) << "</FastCopying>";
743  msg << "\n</Input>";
744  }
745  msg << "\n</Inputs>";
746  msg << "\n</File>";
747 
748  }
749  return msg.str();
750  }
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
double f[11][100]
Value const & findOrDefault(std::map< Key, Value > const &m, Key const &k, Value const &defaultValue)
Definition: Map.h:28
tuple msg
Definition: mps_check.py:277
void edm::JobReport::eventReadFromFile ( InputType  inputType,
JobReport::Token  fileToken 
)

Report that an event has been read from the file identified by the given Token.

Definition at line 389 of file JobReport.cc.

References f, impl_, and edm::JobReport::InputFile::numEventsRead.

389  {
390  JobReport::InputFile& f = impl_->getInputFileForToken(inputType, fileToken);
391  ++f.numEventsRead;
392  }
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
double f[11][100]
void edm::JobReport::eventWrittenToFile ( JobReport::Token  fileToken,
RunNumber_t  run,
EventNumber_t  event 
)

Report that the event with the given id has been written to the file identified by the given Token.

Definition at line 455 of file JobReport.cc.

References f, impl_, and edm::JobReport::OutputFile::numEventsWritten.

Referenced by NanoAODOutputModule::write().

455  {
456  JobReport::OutputFile& f = impl_->getOutputFileForToken(fileToken);
457  ++f.numEventsWritten;
458  }
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
double f[11][100]
edm::propagate_const<std::unique_ptr<JobReportImpl> >& edm::JobReport::impl ( )
inlineprotected

Definition at line 431 of file JobReport.h.

References impl_.

Referenced by edm::service::JobReportService::frameworkShutdownOnFailure(), and edm::service::JobReportService::postEndJob().

431 {return impl_;}
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
void edm::JobReport::inputFileClosed ( InputType  inputType,
JobReport::Token  fileToken 
)

Report that the input file identified by the given Token has been closed. An exception will be thrown if the given Token was not obtained from inputFileOpened.

Definition at line 401 of file JobReport.cc.

References f, edm::JobReport::InputFile::fileHasBeenClosed, impl_, CommonMethods::lock(), edm::Primary, and write_mutex.

Referenced by DQMRootSource::closeFile_().

401  {
402  JobReport::InputFile& f = impl_->getInputFileForToken(inputType, fileToken);
403  f.fileHasBeenClosed = true;
404  if(inputType == InputType::Primary) {
405  impl_->writeInputFile(f);
406  } else {
407  {
408  std::lock_guard<std::mutex> lock(write_mutex);
409  impl_->writeInputFile(f);
410  }
411  }
412  }
std::mutex write_mutex
Definition: JobReport.h:435
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
double f[11][100]
JobReport::Token edm::JobReport::inputFileOpened ( std::string const &  physicalFileName,
std::string const &  logicalFileName,
std::string const &  catalog,
std::string const &  inputType,
std::string const &  inputSourceClassName,
std::string const &  moduleLabel,
std::string const &  guid,
std::vector< std::string > const &  branchNames 
)

Report that an input file has been opened. The returned Token should be used for later identification of this file.

Definition at line 341 of file JobReport.cc.

References edm::JobReport::InputFile::branchNames, getEcalConditions_orcoffint2r_cff::catalog, edm::JobReport::InputFile::catalog, edm::JobReport::InputFile::fileHasBeenClosed, edm::JobReport::InputFile::guid, impl_, ElectronMcFakePostValidator_cfi::InputFile, edm::JobReport::InputFile::inputSourceClassName, edm::JobReport::InputFile::inputType, edm::JobReport::InputFile::logicalFileName, edm::JobReport::InputFile::moduleLabel, edm::JobReport::InputFile::numEventsRead, edm::JobReport::InputFile::physicalFileName, edm::Primary, edm::SecondaryFile, and edm::SecondarySource.

Referenced by DQMRootSource::readFile_().

348  {
349 
350  InputType theInputType = InputType::Primary;
351  InputFile* newFile = nullptr;
352  JobReport::Token newToken = 0;
353 
354  if (inputType == "mixingFiles") {
355  theInputType = InputType::SecondarySource;
356  auto itr = impl_->inputFilesSecSource_.push_back(InputFile());
357  newFile = &(*itr);
358  newToken = itr - impl_->inputFilesSecSource_.begin();
359  } else {
360  if (inputType == "secondaryFiles") {
361  theInputType = InputType::SecondaryFile;
362  }
363  impl_->inputFiles_.emplace_back();
364  newFile = &impl_->inputFiles_.back();
365  newToken = impl_->inputFiles_.size() - 1;
366  }
367 
368  if(theInputType == InputType::Primary) {
369  impl_->lastOpenedPrimaryInputFile_ = impl_->inputFiles_.size() - 1;
370  }
371  newFile->logicalFileName = logicalFileName;
372  newFile->physicalFileName = physicalFileName;
373  newFile->catalog = catalog;
374  newFile->inputType = inputType;
375  newFile->inputSourceClassName = inputSourceClassName;
376  newFile->moduleLabel = moduleLabel;
377  newFile->guid = guid;
378  newFile->numEventsRead = 0;
379  newFile->branchNames = branchNames;
380  newFile->fileHasBeenClosed = false;
381 
382  // Add the new input file token to all output files
383  // currently open.
384  impl_->insertInputForOutputs(theInputType, newToken);
385  return newToken;
386  }
InputType
Definition: InputType.h:5
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
std::size_t Token
Definition: JobReport.h:107
JobReport& edm::JobReport::operator= ( JobReport const &  )
delete
void edm::JobReport::outputFileClosed ( JobReport::Token  fileToken)

Report that the output file identified by the given Token has been closed. An exception will be thrown if the given Token was not obtained from outputFileOpened.

Definition at line 461 of file JobReport.cc.

References f, edm::JobReport::OutputFile::fileHasBeenClosed, and impl_.

Referenced by DQMRootOutputModule::finishEndFile(), and NanoAODOutputModule::reallyCloseFile().

461  {
462  JobReport::OutputFile& f = impl_->getOutputFileForToken(fileToken);
463  f.fileHasBeenClosed = true;
464  impl_->writeOutputFile(f);
465  }
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
double f[11][100]
JobReport::Token edm::JobReport::outputFileOpened ( std::string const &  physicalFileName,
std::string const &  logicalFileName,
std::string const &  catalog,
std::string const &  outputModuleClassName,
std::string const &  moduleLabel,
std::string const &  guid,
std::string const &  dataType,
std::string const &  branchHash,
std::vector< std::string > const &  branchNames 
)

Report that an output file has been opened. The returned Token should be used for later identification of this file.

Definition at line 415 of file JobReport.cc.

References edm::JobReport::OutputFile::branchHash, edm::JobReport::OutputFile::branchNames, getEcalConditions_orcoffint2r_cff::catalog, edm::JobReport::OutputFile::catalog, edm::JobReport::OutputFile::contributingInputs, edm::JobReport::OutputFile::contributingInputsSecSource, MergeFilesAndCalculateEfficiencies_cfg::dataType, edm::JobReport::OutputFile::dataType, edm::JobReport::OutputFile::fileHasBeenClosed, edm::JobReport::OutputFile::guid, mps_fire::i, impl_, edm::JobReport::OutputFile::logicalFileName, edm::JobReport::OutputFile::moduleLabel, edm::JobReport::OutputFile::numEventsWritten, edm::JobReport::OutputFile::outputModuleClassName, edm::JobReport::OutputFile::physicalFileName, and alignCSCRings::r.

Referenced by DQMRootOutputModule::openFile().

423  {
424  auto itr = impl_->outputFiles_.emplace_back();
425  JobReport::OutputFile& r = *itr;
426 
427  r.logicalFileName = logicalFileName;
428  r.physicalFileName = physicalFileName;
429  r.catalog = catalog;
430  r.outputModuleClassName = outputModuleClassName;
431  r.moduleLabel = moduleLabel;
432  r.guid = guid;
433  r.dataType = dataType;
434  r.branchHash = branchHash;
435  r.numEventsWritten = 0;
436  r.branchNames = branchNames;
437  r.fileHasBeenClosed = false;
438  //
439  // Init list of contributors to list of open input file Tokens
440  //
441  for(std::vector<Token>::size_type i = 0, iEnd = impl_->inputFiles_.size(); i < iEnd; ++i) {
442  if(!impl_->inputFiles_[i].fileHasBeenClosed) {
443  r.contributingInputs.push_back(i);
444  }
445  }
446  for(tbb::concurrent_vector<Token>::size_type i = 0, iEnd = impl_->inputFilesSecSource_.size(); i < iEnd; ++i) {
447  if(!impl_->inputFilesSecSource_[i].fileHasBeenClosed) {
448  r.contributingInputsSecSource.push_back(i);
449  }
450  }
451  return itr - impl_->outputFiles_.begin();
452  }
uint16_t size_type
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
void edm::JobReport::reportAnalysisFile ( std::string const &  fileName,
std::map< std::string, std::string > const &  fileData 
)

Definition at line 507 of file JobReport.cc.

References impl_, CommonMethods::lock(), mps_check::msg, and write_mutex.

Referenced by TFileService::afterBeginJob(), DQMStoreStats::calcstats(), AlcaBeamSpotHarvester::endRun(), PCLMetadataWriter::endRun(), DQMFileSaver::saveJobReport(), and dqm::DQMFileSaverBase::saveJobReport().

507  {
508  if(impl_->ost_) {
509  std::ostream& msg = *(impl_->ost_);
510  {
511  std::lock_guard<std::mutex> lock(write_mutex);
512  msg << "<AnalysisFile>\n"
513  << " <FileName>" << TiXmlText(fileName) << "</FileName>\n";
514 
515  typedef std::map<std::string, std::string>::const_iterator const_iterator;
516  for(const_iterator pos = fileData.begin(), posEnd = fileData.end(); pos != posEnd; ++pos) {
517  msg << " <" << pos->first
518  << " Value=\"" << pos->second << "\" />"
519  << "\n";
520  }
521  msg << "</AnalysisFile>\n";
522  msg << std::flush;
523  }
524  }
525  }
std::mutex write_mutex
Definition: JobReport.h:435
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
tuple msg
Definition: mps_check.py:277
void edm::JobReport::reportDataType ( Token  fileToken,
std::string const &  dataType 
)

Report the data type of a file after it has been opened Needed since the data type isn't known until an event has been read

Definition at line 395 of file JobReport.cc.

References MergeFilesAndCalculateEfficiencies_cfg::dataType, edm::JobReport::OutputFile::dataType, f, and impl_.

395  {
396  JobReport::OutputFile& f = impl_->getOutputFileForToken(fileToken);
397  f.dataType = dataType;
398  }
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
double f[11][100]
void edm::JobReport::reportError ( std::string const &  shortDesc,
std::string const &  longDesc,
int const &  exitCode 
)

Report an exception, providing details of the problem as a short description (Eg "XXXError") and a long description (Eg "XXX crashed because...") Also overload this method to accept an optional standard exit code

Definition at line 528 of file JobReport.cc.

References impl_, CommonMethods::lock(), mps_check::msg, and write_mutex.

Referenced by edm::printCmsException().

530  {
531  if(impl_->ost_) {
532  {
533  std::lock_guard<std::mutex> lock(write_mutex);
534  std::ostream& msg = *(impl_->ost_);
535  msg << "<FrameworkError ExitStatus=\""<< exitCode
536  << "\" Type=\"" << shortDesc << "\" >\n";
537  msg << "<![CDATA[\n" << longDesc << "\n]]>\n";
538  msg << "</FrameworkError>\n";
539  msg << std::flush;
540  }
541  }
542  }
std::mutex write_mutex
Definition: JobReport.h:435
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
tuple msg
Definition: mps_check.py:277
void edm::JobReport::reportFallbackAttempt ( std::string const &  pfn,
std::string const &  lfn,
std::string const &  err 
)

Definition at line 561 of file JobReport.cc.

References trackingPlots::fallback, impl_, CommonMethods::lock(), mps_check::msg, and write_mutex.

561  {
562  if(impl_->ost_) {
563  std::ostream& msg = *(impl_->ost_);
564  TiXmlElement fallback("FallbackAttempt");
565  fallback.SetAttribute("Pfn", pfn);
566  fallback.SetAttribute("Lfn", lfn);
567  {
568  std::lock_guard<std::mutex> lock(write_mutex);
569  msg << fallback << "\n";
570  msg << "<![CDATA[\n" << err << "\n]]>\n";
571  msg << std::flush;
572  }
573  }
574  }
std::mutex write_mutex
Definition: JobReport.h:435
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
tuple msg
Definition: mps_check.py:277
void edm::JobReport::reportFastClonedBranches ( std::set< std::string > const &  fastClonedBranches,
long long  nEvents 
)

Inform the job report that branches have been fast Cloned.

Definition at line 657 of file JobReport.cc.

References impl_, and nEvents.

657  {
658  std::set<std::string>& clonedBranches = impl_->inputFiles_.at(impl_->lastOpenedPrimaryInputFile_).fastClonedBranches;
659  for(std::set<std::string>::const_iterator it = fastClonedBranches.begin(), itEnd = fastClonedBranches.end();
660  it != itEnd; ++it) {
661  if(clonedBranches.insert(*it).second) {
662  impl_->readBranches_[*it] += nEvents;
663  }
664  }
665  }
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
UInt_t nEvents
Definition: hcalCalib.cc:42
void edm::JobReport::reportFastCopyingStatus ( JobReport::Token  fileToken,
std::string const &  inputFileName,
bool  fastCopying 
)

Definition at line 481 of file JobReport.cc.

References f, edm::JobReport::OutputFile::fastCopyingInputs, and impl_.

481  {
482  JobReport::OutputFile& f = impl_->getOutputFileForToken(fileToken);
483  f.fastCopyingInputs.insert(std::make_pair(inputFileName, fastCopying));
484  }
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
double f[11][100]
void edm::JobReport::reportInputLumiSection ( unsigned int  run,
unsigned int  lumiSectId 
)

API for reporting a Lumi Section to the job report. for input files, call only if lumi section is physically read from the input file

Definition at line 492 of file JobReport.cc.

References impl_.

Referenced by dqmservices::DQMProtobufReader::readLuminosityBlock_(), and DQMRootSource::readLuminosityBlock_().

492  {
493  impl_->associateInputLumiSection(run, lumiSectId);
494  }
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
void edm::JobReport::reportInputRunNumber ( unsigned int  run)

API to report a run read from input

Definition at line 502 of file JobReport.cc.

References impl_.

Referenced by DQMRootSource::readRun_().

502  {
503  impl_->associateInputRun(run);
504  }
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
void edm::JobReport::reportLumiSection ( JobReport::Token  token,
unsigned int  run,
unsigned int  lumiSectId,
unsigned long  nEvents = 0 
)

API for reporting a Lumi Section to the job report. for output files, call only if lumi section is written to the output file

Definition at line 487 of file JobReport.cc.

References impl_.

Referenced by NanoAODOutputModule::writeLuminosityBlock(), and DQMRootOutputModule::writeLuminosityBlock().

487  {
488  impl_->associateLumiSection(token, run, lumiSectId,nEvents);
489  }
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
UInt_t nEvents
Definition: hcalCalib.cc:42
void edm::JobReport::reportMemoryInfo ( std::vector< std::string > const &  memoryData)

Report Memory statistics ALTERNATE FORM - USING THIS MAY NECESSITATE CHANGES IN PARSING XML! Invoked by the Memory service to send an end of job summary about memory usage for inclusion in the job report

Definition at line 577 of file JobReport.cc.

References impl_, and mps_check::msg.

577  {
578  if(impl_->ost_) {
579  std::ostream& msg = *(impl_->ost_);
580  msg << "<MemoryService>\n";
581 
582  typedef std::vector<std::string>::const_iterator const_iterator;
583  for(const_iterator pos = memoryData.begin(), posEnd = memoryData.end(); pos != posEnd; ++pos) {
584  msg << *pos << "\n";
585  }
586  msg << "</MemoryService>\n";
587  msg << std::flush;
588  }
589  }
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
tuple msg
Definition: mps_check.py:277
void edm::JobReport::reportMessageInfo ( std::map< std::string, double > const &  messageData)

Report Message statistics Invoked by the MessageLogger service to send an end of job summary about numbers of various categories messages issued for inclusion in the job report

Definition at line 592 of file JobReport.cc.

References impl_, and mps_check::msg.

Referenced by edm::service::MessageLogger::SummarizeInJobReport().

592  {
593  if(impl_->ost_) {
594  std::ostream& msg = *(impl_->ost_);
595  msg << "<MessageSummary>\n";
596  typedef std::map<std::string, double>::const_iterator const_iterator;
597  for(const_iterator pos = messageData.begin(), posEnd = messageData.end(); pos != posEnd; ++pos) {
598  msg << " <" << pos->first
599  << " Value=\"" << pos->second << "\" />"
600  << "\n";
601  }
602  msg << "</MessageSummary>\n";
603  msg << std::flush;
604  }
605  }
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
tuple msg
Definition: mps_check.py:277
void edm::JobReport::reportPerformanceForModule ( std::string const &  metricClass,
std::string const &  moduleName,
std::map< std::string, std::string > const &  metrics 
)

Definition at line 702 of file JobReport.cc.

References impl_, mps_check::msg, and AlCaHLTBitMon_QueryRunRegistry::string.

Referenced by XrdAdaptor::XrdStatisticsService::postEndJob().

704  {
705  if(impl_->ost_) {
706  std::ostream& msg = *(impl_->ost_);
707  msg << "<PerformanceReport>\n"
708  << " <PerformanceModule Metric=\"" << metricClass << "\" "
709  << " Module=\"" << moduleName << "\" >\n";
710 
711  typedef std::map<std::string, std::string>::const_iterator const_iterator;
712  for(const_iterator iter = metrics.begin(), iterEnd = metrics.end(); iter != iterEnd; ++iter) {
713  msg << " <Metric Name=\"" << iter->first << "\" "
714  << "Value=\"" << iter->second << "\"/>\n";
715  }
716 
717  msg << " </PerformanceModule>\n"
718  << "</PerformanceReport>\n";
719  msg << std::flush;
720  //LogInfo("FwkJob") << msg.str();
721  }
722  }
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
std::string moduleName(Provenance const &provenance)
Definition: Provenance.cc:27
tuple msg
Definition: mps_check.py:277
void edm::JobReport::reportPerformanceSummary ( std::string const &  metricClass,
std::map< std::string, std::string > const &  metrics 
)

Performance Reports

Two categories: Summary for entire job and module for a specific module Each one requires a performance metric class such as Timing, Memory, CPU, Trigger etc.

Definition at line 681 of file JobReport.cc.

References impl_, and mps_check::msg.

Referenced by TFileAdaptor::termination().

682  {
683  if(impl_->ost_) {
684  std::ostream& msg = *(impl_->ost_);
685  msg << "<PerformanceReport>\n"
686  << " <PerformanceSummary Metric=\"" << metricClass << "\">\n";
687 
688  typedef std::map<std::string, std::string>::const_iterator const_iterator;
689  for(const_iterator iter = metrics.begin(), iterEnd = metrics.end(); iter != iterEnd; ++iter) {
690  msg << " <Metric Name=\"" << iter->first << "\" "
691  << "Value=\"" << iter->second << "\"/>\n";
692  }
693 
694  msg << " </PerformanceSummary>\n"
695  << "</PerformanceReport>\n";
696  msg << std::flush;
697  //LogInfo("FwkJob") << msg.str();
698  }
699  }
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
tuple msg
Definition: mps_check.py:277
void edm::JobReport::reportRandomStateFile ( std::string const &  name)

Report the name of the random engine persistency file

Definition at line 667 of file JobReport.cc.

References impl_, CommonMethods::lock(), mps_check::msg, and write_mutex.

667  {
668  if(impl_->ost_) {
669  std::ostream& msg = *(impl_->ost_);
670  {
671  std::lock_guard<std::mutex> lock(write_mutex);
672  msg << "<RandomServiceStateFile>\n"
673  << TiXmlText(name) << "\n"
674  << "</RandomServiceStateFile>\n";
675  msg << std::flush;
676  }
677  }
678  }
std::mutex write_mutex
Definition: JobReport.h:435
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
tuple msg
Definition: mps_check.py:277
void edm::JobReport::reportReadBranch ( InputType  inputType,
std::string const &  branchName 
)

Inform the job report that a branch has been read.

Definition at line 642 of file JobReport.cc.

References electrons_cff::branchName, impl_, edm::Primary, edm::SecondaryFile, and edm::SecondarySource.

642  {
643  if(inputType == InputType::Primary) {
644  // Fast cloned branches have already been reported.
645  std::set<std::string> const& clonedBranches = impl_->inputFiles_.at(impl_->lastOpenedPrimaryInputFile_).fastClonedBranches;
646  if(clonedBranches.find(branchName) == clonedBranches.end()) {
647  ++impl_->readBranches_[branchName];
648  }
649  } else if (inputType == InputType::SecondaryFile) {
650  ++impl_->readBranchesSecFile_[branchName];
651  } else if (inputType == InputType::SecondarySource) {
652  ++impl_->readBranchesSecSource_[branchName].value();
653  }
654  }
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
void edm::JobReport::reportReadBranches ( )

Report read branches Invoked by the source that reads ROOT/EDM files at the end of a job to report which product branches in the Events tree have been read, with a count of the number of events for which the branch was read.

Definition at line 608 of file JobReport.cc.

References MicroEventContent_cff::branch, and impl_.

608  {
609  if(impl_->printedReadBranches_) return;
610  impl_->printedReadBranches_ = true;
611  if(impl_->ost_) {
612  std::ostream& ost = *(impl_->ost_);
613  ost << "<ReadBranches>\n";
614  for(auto const& iBranch : impl_->readBranches_) {
615  TiXmlElement branch("Branch");
616  branch.SetAttribute("Name", iBranch.first);
617  branch.SetAttribute("ReadCount", iBranch.second);
618  ost << branch << "\n";
619  }
620  for(auto const& iBranch : impl_->readBranchesSecFile_) {
621  TiXmlElement branch("Branch");
622  branch.SetAttribute("Name", iBranch.first);
623  branch.SetAttribute("ReadCount", iBranch.second);
624  ost << branch << "\n";
625  }
626  ost << "</ReadBranches>\n";
627  if(!impl_->readBranchesSecSource_.empty()) {
628  ost << "<SecondarySourceReadBranches>\n";
629  for(auto const& iBranch : impl_->readBranchesSecSource_) {
630  TiXmlElement branch("Branch");
631  branch.SetAttribute("Name", iBranch.first);
632  branch.SetAttribute("ReadCount", iBranch.second.value().load());
633  ost << branch << "\n";
634  }
635  ost << "</SecondarySourceReadBranches>\n";
636  }
637  ost << std::flush;
638  }
639  }
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
void edm::JobReport::reportRunNumber ( JobReport::Token  token,
unsigned int  run 
)

API for reporting a Run to the job report. for output files, call only if Run is written to the output file

Definition at line 497 of file JobReport.cc.

References impl_.

Referenced by NanoAODOutputModule::writeRun(), and DQMRootOutputModule::writeRun().

497  {
498  impl_->associateRun(token, run);
499  }
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
void edm::JobReport::reportSkippedEvent ( RunNumber_t  run,
EventNumber_t  event 
)

Definition at line 468 of file JobReport.cc.

References impl_, CommonMethods::lock(), mps_check::msg, and write_mutex.

468  {
469  if(impl_->ost_) {
470  std::ostream& msg = *(impl_->ost_);
471  {
472  std::lock_guard<std::mutex> lock(write_mutex);
473  msg << "<SkippedEvent Run=\"" << run << "\"";
474  msg << " Event=\"" << event << "\" />\n";
475  msg << std::flush;
476  }
477  }
478  }
std::mutex write_mutex
Definition: JobReport.h:435
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
tuple msg
Definition: mps_check.py:277
void edm::JobReport::reportSkippedFile ( std::string const &  pfn,
std::string const &  lfn 
)

Report Skipped File

Report that a file has been skipped due to it not being found.

Definition at line 545 of file JobReport.cc.

References impl_, CommonMethods::lock(), mps_check::msg, runEdmFileComparison::skipped, and write_mutex.

546  {
547  if(impl_->ost_) {
548  std::ostream& msg = *(impl_->ost_);
549  TiXmlElement skipped("SkippedFile");
550  skipped.SetAttribute("Pfn", pfn);
551  skipped.SetAttribute("Lfn", lfn);
552  {
553  std::lock_guard<std::mutex> lock(write_mutex);
554  msg << skipped << "\n";
555  msg << std::flush;
556  }
557  }
558  }
std::mutex write_mutex
Definition: JobReport.h:435
edm::propagate_const< std::unique_ptr< JobReportImpl > > impl_
Definition: JobReport.h:434
tuple msg
Definition: mps_check.py:277

Member Data Documentation

edm::propagate_const<std::unique_ptr<JobReportImpl> > edm::JobReport::impl_
private
std::mutex edm::JobReport::write_mutex
private