CMS 3D CMS Logo

 All Classes Namespaces Files Functions Variables Typedefs Enumerations Enumerator Properties Friends Macros Pages
Functions | Variables
relval_machine Namespace Reference

Functions

def convert_keys_to_string
 
def fix_run
 
def get_json_files
 
def load_steps_and_workflows
 

Variables

tuple steps = Steps()
 
tuple workflows = Matrix()
 

Function Documentation

def relval_machine.convert_keys_to_string (   dictionary)
Recursively converts dictionary keys to strings.
    Utility to help deal with unicode keys in dictionaries created from json requests.
    In order to pass dict to function as **kwarg we should transform key/value to str.

Definition at line 34 of file relval_machine.py.

References python.multivaluedict.dict, and python.multivaluedict.map().

Referenced by load_steps_and_workflows().

34 
35 def convert_keys_to_string(dictionary):
36  """ Recursively converts dictionary keys to strings.
37  Utility to help deal with unicode keys in dictionaries created from json requests.
38  In order to pass dict to function as **kwarg we should transform key/value to str.
39  """
40  if isinstance(dictionary, basestring):
41  return str(dictionary)
42  elif isinstance(dictionary, collections.Mapping):
43  return dict(map(convert_keys_to_string, dictionary.iteritems()))
44  elif isinstance(dictionary, collections.Iterable):
45  return type(dictionary)(map(convert_keys_to_string, dictionary))
46  else:
47  return dictionary
def convert_keys_to_string
def relval_machine.fix_run (   run)

Definition at line 24 of file relval_machine.py.

References python.rootplot.root2matplotlib.replace(), and split.

Referenced by load_steps_and_workflows().

24 
25 def fix_run(run):
26  runs = run.replace(" ", "").replace("[", "").replace("]", "").split(",")
27  int_runs = []
28  for item in runs:
29  if item.isdigit():
30  int_runs.append(int(item))
31  else:
32  print "WARNING: run is in bad format: {0}".format(run)
33  return int_runs
double split
Definition: MVATrainer.cc:139
def relval_machine.get_json_files ( )

Definition at line 11 of file relval_machine.py.

Referenced by load_steps_and_workflows().

11 
12 def get_json_files():
13  cwd = os.path.join(os.getcwd(), "json_data")
14  if not os.path.exists(cwd):
15  return []
16 
17  json_files = []
18  for f in os.listdir(cwd):
19  full_path = os.path.join(cwd, f)
20  if os.path.isfile(full_path) and f.endswith(".json"):
21  json_files.append(full_path)
22  return json_files
23 
def relval_machine.load_steps_and_workflows ( )

Definition at line 48 of file relval_machine.py.

References convert_keys_to_string(), fix_run(), and get_json_files().

48 
50  data_files = get_json_files()
51  for index, data_file in enumerate(data_files):
52  with open(data_file, "r") as f:
53  data = json.load(f)
54  data = convert_keys_to_string(data)
55  label = data["label"]
56  steps_names = []
57  for step_name, step in data["steps"].items():
58  steps_names.append((step_name, step["sequence_number"]))
59  if step_name in steps:
60  continue # this step was inserted already
61 
62  # inputInfo case
63  if "inputInfo" in step:
64  input_info = step["inputInfo"]
65  if "run" in input_info:
66  input_info["run"] = fix_run(input_info["run"])
67 
68  steps[step_name] = {
69  'INPUT': InputInfo(**input_info)
70  }
71  # step with parameters
72  elif "parameters" in step:
73  steps[step_name] = step["parameters"]
74  else:
75  raise Exception("Wrong step format in {0} file".format(data_file))
76 
77  sorted_steps = sorted(steps_names, key=lambda step: step[1]) # sort steps by sequence number
78  sorted_steps_names = [step_name[0] for step_name in sorted_steps] # filter only step names
79 
80  workflows[1000000.0 + 0.1*index] = [label, sorted_steps_names]
81 
82 
84 
def load_steps_and_workflows
def convert_keys_to_string

Variable Documentation

tuple relval_machine.steps = Steps()

Definition at line 8 of file relval_machine.py.

Referenced by HLTMuonValidator.dqmBeginRun(), TrackingMaterialPlotter.fill_gradient(), ListGroups.fillGradient(), MuonResiduals5DOFFitter.fit(), MuonResiduals6DOFFitter.fit(), MuonResiduals6DOFrphiFitter.fit(), XHistogram.splitSegment(), HLTMuonValidator.stepLabels(), CosmicMuonUtilities.stepPropagate(), and CSCGasCollisions.writeSummary().

tuple relval_machine.workflows = Matrix()

Definition at line 7 of file relval_machine.py.