dataLoader Namespace Reference

Classes
class	DataLoader

Functions
def	get_data
def	get_data_csv

Variables
	separate_by_flav = False
	separate_by_op = False

Function Documentation

def dataLoader.get_data

(

filename

)

Definition at line 191 of file dataLoader.py.

References get_data_csv(), and print().

Referenced by generateFlavCfromFlavB.main(), and checkBTagCalibrationConsistency.run_check().

def get_data(filename):
    with open(filename) as f:
        csv_data = f.readlines()
    if not (csv_data and "OperatingPoint" in csv_data[0]):
        print("Data file does not contain typical header: %s. Exit" % filename)
        return False
    csv_data.pop(0)  # remove header
    return get_data_csv(csv_data)

def dataLoader.get_data_csv

(

csv_data

)

Definition at line 158 of file dataLoader.py.

References digitizers_cfi.strip.

Referenced by get_data(), and checkBTagCalibrationConsistency.run_check_csv().

def get_data_csv(csv_data):
    # grab measurement types
    meas_types = set(
        l.split(',')[1].strip()
        for l in csv_data
        if len(l.split()) == 11
    )

    # grab operating points
    ops = set(
        int(l.split(',')[0])
        for l in csv_data
        if len(l.split()) == 11
    ) if separate_by_op else ['all']

    # grab flavors
    flavs = set(
        int(l.split(',')[3])
        for l in csv_data
        if len(l.split()) == 11
    ) if separate_by_flav else ['all']

    # make loaders and filter empty ones
    lds = list(
        DataLoader(csv_data, mt, op, fl)
        for mt in meas_types
        for op in ops
        for fl in flavs
    )
    lds = [d for d in lds if d.entries]
    return lds