coffea.processor

A framework for analysis scale-out

Functions

run_spark_job(fileset, processor_instance, ...)

A wrapper to submit spark jobs

accumulate(items[, accum])

Classes

ProcessorABC()

ABC for a generalized processor

LazyDataFrame(tree[, entrystart, entrystop, ...])

Simple delayed uproot reader (a la lazyarrays)

Weights(size[, storeIndividual])

Container for event weights and associated systematic shifts

PackedSelection([dtype])

Store boolean mask vectors in a compact manner

IterativeExecutor([status, unit, desc, ...])

Execute in one thread iteratively

FuturesExecutor(status, unit, desc, ...)

Execute using multiple local cores using python futures

DaskExecutor([status, unit, desc, ...])

Execute using dask futures

ParslExecutor([status, unit, desc, ...])

Execute using parsl pyapp wrapper

WorkQueueExecutor(status, unit, desc, ...)

Execute using Work Queue

Runner(executor, pre_executor, chunksize, ...)

A tool to run a processor using uproot for data delivery

AccumulatorABC()

Abstract base class for an accumulator

value_accumulator(default_factory[, initial])

Holds a value of arbitrary type

list_accumulator([iterable])

A list with accumulator semantics

set_accumulator

A set with accumulator semantics

dict_accumulator

A dictionary with accumulator semantics

defaultdict_accumulator

A defaultdict with accumulator semantics

column_accumulator(value)

An appendable numpy ndarray

NanoAODSchema(base_form[, version])

NanoAOD schema builder

TreeMakerSchema(base_form)

TreeMaker schema builder

iterative_executor

alias of IterativeExecutor

futures_executor

alias of FuturesExecutor

dask_executor

alias of DaskExecutor

parsl_executor

alias of ParslExecutor

work_queue_executor

alias of WorkQueueExecutor

Class Inheritance Diagram

Inheritance diagram of coffea.processor.processor.ProcessorABC, coffea.processor.dataframe.LazyDataFrame, coffea.processor.helpers.Weights, coffea.processor.helpers.PackedSelection, coffea.processor.executor.IterativeExecutor, coffea.processor.executor.FuturesExecutor, coffea.processor.executor.DaskExecutor, coffea.processor.executor.ParslExecutor, coffea.processor.executor.WorkQueueExecutor, coffea.processor.executor.Runner, coffea.processor.accumulator.AccumulatorABC, coffea.processor.accumulator.value_accumulator, coffea.processor.accumulator.list_accumulator, coffea.processor.accumulator.set_accumulator, coffea.processor.accumulator.dict_accumulator, coffea.processor.accumulator.defaultdict_accumulator, coffea.processor.accumulator.column_accumulator, coffea.nanoevents.schemas.nanoaod.NanoAODSchema, coffea.nanoevents.schemas.treemaker.TreeMakerSchema, coffea.processor.executor.IterativeExecutor, coffea.processor.executor.FuturesExecutor, coffea.processor.executor.DaskExecutor, coffea.processor.executor.ParslExecutor, coffea.processor.executor.WorkQueueExecutor