matensemble package

MatEnsemble

MatEnsemble is a Python workflow library for building and running high-throughput and dependency-aware workflows on HPC systems. It lets users define delayed Python and executable chores, connect them through data dependencies, and submit them for execution with Flux.

Submodules

• matensemble.chore module
• matensemble.fluxlet module
• matensemble.logger module
  • StatusWriter
    • StatusWriter.path
    • StatusWriter.nnodes
    • StatusWriter.cores_per_node
    • StatusWriter.gpus_per_node
    • StatusWriter.__init__()
    • StatusWriter.update()
• matensemble.manager module
• matensemble.model module
  • OutputReference
    • OutputReference.chore_id
    • OutputReference.workdir
    • OutputReference.result()
    • OutputReference.__init__()
  • Resources
    • Resources.num_tasks
    • Resources.cores_per_task
    • Resources.gpus_per_task
    • Resources.mpi
    • Resources.env
    • Resources.inherit_env
    • Resources.__init__()
  • ChoreType
    • ChoreType.PYTHON
    • ChoreType.EXECUTABLE
    • ChoreType.encode()
    • ChoreType.replace()
    • ChoreType.split()
    • ChoreType.rsplit()
    • ChoreType.join()
    • ChoreType.capitalize()
    • ChoreType.casefold()
    • ChoreType.title()
    • ChoreType.center()
    • ChoreType.count()
    • ChoreType.expandtabs()
    • ChoreType.find()
    • ChoreType.partition()
    • ChoreType.index()
    • ChoreType.ljust()
    • ChoreType.lower()
    • ChoreType.lstrip()
    • ChoreType.rfind()
    • ChoreType.rindex()
    • ChoreType.rjust()
    • ChoreType.rstrip()
    • ChoreType.rpartition()
    • ChoreType.splitlines()
    • ChoreType.strip()
    • ChoreType.swapcase()
    • ChoreType.translate()
    • ChoreType.upper()
    • ChoreType.startswith()
    • ChoreType.endswith()
    • ChoreType.removeprefix()
    • ChoreType.removesuffix()
    • ChoreType.isascii()
    • ChoreType.islower()
    • ChoreType.isupper()
    • ChoreType.istitle()
    • ChoreType.isspace()
    • ChoreType.isdecimal()
    • ChoreType.isdigit()
    • ChoreType.isnumeric()
    • ChoreType.isalpha()
    • ChoreType.isalnum()
    • ChoreType.isidentifier()
    • ChoreType.isprintable()
    • ChoreType.zfill()
    • ChoreType.format()
    • ChoreType.format_map()
    • ChoreType.maketrans()
    • ChoreType.__init__()
• matensemble.pipeline module
• matensemble.runtime_worker module
• matensemble.strategy module
  • FutureProcessingStrategy
    • FutureProcessingStrategy.__init__()
    • FutureProcessingStrategy.process_futures()
  • AdaptiveStrategy
    • AdaptiveStrategy.__init__()
    • AdaptiveStrategy.process_futures()
  • NonAdaptiveStrategy
    • NonAdaptiveStrategy.__init__()
    • NonAdaptiveStrategy.process_futures()
  • UserStrategy
    • UserStrategy.__init__()
    • UserStrategy.process_futures()
  • append_text()
• matensemble.utils module
  • setup_dashboard()
  • create_app()