pynenc.conf.config_orchestrator

Module Contents

Classes

ConfigOrchestrator

Main config of the orchestrator components.

ConfigOrchestratorSQLite

SQLite-based orchestrator configuration

API

class pynenc.conf.config_orchestrator.ConfigOrchestrator(config_values: Optional[dict[str, Any]] = None, config_filepath: Optional[str] = None)[source]

Bases: pynenc.conf.config_base.ConfigPynencBase

Main config of the orchestrator components.

Variables:
  • blocking_control (ConfigField[bool]) – This boolean flag activates control over tasks that are blocking on other tasks. If a task invocation is waiting on another invocation, it notifies the runner, which temporarily removes it from the processing queue and uses the slot for another task invocation. Once the required invocation finishes, the dependent invocation is placed back into the run queue. This feature also prioritizes invocations that have many dependencies over new ones, ensuring efficient task management.

  • auto_final_invocation_purge_hours (ConfigField[float]) – This float value, defaulting to 24.0 hours, sets the duration after which the orchestrator purges all invocations older than the specified time. This purge mechanism helps keep the orchestrator lightweight and fast, as it should ideally operate with minimal latency. Detailed information about the invocations is stored in the result backend, which can handle more data and afford to be slower.

Initialization

blocking_control

‘ConfigField(…)’

auto_final_invocation_purge_hours

‘ConfigField(…)’

class pynenc.conf.config_orchestrator.ConfigOrchestratorSQLite(config_values: Optional[dict[str, Any]] = None, config_filepath: Optional[str] = None)[source]

Bases: pynenc.conf.config_orchestrator.ConfigOrchestrator, pynenc.conf.config_sqlite.ConfigSQLite

SQLite-based orchestrator configuration

Initialization