v0.22.0

This release brings major improvements to AliECS, including support for subworkflow template inclusion, improvements and additions to the template system, and miscellaneous bug fixes.

DEPRECATION NOTICE: starting with AliECS v0.21.0 the o2-aliecs-odc-shim component is deprecated and expected to be removed in the near future. It is still accessible in readout-dataflow by setting odcshim_enabled to true. The existing variable odc_enabled, which was previously used to enable/disable o2-aliecs-odc-shim, now controls the new implementation.

• Apricot and template system calls:

  • [apricot][core] GetDetectorForHost in Apricot + template system
  • [apricot] Implement GetCRUCardsForHost
  • [apricot] GetEndpointsForCRUCard
  • [configuration] Extend service with GetCRUCardsForHost
  • [configuration] GetEndpointsForCRUCard

• Subworkflow template inclusion:

  • [core] Subworkflow template expression resolution in repos package
  • [core] Subworkflow include implementation (includeRole)
  • [core] Fix typo in subworkflow template identifier resolution
  • [core] Ensure a disabled include isn't processed
  • [core] Ensure the included role defaults/vars are reprocessed

• Integration:

  • [core] Update ODC client to latest protofile
  • [core] Update DCS client to latest protofile
  • [core] DCS SOR/EOR response processing
  • [core] DCS Cleanup template function, performs EOR regardless if needed

• Miscellaneous:

  • [coconut] Fix typo
  • [core] Limit InfoLogger message size to 1024 Bytes
  • [core] Allow templating of FairMQ channel rateLogging
  • [executor] Drop stdout messages if no piping selected

v0.21.80

This release brings major improvements to AliECS, including support for subworkflow template inclusion, improvements to the template system and miscellaneous bug fixes.

DEPRECATION NOTICE: starting with AliECS v0.21.0 the o2-aliecs-odc-shim component is deprecated and expected to be removed in the near future. It is still accessible by setting odcshim_enabled to true. The existing variable odc_enabled, which was previously used to enable/disable odc-shim, now controls the new implementation.

• Subworkflow template inclusion:

  • [core] Subworkflow template expression resolution in repos package
  • [core] Subworkflow include implementation (includeRole)
  • [core] Fix typo in subworkflow template identifier resolution

• Integration:

  • [core] Update ODC client to latest protofile

• Miscellaneous:

  • [core] Limit InfoLogger message size to 1024 Bytes
  • [core] Allow templating of FairMQ channel rateLogging
  • [executor] Drop stdout messages if no piping selected

v0.21.2

This patch release for the v0.21 series fixes a core crash when deploying an environment from certain kinds of workflow templates.

• [core] Fix nil pointer dereference

v0.21.1

This patch release for the v0.21 series fixes a serious issue with task lifetime management and adds support for user-configurable task output redirection.

• [core] Fix empty roster issue
• [executor] Configurable task stdout logging
• [executor] Support parametrization of task log pipe

v0.21.0

This release brings major improvements to AliECS, including multiple fixes for common error conditions, a refactored environment teardown sequence, a reimplementation of the ODC (EPN subcontrol) client based on the new integration plugin system, and miscellaneous bug fixes.

DEPRECATION NOTICE: starting with AliECS v0.21.0 the o2-aliecs-odc-shim component is deprecated and expected to be removed in the near future. It is still accessible by setting odcshim_enabled to true. The existing variable odc_enabled, which was previously used to enable/disable odc-shim, now controls the new implementation.

• Error handling:

  • [core] Transition configure should return immediately after failing the workflow deployment
  • [core] Log which role failed during deployment
  • [core] Improve output on deployment failure
  • [core] Environment should kill tasks after failed deployment
  • [core] Fix panic close nil channel on teardown
  • [core] Adjust CreateAutoEnvironment to the new Teardown
  • [core] Send event with the correct TaskID
  • [executor] Correct timeout for Kill sequence GetState
  • [executor] Fix PID running check for negative PID (PGID)
  • [executor] Kill leftover tasks when rpc failed to start

• Environment termination and cleanup:

  • [core] Ensure every Teardown API call is forced if necessary
  • [core] Refactor environment.Manager.CreateEnvironment
  • [core] Use TeardownEnvironment to cleanup after a failed deployment

• Integration:

  • [core] New ddsched.EnsureTermination call, to be used as DESTROY hook
  • [core] New ODC integration plugin
  • [core] Sort functions in ODC integration plugin
  • [core] Add EnsureCleanup to ODC functions
  • [core] Concurrently initialize all plugins
  • [core] Reduce integration plugin dial timeouts

• Miscellaneous:

  • [coconut] Print number of FLPs for environment
  • [common] Add ALICE Run 3 System ID mapping
  • [common] Add some non-standard system IDs for convenience
  • [core] Expose number of FLPs per environment
  • [core] Await expressions, optional with trigger
  • [executor] Reduce gRPC dial timeout to 30s thanks to modules v4
  • [misc] Update default configuration parameters
  • [walnut] Fix workflow template schema

v0.20.81

This release brings major improvements to AliECS, including multiple fixes for common error conditions, a refactored environment teardown sequence, a reimplementation of the ODC (EPN subcontrol) client based on the new integration plugin system, and miscellaneous minor fixes.

DEPRECATION NOTICE: starting with AliECS v0.21.0 the o2-aliecs-odc-shim component is deprecated and expected to be removed in the near future. It is still accessible by setting odcshim_enabled to true. The existing variable odc_enabled, which was previously used to enable/disable odc-shim, now controls the new implementation.

• Error handling:

  • [core] Transition configure should return immediately after failing the workflow deployment
  • [core] Log which role failed during deployment
  • [core] Improve output on deployment failure
  • [executor] Correct timeout for Kill sequence GetState
  • [executor] Fix PID running check for negative PID (PGID)

• Environment termination and cleanup:

  • [core] Ensure every Teardown API call is forced if necessary
  • [core] Refactor environment.Manager.CreateEnvironment
  • [core] Use TeardownEnvironment to cleanup after a failed deployment

• Integration:

  • [core] New ddsched.EnsureTermination call, to be used as DESTROY hook
  • [core] New ODC integration plugin
  • [core] Sort functions in ODC integration plugin
  • [core] Add EnsureCleanup to ODC functions
  • [core] Concurrently initialize all plugins
  • [core] Reduce integration plugin dial timeouts

• Miscellaneous:

  • [coconut] Print number of FLPs for environment
  • [common] Add ALICE Run 3 System ID mapping
  • [common] Add some non-standard system IDs for convenience
  • [core] Expose number of FLPs per environment
  • [core] Await expressions, optional with trigger
  • [executor] Reduce gRPC dial timeout to 30s thanks to modules v4
  • [walnut] Fix workflow template schema

v0.20.80

This release brings major improvements to AliECS, including multiple fixes for common error conditions, a refactored environment teardown sequence, a reimplementation of the ODC (EPN subcontrol) client based on the new integration plugin system, and miscellaneous minor fixes.

DEPRECATION NOTICE: starting with AliECS v0.21.0 the o2-aliecs-odc-shim component is deprecated and expected to be removed in the near future. It is still accessible by setting odcshim_enabled to true. The existing variable odc_enabled, which was previously used to enable/disable odc-shim, now controls the new implementation.

• Error handling:

  • [core] Transition configure should return immediately after failing the workflow deployment
  • [core] Log which role failed during deployment
  • [core] Improve output on deployment failure
  • [executor] Correct timeout for Kill sequence GetState
  • [executor] Fix PID running check for negative PID (PGID)

• Environment termination and cleanup:

  • [core] Ensure every Teardown API call is forced if necessary
  • [core] Refactor environment.Manager.CreateEnvironment
  • [core] Use TeardownEnvironment to cleanup after a failed deployment

• Integration:

  • [core] New ddsched.EnsureTermination call, to be used as DESTROY hook
  • [core] New ODC integration plugin
  • [core] Sort functions in ODC integration plugin
  • [core] Add EnsureCleanup to ODC functions
  • [core] Concurrently initialize all plugins
  • [core] Reduce integration plugin dial timeouts

• Miscellaneous:

  • [coconut] Print number of FLPs for environment
  • [common] Add ALICE Run 3 System ID mapping
  • [common] Add some non-standard system IDs for convenience
  • [core] Expose number of FLPs per environment
  • [executor] Reduce gRPC dial timeout to 30s thanks to modules v4
  • [walnut] Fix workflow template schema

v0.20.7

This patch release brings several fixes, mainly concerning integration, and to facilitate operations at LHC Point 2.

[coconut] Set maximum incoming gRPC payload size to 10MB
[core] Log when DD scheduler connected
[core] Disable system proxy by default for Mesos, DCS, DDscheduler
[executor] Never use any proxy when connecting to Mesos master

v0.20.6

This patch release fixes a race in the task termination procedure.

• [core] Fix kill tasks deadline

v0.20.5

This patch release fixes an issue that could cause an executor crash when force destroying an environment derived from a workflow template that includes hooks.

• [executor] Ensure hooks can always terminate safely