NOTES:
BREAKING CHANGES:
ENHANCEMENTS:
- resource/hopsworksai_cluster: Set Default
version
to 3.9.0
FEATURES:
BUG FIXES:
ENHANCEMENTS:
- resource/hopsworksai_cluster: Set Default
version
to 3.8.0
ENHANCEMENTS:
- resource/hopsworksai_cluster: Set Default
version
to 3.7.1
ENHANCEMENTS:
- resource/hopsworksai_cluster: Set Default
version
to 3.7.0
ENHANCEMENTS:
- resource/hopsworksai_cluster: Add support for
gcp_attributes
FEATURES:
- New Data Source:
hopsworksai_gcp_service_account_custom_role_permissions
ENHANCEMENTS:
- Bump minimum Go version to 1.20
- resource/hopsworksai_cluster: Set Default
version
to 3.5.0
ENHANCEMENTS:
- Drop support for GPU workers on Spark
- resource/hopsworksai_cluster: Set Default
version
to 3.4.1
ENHANCEMENTS:
- examples: add an advanced aws example to setup a Hopsworks cluster with ArrowFlight server
- resource/hopsworksai_cluster: Add a new attribute
rondb/mysql_nodes/arrow_flight_with_duckdb
to enable or disable ArrowFlight server with DuckDB
NOTES:
BREAKING CHANGES:
ENHANCEMENTS:
- test-fixtures: run against dev and prod envs
- resource/hopsworksai_cluster: Set Default
version
to 3.3.0 - Bump minimum Go version to 1.19
FEATURES:
BUG FIXES:
ENHANCEMENTS:
- resource/hopsworksai_cluster: Set Default
version
to 3.2.0
ENHANCEMENTS:
- examples: add advanced azure aks example with vnet peering
- datasource/aws_instance_profile_policy: Add support for testconnector image
- examples: Update terraform helpers modules to version 2.3.0
- resource/hopsworksai_cluster: remove version suffix before checking
ENHANCEMENTS: examples: Update terraform helpers modules
NOTES: Old terraform providers would fail to create new single_node RonDB clusters, so you they need to update to this version.
ENHANCEMENTS:
- dependencies: Bump hashicorp/terraform-plugin-log from 0.7.0 to 0.8.0
- dependencies: Bump hashicorp/terraform-plugin-sdk/v2 from 2.24.1 to 2.25.0
- dependencies: Bump hashicorp/terraform-plugin-docs from 0.13.0 to 0.14.1
- datasource/dataSourceAWSInstanceProfilePolicy: Add possibility to limit permissions to region, user ecr account and hopsworks.ai ecr account.
- remove unusued AWS permissions from instance profile policy
- resource/hopsworksai_cluster: introduce an explicit allInOne parameter instead of detecting allInOne RonDB implicitly
ENHANCEMENTS:
- resource/hopsworksai_cluster: Enforce setting
ecr_registry_account_id
andacr_registry_name
during upgrade from 3.0 to 3.1
ENHANCEMENTS:
- datasource/aws_instance_profile_policy: Deprecate
enable_eks_and_ecr
attribute to useenable_eks
andenable_ecr
instead - datasource/azure_user_assigned_identity_permissions: Deprecate
enable_aks_and_acr
attribute to useenable_aks
andenable_acr
instead - Update acceptance tests and examples for new release
ENHANCEMENTS:
- add a jenkins pipline for acceptance tests
- dependencies: Bump hashicorp/terraform-plugin-sdk/v2 from 2.24.0 to 2.24.1
- collect ec2init log in aws acceptance tests
- datasource/aws_instance_profile_policy: Add permissions for internal service images (onlinefs, airflow, git)
BUG FIXES:
- Fix TestAccClusterAWS_RonDB and TestAccClusterAzure_RonDB
ENHANCEMENTS:
- datasource/aws_instance_profile_policy: Add ecr:TagResource permission
ENHANCEMENTS:
- Bump minimum Go version to 1.18
- Bump golangci-lint version to 1.50.1
- dependencies: Bump hashicorp/terraform-plugin-sdk/v2 from 2.20.0 to 2.24.0
- resource/hopsworksai_cluster: Use managed docker containers by default from version 3.1.0
FEATURES:
- Add support for head node dedicated instance profile.
- Filter instance types based on nvme drives
ENHANCEMENTS:
- return nodes private ips
BUG FIXES: docs: Update documentation links
NOTES:
- The
instance_type
attribue(s) are not optional anymore - resource/hopsworksai_cluster: Change default values for RonDB cluster. New default number of replicas is
2
and new default number of Datanodes is2
BREAKING CHANGES:
- Creating a Hopsworks cluster will require a seperate RonDB node. RonDB attribute is required by default.
- Remove deprecated
aws_attributes/bucket_name
attribute. - Set
aws_attributes/bucket/name
attribute to be required. - Remove deprecated
azure_attributes/storage_account
andazure_attributes/storage_container_name
attributes. - Set
azure_attributes/container/storage_account
attribute to be required. - Remove deprecated
azure_attributes/search_domain
attribute.
ENHANCEMENTS:
- dependencies: Bump hashicorp/terraform-plugin-docs from 0.10.1 to 0.13.0
- dependencies: Bump hashicorp/terraform-plugin-sdk/v2 from 2.17.0 to 2.20.0
- dependencies: Bump hashicorp/terraform-plugin-log from 0.4.1 to 0.7.0
- devtools: Bump golangci-lint from 1.45.2 to 1.46.2
- datasource/instance_type(s): Add required
region
attribute to filter supported instance types - resource/hopsworksai_cluster: Update
update_state
attribute description - resource/hopsworksai_cluster: Do not use default
instance_type
values and make the attribute(s) required - resource/hopsworksai_cluster: Set Default
version
to 3.0.0 - resource/hopsworksai_cluster: Add attribute
rondb/single_node
to use a RonDB single node cluster.
BUG FIXES:
- resource/hopsworksai_backup: Update acceptance tests to not stop cluster before taking backups
- resource/hopsworksai_cluster_from_backup: Update acceptance tests to not stop cluster before taking backups
- datasource/hopsworksai_azure_user_assigned_identity_permissions: Add the missing listkeys action permission for backup
NOTES:
- resource/hopsworksai_cluster: Change default values for RonDB cluster. New default number of replicas is
1
and new default number of Datanodes is1
BREAKING CHANGES:
- Default values for RonDB cluster changed. New default number of replicas is
1
and new default number of Datanodes is1
BUG FIXES:
ENHANCEMENTS:
- Bump minimum Go version to 1.17
- Bump golangci-lint version to 1.45.2
- dependencies: Bump hashicorp/terraform-plugin-sdk/v2 from 2.13.0 to 2.17.0
- dependencies: Bump hashicorp/terraform-plugin-docs from 0.7.0 to 0.10.1
- dependencies: Bump hashicorp/terraform-plugin-log from 0.3.0 to 0.4.1
- examples: Update versions and remove deprecated attributes
- resource/hopsworksai_cluster: Add
ha_enabled
experimental attribute to allow using multi head node setup for high availability. - resource/hopsworksai_cluster: Add
cluster_domain_prefix
attribute to override the default UUID name of a Cluster. This option is available only to users with special privileges. - resource/hopsworksai_cluster: Add
custom_hosted_zone
attribute to override the default Hosted Zone of a cluster's public domain name (cloud.hopsworks.ai). This option is available only to users with special privileges. - resource/hopsworksai_cluster: Add
aws_attributes/ebs_encryption
attribute to configure EBS encryption for disks on AWS clusters. - resource/hopsworksai_cluster: Change
ssh_key
attribute to be optional for AWS.
BUG FIXES:
- datasource/aws_instance_profile_policy: The
ecr:CreateRepository
permission has no resource level condition for private registries
BUG FIXES:
- resource/hopsworksai_backup: Handle get backup if backup not found and backupPipeline is InProgress
- resource/hopsworksai_backup: Wait for cluster start during backup pipeline
- resource/hopsworksai_backup: Fix interface conversion error
- resource/hopsworksai_backup: Return empty backup object when pending to avoid not found checks
ENHANCEMENTS:
- provider: Add
api_gateway
optional parameter to set a development API gateway. If not specified it defaults tohttps://api.hopsworks.ai
NOTES:
- resource/hopsworksai_cluster: Deprecate
aws_attributes/bucket_name
attribute to useaws_attributes/bucket/name
instead - resource/hopsworksai_cluster: Deprecate
azure_attributes/storage_account
attribute to useazure_attributes/container/storage_account
instead - resource/hopsworksai_cluster: Deprecate
azure_attributes/storage_container_name
attribute to useazure_attributes/container/name
instead
ENHANCEMENTS:
- resource/hopsworksai_cluster: Add
aws_attributes/bucket
block to contain all bucket related configurations - resource/hopsworksai_cluster: Add
aws_attributes/bucket/encryption
andaws_attributes/bucket/acl
attributes to configure the bucket encryption and ACL properties - resource/hopsworksai_cluster: Add
azure_attributes/container
block to contain all container related configurations - resource/hopsworksai_cluster: Add
azure_attributes/container/encryption
attributes to configure the container encryption
ENHANCEMENTS:
- acceptance_tests: Tag resources with their respective test name
- acceptance_tests: Providers is deprecated use ProviderFactories instead
- acceptance_tests: Use r5 and c5 instance types in RonDB upscale tests
- logging: use tflog instead of log.Printf
- dependencies: Bump hashicorp/terraform-plugin-sdk/v2 from 2.11.0 to 2.13.0
- examples: pin aws/azure provider versions to avoid breaking changes
BUG FIXES:
- resource/cluster: Add suppression check on
disk_size
attribute to avoid forced replacement during rollback
ENHANCEMENTS:
- resource/hopsworksai_cluster: Add
deactivate_hopsworksai_log_collection
attribute to deactivate or activate Hopsworks.ai log collection. - resource/hopsworksai_cluster: Add
collect_logs
attribute to enable pushing services' logs to AWS CloudWatch. - resource/hopsworksai_cluster: Add
head/node_id
readonly attribute to retrieve the corresponding aws/azure instance id of the head node. - dependencies: Bump hashicorp/terraform-plugin-sdk/v2 from 2.10.1 to 2.11.0
- dependencies: Bump hashicorp/terraform-plugin-docs from 0.5.1 to 0.7.0
NOTES:
- datasource/aws_instance_profile_policy: Deprecate
enable_upgrade
attribute since these permissions are not required anymore from version 2.4.0 onwards - datasource/azure_user_assigned_identity_permissions: Deprecate
enable_upgrade
attribute since these permissions are not required anymore from version 2.4.0 onwards
BUG FIXES:
- resource/hopsworksai_cluster: fix incorrect conversion error
- datasource/aws_instance_profile_policy: Add missing backup permissions
- resource/hopsworksai_cluster: fix upgrade and rollback to work with version 2.4.0 and onwards
ENHANCEMENTS:
- datasource/aws_instance_profile_policy: Set Default to false for
enable_upgrade
attribute - resource/hopsworksai_cluster: Set Default
version
to 2.5.0 - Extend resource testing framework to allow multiplexing HTTP requests with the same method and path
- resource/hopsworksai_cluster: Add support for changing
instance_type
of head node and RonDB nodes
ENHANCEMENTS:
- examples/complete/aws: add aws profile in variables
- datasource/dataSourceAWSInstanceProfilePolicy: Add possibility to limit permissions to eks cluster name.
- datasource/dataSourceAWSInstanceProfilePolicy: Add possibility to limit permissions to cluster id.
BREAKING CHANGES:
BUG FIXES:
- resource/hopsworksai_cluster: The
version
updates should always run with no other updates. - Fix TestExpandTags to avoid inconsistent results due to different ordering when iterating the tags map.
ENHANCEMENTS:
- resource/hopsworksai_cluster: Add support for updating
version
attribute to allow upgrade and rollback - resource/hopsworksai_cluster: Add a new computed attribute
upgrade_in_progress
- resource/hopsworksai_cluster: Rename attribute
azure_attributes/search_domain
toazure_attributes/network/search_domain
and deprecateazure_attributes/search_domain
- resource/hopsworksai_cluster: Update default
version
to 2.4.0
FEATURES:
- New Data Source:
hopsworksai_version
ENHANCEMENTS:
- resource/hopsworksai_cluster: Add a new attribute
search_domain
BUG FIXES:
- resource/hopsworksai_cluster: Fix validation condition for
backup_retention_period
- datasource/hopsworksai_cluster: Check if cluster is not nil before updating state
- resource/hopsworksai_cluster: Set Required to true for
aws_attributes/network/subnet_id
to ensure setting the subnet_name if setting up your own network configuration - Add command-failed to cluster error states
ENHANCEMENTS:
- resource/hopsworksai_cluster: Add a new attribute
init_script
- resource/hopsworksai_cluster: Add new attributes
workers/spot_config
,autoscale/non_gpu_workers/spot_config
, andautoscale/gpu_workers/spot_config
- resource/hopsworksai_cluster: Add a new attribute
os
- resource/hopsworksai_cluster: Add a new attribute
run_init_script_first
- Allow setting aws_profile and aws_region when running acceptance tests
FEATURES:
- New Resource:
hopsworksai_backup
- New Resource:
hopsworksai_cluster_from_backup
- New Data Source:
hopsworksai_backup
- New Data Source:
hopsworksai_backups
BUG FIXES:
- resource/hopsworksai_cluster: Set Required to true for
azure_attributes/network/subnet_name
to ensure setting the subnet_name if setting up your own network configuration
ENHANCEMENTS:
- resource/hopsworksai_cluster: Add a new attribute
azure_attributes/network/resource_group
to allow setting up the network on a different resource group
ENHANCEMENTS:
- Update documentations
- Add more examples
BUG FIXES:
- resource/hopsworksai_cluster: check if
ecr_registry_account_id
,eks_cluster_name
, andaks_cluster_name
is not an empty string before setting it - resource/hopsworksai_cluster: Skip name validation and relay on backend for validation
ENHANCEMENTS:
- more unit tests
- resource/hopsworksai_cluster: Add a new attribute
rondb
- resource/hopsworksai_cluster: Add a new attribute
autoscale
- resource/hopsworksai_cluster: Set Computed to true for
head/instance_type
andazure_attributes/storage_container_name
- resource/hopsworksai_cluster: Set Required to true for
workers/instance_type
- resource/hopsworksai_cluster: Set Required to true for
azure_attributes/network/virtual_network_name
andaws_attributes/network/vpc_id
- resource/hopsworksai_cluster: Set Computed to true for
azure_attributes/network/subnet_name
,azure_attributes/network/security_group_name
,aws_attributes/network/subnet_id
andaws_attributes/network/security_group_id
- datasource/azure_user_assigned_identity_permissions: Add a new attribute
enable_aks_and_acr
- resource/hopsworksai_cluster: Set Computed to true for
aws_attributes/ecr_registry_account_id
- complete example to create Hopsworks clusters with AKS/ACR and EKS/ECR
FEATURES:
- New Data Source:
hopsworksai_instance_type
- New Data Source:
hopsworksai_instance_types
FEATURES:
- New Resource:
hopsworksai_cluster
- New Data Source:
hopsworksai_clusters
- New Data Source:
hopsworksai_aws_instance_profile_policy
- New Data Source:
hopsworksai_azure_user_assigned_identity_permissions
- New Data Source:
hopsworksai_cluster