Beta - Databricks Autoscale Badly Setup
- Query id: 953c0cc6-5f30-44cb-a803-bf4ef2571be8
- Query name: Beta - Databricks Autoscale Badly Setup
- Platform: Terraform
- Severity: Medium
- Category: Resource Management
- CWE: 400
- URL: Github
Description¶
Databricks should have min and max worker setup for autoscale
Documentation
Code samples¶
Code samples with security vulnerabilities¶
Positive test num. 1 - tf file
resource "databricks_cluster" "positive1" {
cluster_name = "Shared Autoscaling"
spark_version = data.databricks_spark_version.latest.id
node_type_id = data.databricks_node_type.smallest.id
autotermination_minutes = 20
autoscale {
min_workers = 1
}
aws_attributes {
availability = "SPOT"
zone_id = "us-east-1"
first_on_demand = 1
spot_bid_price_percent = 100
}
}
Positive test num. 2 - tf file
resource "databricks_cluster" "positive2" {
cluster_name = "Shared Autoscaling"
spark_version = data.databricks_spark_version.latest.id
node_type_id = data.databricks_node_type.smallest.id
autotermination_minutes = 20
autoscale {
max_workers = 50
}
aws_attributes {
availability = "SPOT"
zone_id = "us-east-1"
first_on_demand = 1
spot_bid_price_percent = 100
}
}
Code samples without security vulnerabilities¶
Negative test num. 1 - tf file
resource "databricks_cluster" "negative" {
cluster_name = "Shared Autoscaling"
spark_version = data.databricks_spark_version.latest.id
node_type_id = data.databricks_node_type.smallest.id
autotermination_minutes = 20
autoscale {
min_workers = 1
max_workers = 50
}
aws_attributes {
availability = "SPOT_WITH_FALLBACK"
zone_id = "auto"
first_on_demand = 1
spot_bid_price_percent = 100
}
}