All-purpose, job, single-node, multi-node, auto-scaling, SQL warehouses, serverless and GPU compute explained — plus access modes, cost tips and which type fits each role. This Types of Clusters in Databricks guide keeps it simple.
✍️ Azure Trainings trainers⏱ 4 min read📅 Updated 11 October 2026
A Databricks cluster (compute) is a group of VMs that runs your notebooks, jobs and queries with Spark. Use job compute with auto-scaling for production pipelines, all-purpose or serverless for development, SQL warehouses for BI, single-node for learning and small tests, and GPU clusters only for deep learning. Always turn on auto-termination.
Databricks Units (DBUs) plus Azure VM time while it runs.
You choose VM size, Databricks Runtime version, number of workers and settings like auto-termination. Want to learn this hands-on? Join our Azure Data Engineer Training in Hyderabad.
Compute types
Main types of Databricks compute
💻
All-purpose compute
Interactive clusters for notebooks and development; can be shared.
For: development
⏰
Job compute
Created for a scheduled job, shut down when it finishes — cheaper for production.
For: production pipelines
📊
SQL warehouses
Optimised for SQL queries and BI tools like Power BI.
For: analysts & BI
☁️
Serverless compute
Databricks manages infrastructure and starts quickly (supported regions).
For: fast start, no tuning
🏊
Instance pools
Keep ready VMs to cut cluster start time.
For: faster starts
🎮
GPU clusters
Graphics processors for deep learning, vision and NLP.
For: deep learning only
Sizing
Single-node, multi-node and auto-scaling
↔️ Swipe the table sideways
TypeHow it worksBest forSingle-nodeEverything on the driver, no workersLearning, small data, testing, light MLMulti-nodeOne driver + many workers in parallelLarge ETL, big data analytics, distributed MLAuto-scalingAdds/removes workers between min and maxWorkloads that change size during the day
Sharing
Access modes (formerly High Concurrency)
👥
Standard (formerly Shared)
Many users share one cluster with isolation; works with Unity Catalog.
🙋
Dedicated (formerly Single user)
Assigned to one user or group; needed for some ML libraries.
For many-user SQL and BI workloads, SQL warehouses are usually the best choice.
🧭 Want to practise choosing and tuning Databricks clusters? Our trainers guide you in live labs.
RoleRecommended computeData engineersJob compute for pipelines; all-purpose or serverless for developmentData analystsSQL warehouses for queries and dashboardsData scientistsSingle- or multi-node ML runtime clusters; GPU for deep learningTeams sharing notebooksAll-purpose compute in Standard access mode
Examples
Example scenarios
Dev & test
Small single-node cluster
Test PySpark code cheaply before running on full data.
Nightly ETL
Job compute + auto-scaling
Each run gets the resources it needs and shuts down afterwards.
Image recognition
GPU cluster
Cut deep learning training time.
Illustrative examples.
Save money
How to control cluster cost
💸 Cost tips
• Turn on auto-termination (e.g. 15–30 minutes idle)
• Use job compute, not all-purpose, for scheduled pipelines
• Right-size VMs: memory-optimised for shuffle-heavy work, compute-optimised for CPU-bound
• Use auto-scaling with sensible min and max workers
• Use instance pools to reduce start time instead of keeping clusters on
• Use GPUs only for workloads that truly benefit
✕ Running production jobs on always-on all-purpose clusters
✕ No auto-termination on interactive clusters
✕ Huge clusters for small test data
Learn Databricks hands-on Our Azure Data Engineer training covers Databricks clusters, Spark tuning, Delta Lake and real pipelines.
You can learn Types of Clusters in Databricks in our live classroom batches near JNTU/KPHB or in live online batches with Azure Trainings. Book a free demo class to see how we teach before you join.
var ekit_config = {"ajaxurl":"https://azuretrainings.in/wp-admin/admin-ajax.php","nonce":"8822cf6d3c","i18n":{"video_frame":"Video player","close":"Close","slider_prev":"Previous slide","slider_next":"Next slide","slider_first":"This is the first slide","slider_last":"This is the last slide","slider_bullet":"Go to slide {{index}}"}};
//# sourceURL=ekit-core-js-extra
var localize = {"ajaxurl":"https://azuretrainings.in/wp-admin/admin-ajax.php","nonce":"c2dfb72640","i18n":{"added":"Added ","compare":"Compare","loading":"Loading..."},"eael_translate_text":{"required_text":"is a required field","invalid_text":"Invalid","billing_text":"Billing","shipping_text":"Shipping","fg_mfp_counter_text":"of"},"page_permalink":"https://azuretrainings.in/types-of-clusters-in-databricks/","cart_redirectition":"no","cart_page_url":"","el_breakpoints":{"mobile":{"label":"Mobile Portrait","value":767,"default_value":767,"direction":"max","is_enabled":true},"mobile_extra":{"label":"Mobile Landscape","value":880,"default_value":880,"direction":"max","is_enabled":false},"tablet":{"label":"Tablet Portrait","value":1024,"default_value":1024,"direction":"max","is_enabled":true},"tablet_extra":{"label":"Tablet Landscape","value":1200,"default_value":1200,"direction":"max","is_enabled":false},"laptop":{"label":"Laptop","value":1366,"default_value":1366,"direction":"max","is_enabled":false},"widescreen":{"label":"Widescreen","value":2400,"default_value":2400,"direction":"min","is_enabled":false}}};
//# sourceURL=eael-general-js-extra