DEV Community

#databricks

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Delta Lake Schema Evolution and Time Travel on Azure Databricks: mergeSchema, overwriteSchema, Column Mapping, and RESTORE

Delta Lake Schema Evolution and Time Travel on Azure Databricks: mergeSchema, overwriteSchema, Column Mapping, and RESTORE

Comments
5 min read
Repartition vs Coalesce vs partitionBy on Azure Databricks: Controlling Output Files When Writing Delta Tables

Repartition vs Coalesce vs partitionBy on Azure Databricks: Controlling Output Files When Writing Delta Tables

Comments
6 min read
Databricks co‑founder reveals how to win big‑enterprise customers

Databricks co‑founder reveals how to win big‑enterprise customers

Comments
3 min read
Databricks Lakehouse Platform for Real-Time, Agentic Data and AI Workloads

Databricks Lakehouse Platform for Real-Time, Agentic Data and AI Workloads

Comments
3 min read
Databricks Runtime Introduces NEAREST BY: Native SQL Vector Search at Scale

Databricks Runtime Introduces NEAREST BY: Native SQL Vector Search at Scale

Comments
4 min read
Tiered Storage in Apache Kafka — Hot Data on Disk, Old Data in S3 (and the Same Trick That Cuts a Databricks Bill)

Tiered Storage in Apache Kafka — Hot Data on Disk, Old Data in S3 (and the Same Trick That Cuts a Databricks Bill)

1
Comments 1
8 min read
Auto CDF Moved the CDC Tax From Writes to Reads: Delta CDF vs Auto CDF vs Spark 4.2 CHANGES

Auto CDF Moved the CDC Tax From Writes to Reads: Delta CDF vs Auto CDF vs Spark 4.2 CHANGES

1
Comments 1
9 min read
Beyond File Storage: Using Amazon S3 as a Historical Data Layer

Beyond File Storage: Using Amazon S3 as a Historical Data Layer

1
Comments 1
7 min read
PySpark Caching on Azure Databricks: cache() vs persist() vs checkpoint(), the Disk Cache, and When Caching Hurts

PySpark Caching on Azure Databricks: cache() vs persist() vs checkpoint(), the Disk Cache, and When Caching Hurts

1
Comments
6 min read
Databricks Generative AI Engineer Associate: what to actually study

Databricks Generative AI Engineer Associate: what to actually study

Comments
3 min read
Databricks Data Engineer Associate Exam 2026: Format, Domains and Study Plan

Databricks Data Engineer Associate Exam 2026: Format, Domains and Study Plan

Comments
3 min read
Databricks for AI Engineering

Databricks for AI Engineering

Comments
8 min read
Databricks sells AI. 24 of its 29 design questions are classic, not AI.

Databricks sells AI. 24 of its 29 design questions are classic, not AI.

Comments
7 min read
Auto Loader and Structured Streaming on Azure Databricks: Checkpoints, Schema Evolution, and Exactly-Once

Auto Loader and Structured Streaming on Azure Databricks: Checkpoints, Schema Evolution, and Exactly-Once

Comments
6 min read
PySpark Window Functions on Databricks: Latest-Record Dedup, Running Totals, Sessionisation, and the Frame Traps

PySpark Window Functions on Databricks: Latest-Record Dedup, Running Totals, Sessionisation, and the Frame Traps

1
Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.