DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
The Silent CDC Bug: Data Loss With No Errors
pipelinewhiteboard profile

The Silent CDC Bug: Data Loss With No Errors

#dataengineering #postgres #kafka #database
Comments
7 min read
Delta Lake Schema Evolution and Time Travel on Azure Databricks: mergeSchema, overwriteSchema, Column Mapping, and RESTORE
karanpulyala profile

Delta Lake Schema Evolution and Time Travel on Azure Databricks: mergeSchema, overwriteSchema, Column Mapping, and RESTORE

#databricks #deltalake #pyspark #dataengineering
Comments
5 min read
Debezium Postgres to Kafka: Every Setting Explained
pipelinewhiteboard profile

Debezium Postgres to Kafka: Every Setting Explained

#dataengineering #postgres #kafka #tutorial
Comments
8 min read
dbt tests that actually catch bad data
fisher_51 profile

dbt tests that actually catch bad data

#dataengineering #dbt #testing
Comments
1 min read
Your CSV importer needs an exception report, not just column mapping
mapryva profile

Your CSV importer needs an exception report, not just column mapping

#python #csv #dataengineering #abotwrotethis
Comments
5 min read
OCR is a step, not a guarantee (turning scanned archives into usable data)
fabienk profile

OCR is a step, not a guarantee (turning scanned archives into usable data)

#ocr #automation #dataengineering #productivity
Comments
5 min read
Dataflow Gen2 Eating Your Microsoft Fabric Capacity? Why Default Settings Burn 60-80% Extra CUs
costfabric profile

Dataflow Gen2 Eating Your Microsoft Fabric Capacity? Why Default Settings Burn 60-80% Extra CUs

#microsoftfabric #dataengineering #powerbi #etl
Comments
3 min read
Power BI Premium P1 to Microsoft Fabric F64 Migration: Why Most Teams Are Over-Provisioned
costfabric profile

Power BI Premium P1 to Microsoft Fabric F64 Migration: Why Most Teams Are Over-Provisioned

#powerbi #microsoftfabric #finops #dataengineering
Comments
3 min read
Snowflake Openflow Limitations: 6 Production Trade-offs
techsourabh profile

Snowflake Openflow Limitations: 6 Production Trade-offs

#dataengineering #database #snowflake #etl
Comments
15 min read
Data apps, defined: levels, principles, and a scorecard builders can actually use
sangaraju1988 profile

Data apps, defined: levels, principles, and a scorecard builders can actually use

#dataengineering #ai #analytics #architecture
1
Comments
8 min read
Metadata Graph for Data Engineering: A Practical Guide
agenticstacks123 profile

Metadata Graph for Data Engineering: A Practical Guide

#dataengineering #ai #metadata #tutorial
Comments
11 min read
1% of Layoffs Blamed on AI: What Gallup Means for Data Engineers
datadriven profile

1% of Layoffs Blamed on AI: What Gallup Means for Data Engineers

#dataengineering #career #ai #interview
Comments
8 min read
Why Pausing Your Microsoft Fabric Capacity Triggers Surprise Azure Bills (Smoothing & Carryforward)
costfabric profile

Why Pausing Your Microsoft Fabric Capacity Triggers Surprise Azure Bills (Smoothing & Carryforward)

#microsoftfabric #powerbi #dataengineering #azure
1
Comments 1
4 min read
Design patterns, explained: the vocabulary of an object-oriented design interview
gowthampotureddi profile

Design patterns, explained: the vocabulary of an object-oriented design interview

#designsystem #walkin #interview #dataengineering
Comments
13 min read
Replacing a Spreadsheet Report With an Automated Workflow: A Practical Checklist
affix_centersoftechserv profile

Replacing a Spreadsheet Report With an Automated Workflow: A Practical Checklist

#automation #dataengineering #python #productivity
Comments
2 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.