DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
DB Explorer: A Lightweight Database Viewer I Built for Everyday Development Work

DB Explorer: A Lightweight Database Viewer I Built for Everyday Development Work

Comments
2 min read
A CSV Can Be Valid and Still Corrupt Your Import

A CSV Can Be Valid and Still Corrupt Your Import

Comments
2 min read
How to Validate Event Data in ClickHouse and Superset

How to Validate Event Data in ClickHouse and Superset

Comments
9 min read
How to Reconcile Nested ePOS and ERP Data Arrays Natively in the Browser

How to Reconcile Nested ePOS and ERP Data Arrays Natively in the Browser

Comments
3 min read
How to Optimize Slow dbt Models: Incremental Models, DAGs, and Query Performance

How to Optimize Slow dbt Models: Incremental Models, DAGs, and Query Performance

Comments
5 min read
Lakehouse vs Data Warehouse vs Data Lake: The Difference in One Picture

Lakehouse vs Data Warehouse vs Data Lake: The Difference in One Picture

Comments
2 min read
What is dbt and Why is it in Every Data Engineering Job Listing?

What is dbt and Why is it in Every Data Engineering Job Listing?

Comments
3 min read
Apache Iceberg Maintenance Tools: From Spark Procedures to Autonomous Control Planes

Apache Iceberg Maintenance Tools: From Spark Procedures to Autonomous Control Planes

Comments
16 min read
A test you can't run is a test you don't have

A test you can't run is a test you don't have

Comments
4 min read
Replacing an AWS Glue ingestion job with DBMS_CLOUD_PIPELINE in Autonomous Database: lessons learned

Replacing an AWS Glue ingestion job with DBMS_CLOUD_PIPELINE in Autonomous Database: lessons learned

Comments
2 min read
Why Customer AI Needs an AI-Ready Customer Profile

Why Customer AI Needs an AI-Ready Customer Profile

Comments
8 min read
From Messy CSV to Business Insight: A Small Python + SQL Analytics Pipeline

From Messy CSV to Business Insight: A Small Python + SQL Analytics Pipeline

Comments
4 min read
Databricks Architecture Explained: Control Plane, Compute Plane, Delta Lake and Unity Catalog

Databricks Architecture Explained: Control Plane, Compute Plane, Delta Lake and Unity Catalog

Comments
2 min read
5,800 Data Engineers on What Is Actually in Production in 2026

5,800 Data Engineers on What Is Actually in Production in 2026

Comments
7 min read
Scraping Adversarial Municipal Portals: A Permit Pipeline That Knows When It Failed

Scraping Adversarial Municipal Portals: A Permit Pipeline That Knows When It Failed

Comments
11 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.