close

DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
ClickHouse Native JSON Support in 2026: A PR-by-PR Analysis

ClickHouse Native JSON Support in 2026: A PR-by-PR Analysis

Image Image 6
Comments 1
24 min read
Part 7 - Spark Transform Local vs Cloud ⚡

Part 7 - Spark Transform Local vs Cloud ⚡

Comments
2 min read
Part 1 - Introduction and End-to-End Architecture

Part 1 - Introduction and End-to-End Architecture

Comments
2 min read
Part 9 - dbt Project Setup and Contracts 🧱

Part 9 - dbt Project Setup and Contracts 🧱

Comments
1 min read
Part 8 - Staging Load into Postgres 🗃️

Part 8 - Staging Load into Postgres 🗃️

Comments
2 min read
Part 14 - Cloud Deployment and Lessons Learned ☁️

Part 14 - Cloud Deployment and Lessons Learned ☁️

Comments
2 min read
Part 11 - Dimensions and Fact Table 📊

Part 11 - Dimensions and Fact Table 📊

Comments
2 min read
Part 4 - Airflow Runtime and Shared Config ⚙️

Part 4 - Airflow Runtime and Shared Config ⚙️

Comments
2 min read
Part 5 - Ingestion DAG and Raw Storage 📥

Part 5 - Ingestion DAG and Raw Storage 📥

Comments
2 min read
Part 2 - Data Sources and Domain Model 📡

Part 2 - Data Sources and Domain Model 📡

Comments
2 min read
Part 6 - API Client Design and Reliability 🔁

Part 6 - API Client Design and Reliability 🔁

Comments
2 min read
Part 3 - Station Sampling and Cache Building 🗂️

Part 3 - Station Sampling and Cache Building 🗂️

Comments
2 min read
greatCircleDistance in ClickHouse: Avoiding Full Table Scans

greatCircleDistance in ClickHouse: Avoiding Full Table Scans

Image Image 2
Comments
2 min read
What Is Data Downtime and How Do You Measure It?

What Is Data Downtime and How Do You Measure It?

Comments
15 min read
Kafka Consumer Patterns: What You Actually Need in Production

Kafka Consumer Patterns: What You Actually Need in Production

Image 1
Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.