# dataengineering

1 min read

Christian Himpe

Mar 19

My Data Engineering Library

#dataengineering #agile #sql #docker

2 min read

Kleinanzeigen & mobile.de for Berlin Tech Blog

Mar 18

“Data has a Dream” — A Short comic about data mesh and how it can transform your company

#data #datamesh #dataengineering

2 min read

Judy

Mar 18

How to Transpose Columns in Each Group to a Single Row

#sql #database #coding #dataengineering

7

2 min read

Luis Chirlaque Hernández

Mar 19

DBT (Data Build Tool)

#dataengineering #datamodelling #español #dbt

4 min read

Nitin-bhatt46

Mar 14

"Day 44 of My Learning Journey: Setting Sail into Data Excellence! Today's Focus: Mathematics for Data Analysis (Stats Day -22)

#data #dataengineering #datascience #journey

2 min read

Nitin-bhatt46

Mar 18

"Day 45 of My Learning Journey: Setting Sail into Data Excellence! Today's Focus: Mathematics for Data Analysis (Stats Day -24)

#journey #coding #datascience #dataengineering

1 min read

Apache Doris

Mar 14

Apache Doris 2.1.0: TPC-DS, Parallel Adaptive Scan, Local Shuffle, Arrow Flight-based HTTP Data API

#database #dataengineering #datascience #ai

29 min read

MicroAI for MicroAI Inc

Mar 14

AI and Data Sets – Maximizing the Power of Data

#datamodeling #datascience #dataengineering #aistudio

3 min read

Nitin-bhatt46

Mar 13

"Day 43 of My Learning Journey: Setting Sail into Data Excellence! Today's Focus: Mathematics for Data Analysis (Stats Day -22)

#data #datascience #dataengineering #journey

2 min read

Nitin-bhatt46

Mar 11

"Day 42 of My Learning Journey: Setting Sail into Data Excellence! Today's Focus: Mathematics for Data Analysis (Stats Day -21)

#journey #data #datascience #dataengineering

1 min read

Alex Merced

Mar 6

The Apache Iceberg Lakehouse: The Great Data Equalizer (disrupting the Snowflake/Databricks status quo)

#apacheiceberg #dataengineering #datanalytics #datalakehouse

7 min read

Alex Merced

Mar 1

A deep dive into the concept and world of Apache Iceberg Catalogs

#data #dataengineering #apache #iceberg

8 min read

adriens for opt-nc

Mar 4

📢 About job offers, innovation & data strategy 🔭

#datascience #jupyter #dataengineering #opendata

3

3 min read

Cris Crawford

Mar 13

RisingWave workshop

#stream #dataengineering #risingwave #sql

5 min read

Cris Crawford

Mar 13

Visualization in dbt

#dbt #dataengineering #datavisualization

3 min read

Bala Madhusoodhanan

Mar 4

Xavier's Insight: Overcoming Data Hoarding Disorder

#discuss #dataengineering

5

3 min read

Cris Crawford

Mar 13

Production and CI/CD in dbt

#dbt #dataengineering #github

3 min read

Burak Karakan

Feb 27

The Pains of Data Ingestion

#data #dataengineering #beginners #programming

16

6 min read

Cris Crawford

Feb 24

Testing and documenting DBT models

#dbt #testing #dataengineering

3 min read

Cris Crawford

Feb 24

Building a project in DBT

#dbt #dataengineering #bigquery #sql

5 min read

Alex Merced

Feb 25

The Role of Ontologies in Data Management

#database #dataengineering

6 min read

Richard Li

Mar 8

When Metrics Go Awry: Analyzing KPIs using machine learning, regression analysis, and Shapley values

#machinelearning #saasmetrics #datascience #dataengineering

5 min read

masudahiroto

Feb 17

XGBoost Training Speed: A Comparative Analysis

#machinelearning #datascience #dataengineering #ai

2 min read

Gaurav Vishwakarma

Feb 24

Embarking on the Data Odyssey: A Deep Dive into Data Engineering for Tech Enthusiasts

#dataengineering #data #python #spark

3 min read

Lorenzo Tenti

Feb 13

Big Data is dead & other stories

#machinelearning #machinelearningengineering #dataengineering #mlops

2 min read

Satoshi S.

Mar 12

My Experience with Apache Airflow

#intern #airflow #python #dataengineering

6

3 min read

Pedro H Goncalves

Mar 10

Different file formats, a benchmark doing basic operations

#dataengineering #spark #benchmark #datascience

8

9 min read

Sohail Pathan

Mar 6

Face Detection using AI: Use Cases, Benefits and Implementation

#facedetection #ai #api #dataengineering

8 min read

Paul Duvenage for Check Technologies

Mar 5

How moving from Pandas to Polars made me write better code without writing better code

#polars #dataengineering #rust #airflow

10

14 min read

Cris Crawford

Mar 4

GroupBy and Join in Spark

#spark #sql #dataengineering

2 min read

Alex Merced

Mar 2

10 Reasons to Make Apache Iceberg and Dremio Part of your Data Lakehouse Strategy

#database #dataengineering #datawarehouse #datalake

9 min read

silverboi

Jan 29

Exploring Feature Stores: Personal Insights and Notes on Hopsworks pt.2

#mlops #dataengineering

1 min read

Bruno Nirello

Feb 8

Benchmarking Python Processing Engines: Who’s the Fastest?

#duckdb #python #dataengineering #database

4 min read

Muhammad Adnan Khan for AWS Community Builders

Jan 29

AWS Kinesis - Stream Storage Layer

#kinesis #awsbigdata #stream #dataengineering

3 min read

Cris Crawford

Feb 15

Extracting data with dlt

#dataengineering #dlt #duckdb

7 min read

Viv.esProcSPL

Feb 26

SPL - a database language featuring easy writing and fast running

#database #dataengineering #sql #programming

16

15 min read

Apache Doris

Jan 22

Hands-on Guide to Enable Compute Nodes for Data Lake Analytics in Apache Doris

#tutorial #database #analytics #dataengineering

4 min read

Cris Crawford

Feb 18

Incremental loading in dlt

#dlt #dataengineering

2 min read

Anthony Master

Jan 16

Since When Did APIs Become Databases?

#database #api #dataengineering

4 min read

Neeraj Iyer

Jan 15

Amazon Quicksight vs Microsoft PowerBI

#quicksight #dataengineering #analytics #developer

3 min read

adriens

Jan 31

🦿🛴Smarcity garbage reporting automation w/ ollama

#ai #opensource #automation #dataengineering

4

3 min read

Ayokunle Adeniyi for AWS Community Builders

Feb 10

What to think about when designing, building, managing and operating data systems.

#discuss #systemdesign #dataengineering #learning

8 min read

Cris Crawford

Feb 10

BigQuery best practices

#dataengineering #bigdata

2 min read

Burak Karakan

Feb 8

The Mythical Data Team

#data #dataengineering #team #datascience

6 min read

Richard Li

Jan 12

Using data for predictive analytics

#dataengineering #datascience #data

6 min read

Neeraj Iyer

Dec 27 '23

Glue Data Brew- Data Profiling & Data Quality

#glue #databrew #dataengineering #analyst

3 min read

Romi Mendez

Jan 24

Transform your R Dataframes: Styles, 🎨 Colors, and 😎 Emojis

#data #datascience #r #dataengineering

9 min read

Mwenda Harun Mbaabu

Jan 22

Modern Data Engineering RoadMap - 2024

#dataengineering #datascience #analytics #python

31

3 min read

Alvaro Garcia

Jan 21

Introducción a los Data Lakes

#datalake #aws #spanish #dataengineering

3 min read

Cris Crawford

Jan 20

Data Engineering Saga part 2

#learning #postgres #dataengineering

3 min read

silverboi

Jan 21

Exploring Feature Stores: Personal Insights and Notes on Hopsworks

#mlops #dataengineering

1 min read

Muhammad Adnan Khan for AWS Community Builders

Jan 19

Data Evolution - Databases to Data Lakehouse

#aws #dataengineering #database #datalake

4

4 min read

Chloe Caron

Jan 18

How to build an Anomaly Detector using BigQuery

#dataengineering #datascience #bigquery #machinelearning

4

12 min read

RogerWoods

Dec 16 '23

How proficient is generated AI in transforming text or natural language into SQL?

#developers #dataengineering #ai #database

4 min read

Maddy Quinn for Ably

Jan 17

How NASCAR delivers realtime racing data to millions of fans around the world

#database #dataengineering #webdev #interview

16

2 min read

Dendi Handian

Jan 17

VS Code Extensions for Data Engineering - Part 1

#dataengineering #datascience #database #vscode