Comprehensive LuxDevHQ Data Engineering Course Guide, This comprehensive course spans 4 months (16 weeks) and equips learners with expertise in Python, SQL, Azure, AWS, Apache Airf...

Using Google Cloud Functions for Three-Tier Data Processing with Google Composer and Automated Deployments via GitHub Actions, Table of Contents About Tools Used Solution Architect...

Estimating Coding Tasks: What Could Go Wrong?,Here is how the task of “adding a hash to an existing DataFrame” went from taking a couple of days to consuming almost an entire spr...

¿Cómo instalar AirFlow en instancia EC2 y no morir en el intento? 🤔,En mi labor como ingeniero de datos he visto varias herramientas que me interesa conocer, pero algunas de ell...

My Experience with Apache Airflow, 1. Get Accepted for the MLH Fellowship Program I got accepted for the MLH Fellowship Program 2024 Spring and had an opportunity to work for Apach...

Esse tal do Airflow,É uma plataforma para criar, programar e monitorar fluxos de trabalho de maneira estruturada.Isso é uma explicação simples direta para que você consiga vis...

A Custom Airflow EMR Sensor for Multiple Steps,All data engineers know Apache Airflow; if you don't know, you should. It is a platform to create, schedule, and monitor workflows. I...

Contribuindo para projetos open source, TL;DR Finalmente adentrei o mundo do open source Airflow - Dynamic DAGs example to MWAA local Sempre fui apaixonado pelo mundo do código ab...

Contributing to open source projects, TL;DR I have made my initial foray into the realm of open-source contributions: Airflow - Dynamic DAGs example to MWAA local I have always bee...

Apache Airflow: How to use git-sync with multiple GitHub repositories,Apache Airflow DAGs versioning is an important topic. There's many ways to do it and a lot of tutorials coveri...

Creating Data Pipelines as DAGs in Apache Airflow (Part 1),A DAG is a special kind of graph. So, what exactly is a graph? A graph is used to express or illustrate relationships amo...

BigQuery: Creating a pipeline between MySql and BigQuery using airflow, What is bigquery? BigQuery is a fully managed enterprise data warehouse that provides built-in features such...