DiscoverChannel Request information
CoursesRoadmapThe flowBlogFAQAbout Request information

Data · Intermediate · Online live

Data Pipeline Automation

Orchestrate ETL jobs with Airflow and test data contracts in automated workflows.

Data Pipeline Automation lab environment

Duration: 10 weeks

Format: Online live

Price: ₩1,750,000

Informational only — no checkout on this site.

Request information Money-Back Policy

Overview

For analysts and engineers building reliable data movement. Covers scheduling, retries, data quality checks, and operational handoffs.

What is included

  • Airflow DAG design patterns
  • Data contract testing intro
  • Backfill strategies
  • Observability for batch jobs
  • Cost-aware scheduling tips
  • Mentor review of DAG structure
  • Portfolio DAG documentation

Outcomes

  • Deploy a scheduled pipeline with alerts
  • Implement a contract test on sample data
  • Write a runbook for failed partitions

Mentor

Jin-woo Baek
Jin-woo Baek

Data platform engineer; batch and streaming hybrids.

FAQ

Intermediate SQL is expected; Python for operators is taught in-module.

Reviews

Contract testing section was newer to me — mentor examples used our retail sample schema convincingly.