Data Engineer
Skills
About the role
Experience • Design, develop, and operate reliable data pipelines and DAGs using Apache Airflow/Cloud Composer for batch and near real time workflows. • Build ELT/ETL on GCP services (e.g., BigQuery, Dataflow, Pub/Sub, Cloud Storage; Composer for orchestration); enforce coding, testing, and observability standards. • Write expert level SQL for modeling, complex transformations, windowing functions, and performance tuning; own query efficiency and cost optimization. • Develop Python data components (operators, hooks, transforms), packaging and CI/CD for deployment to Composer/Dataflow. • Work with Big Data ecosystems and MPP warehouses; support data ingestion, schema evolution, and partitioning/clustering strategies. • Integrate Postgres sources/targets • Partner with product, analytics, and platform teams; uphold security, compliance, data quality (DQ checks, SLAs), and documentation standards.
Questions about this role
Want AI Applyd to auto-apply to roles like this?
We tailor your resume per posting, fill the forms, and track replies for you.