Sr Data Engineer

Job Summary

The Senior Data Engineer is responsible for developing and maintaining scalable data pipelines, data transformation processes, and enterprise data warehouse solutions using Microsoft Fabric. The ideal candidate should possess strong technical expertise in cloud-based data engineering and be capable of independently delivering high-quality data integration and analytics solutions.

Key Responsibilities

Develop and maintain data ingestion, transformation, and integration pipelines using Microsoft Fabric.

Build, optimize, and maintain Pyspark notebooks for large-scale data processing.

Implement metadata-driven ETL/ELT frameworks.

Develop and maintain Fabric Data Warehouse objects.

Work with One Lake for enterprise-scale data storage and management.

Ensure high-quality, secure, and reliable data processing while adhering to PII handling and data governance standards.

Collaborate with business analysts, architects, and reporting teams to deliver data solutions supporting analytics and Power BI reporting.

Optimize existing data pipelines for performance, scalability, and reliability.

Troubleshoot production issues and provide timely resolution.

Follow coding standards, documentation practices, version control, and deployment processes.

Required Qualifications

Bachelor’s degree in computer science, Information Technology, Engineering, or a related discipline.

5+ years of experience in Data Engineering with hands-on experience in Microsoft Fabric or similar cloud-based data platforms.

Experience developing and maintaining cloud-based data engineering solutions.

Strong understanding of ETL/ELT concepts, data modeling, and data warehousing.

Good analytical, troubleshooting, and problem-solving skills.

Excellent communication and collaboration skills.

Technical Skills

Microsoft Fabric

Fabric Data Pipelines

PySpark Notebooks

Metadata-Driven Design

OneLake

Fabric Data Warehouse

ETL/ELT Development

Data Modeling

SQL

Python

Power BI

PII Handling and Data Governance

Git

Performance Optimization and Data Pipeline Monitoring

Job Types: Full-time, Contract Contract length: 12 months

Pay: $115,000.00 - $140,000.00 per year

Experience:

Data engineering: 5 years (Required)

Microsoft Fabric: 4 years (Required)

Work Location: Remote