Data Engineer

Job Description: Role Overview:

Hands-on experience with Azure Services: Databricks, Data Factory and DevOps

Proficient in Python, Apache Spark, and PySpark

Write advance and complex SQL queries with solid experience in database management

Develop and maintain data models, data warehouses, and data marts in Snowflake

Automation, build re-usable transformations, performance tuning

Streamline ETL complexity- logics and transformations

Collaborate with data scientists, analysts, and stakeholders to gather requirements and define data models that effectively support business requirements

Demonstrate decision-making, analytical and problem-solving abilities

Strong verbal and written communication skills to manage client discussions

Familiar with working on Agile methodologies - daily scrum, sprint planning, backlog refinement

Responsibilities: Role Overview:

Hands-on experience with Azure Services: Databricks, Data Factory and DevOps

Proficient in Python, Apache Spark, and PySpark

Write advance and complex SQL queries with solid experience in database management

Develop and maintain data models, data warehouses, and data marts in Snowflake

Automation, build re-usable transformations, performance tuning

Streamline ETL complexity- logics and transformations

Collaborate with data scientists, analysts, and stakeholders to gather requirements and define data models that effectively support business requirements

Demonstrate decision-making, analytical and problem-solving abilities

Strong verbal and written communication skills to manage client discussions

Familiar with working on Agile methodologies - daily scrum, sprint planning, backlog refinement

Qualifications: Skillsets:

5-8 years of relevant DE experience

Azure Databricks– ability to create data transformation logics

Strong programming skills in Python and experience with SQL.

Should be able to write complex SQL, Transact SQL, Stored Procedures

ETL tool – Azure data factory, Data Bricks

Experience with Data Modelling

Excellent communication skills and stakeholder management

Ability to work independently in IC role

Good to have

Knowledge on Snowflake platform

Knowledge on PowerBI

Familiarity with CI/CD practices and version control (e.g., Git)

Familiarity with Azure DevOps