Microsoft Fabric

AIA -Pune Location Primery Skill-Microsoft Fabric

Job Summary

Sr Developer with 6 to 10 years of experience will design and optimize data solutions using LakeHouse Spark Job Definition OneLake SQL and PySpark while working in a hybrid day shift model and collaborating with cross functional teams to deliver reliable analytics that support retail banking focused initiatives and strategic decision making across the organization

Responsibilities

Design advanced data processing solutions on LakeHouse platforms that enable reliable analytics and reporting for critical business initiatives across hybrid environments

Develop scalable Spark Job Definition pipelines that process large data volumes efficiently while maintaining accuracy and consistency for downstream consumers

Build and optimize PySpark jobs that transform raw data into curated data sets supporting complex analytical models and operational dashboards for internal stakeholders

Write high quality SQL queries and stored procedures that ensure robust data extraction transformation and loading while adhering to performance and security standards

Implement data models within OneLake that unify structured and semi structured data sources to provide a single trusted view for analytics and data products

Collaborate with data engineers architects and analysts to translate business requirements into technical solutions that align with enterprise data strategies

Optimize data pipelines for performance reliability and cost efficiency by tuning Spark configurations query logic and resource utilization across environments

Implement data quality checks validation rules and monitoring processes that prevent data issues and ensure trustworthy insights for decision makers

Document technical designs data flows and operational procedures clearly so that solutions are easy to maintain enhance and troubleshoot by the wider team

Support production deployments by analyzing issues performing impact assessments and implementing stable fixes that minimize disruption to business operations

Participate in code reviews knowledge sharing sessions and continuous improvement activities that uplift engineering standards and foster a culture of technical excellence

Partner with business teams in domains such as retail banking to understand use cases and ensure data solutions deliver measurable value and positive societal impact

Adapt effectively to the hybrid work model by collaborating through digital tools coordinating with onsite and remote colleagues and maintaining clear communication

Qualifications

Demonstrate strong hands on expertise in LakeHouse architectures with a proven track record of delivering scalable and secure data solutions in enterprise settings

Exhibit advanced skills in Spark Job Definition and PySpark including experience with performance optimization fault tolerance and batch or streaming workloads

Show proficiency in SQL with the ability to design complex queries optimize execution plans and implement robust data transformations in production environments

Apply practical experience with OneLake or similar unified data platforms to consolidate disparate sources and support analytics self service and governance requirements

Bring solid experience in data engineering or development roles with six to ten years of progressive responsibility in modern data platforms and tools

Utilize knowledge of retail banking or financial services as a nice to have capability to design solutions that align with domain specific data patterns and regulatory needs

Communicate clearly with technical and non technical partners and contribute to a collaborative culture that supports ethical data use and better outcomes for customers and society

Certifications Required

Preferred certifications include Databricks Data Engineer Associate or Azure Data Engineer Associate or equivalent cloud data engineering credentials