Azure Databricks Engineer Expert
Skills
About the role
This role is for one of our clients
Industry: IT Services and IT Consulting
Seniority level: Mid-Senior level
Min Experience: 4+ years
Location: Bengaluru, Pune
JobType: full-time
We are looking for a highly skilled Databricks Engineer to design, develop, and optimize data pipelines and analytics solutions. The ideal candidate will have strong expertise in Databricks, PySpark, and SQL, along with experience in creating scalable data solutions across cloud platforms.
Requirements
Key Responsibilities
Design and develop data pipelines and ETL workflows using Databricks and PySpark.
Create and enhance SQL queries for data transformation and analytical purposes.
Work closely with data architects, analysts, and business stakeholders to deliver high-quality data solutions.
Maintain data quality, governance, and compliance throughout all processes.
Integrate data from diverse sources and effectively handle large-scale datasets.
Diagnose issues and improve the performance of data workflows and queries.
Primary Skills (Must-Have)
Strong proficiency in Databricks, including Delta Lake and machine learning capabilities.
Advanced expertise in PySpark for distributed data processing.
Excellent SQL skills for data manipulation and analytics.
Good-to-Have Skills
Experience with cloud services on Azure (ADF, Synapse, Purview, Fabric).
Knowledge of AWS services such as Glue, Lambda, and Step Functions.
Familiarity with workflow orchestration tools like Airflow.
Experience using data transformation and integration tools including DBT, Fivetran, and Informatica.
Understanding of streaming and messaging platforms like Kafka.
BI and data visualization skills with Power BI.
Experience with data governance tools such as Collibra and Alation.
Knowledge of Google Cloud Platform’s BigQuery.
Qualifications
Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related discipline.
Demonstrated experience in constructing and managing data pipelines within cloud environments.
Strong analytical and problem-solving abilities.
Excellent communication and teamwork skills.
Nice to Have
Experience operating in multi-cloud environments such as Azure, AWS, and GCP.
Familiarity with modern data stack technologies and data governance frameworks.
Must-have skills
Databricks, PySpark, Microsoft Azure
Good-to-have skills
SQL
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
Questions about this role
How do I apply to this Azure Databricks Engineer Expert role at Weekday?
Click "Apply with AI Applyd" above. We auto-fill the application from your resume and answer screening questions in seconds. No copy and paste, no juggling tabs.
What's the typical salary for Software Engineer in India?
Compensation for Software Engineer roles in India varies widely by seniority, employer size, and remote vs onsite arrangement. Check the salary range on this listing when published, or browse our Software Engineer hub for India medians across recent openings.
How fast does AI Applyd auto-apply?
Most applications complete in under 90 seconds. You can track the status in your dashboard and watch the screenshot proof land the moment the application submits.
What ATS does Weekday use?
AI Applyd supports Greenhouse, Lever, Ashby, Workday, iCIMS, SmartRecruiters, LinkedIn Easy Apply, and most other ATS platforms. If we can submit through the platform, we do.
Want AI Applyd to auto-apply to roles like this?
We tailor your resume per posting, fill the forms, and track replies for you.