Data Engineer
Skills
About the role
Position Summary:
An experienced data engineer with strong Azure Databricks expertise is required for a 6 month contract to develop and deliver a scalable data pipeline that ingests files and transforms them into standardised, high-quality datasets for reporting. This is a hands-on delivery role focused on building a production-grade pipeline, suited to someone comfortable working independently, defining technical solutions, and rapidly delivering high-quality data engineering components.
Location:
London - UK - Fenchurch
What will your job entail?
Key Responsibilities
Implement a scalable ETL pipeline in Azure Databricks, that transforms raw data into standardised schemas to support reporting and analytics, following a medallion architecture in line with internal design standards.
Leverage an existing email ingestion tool to extract multiple format source files from a shared mailbox.
Develop notebooks, jobs and pipelines in Databricks for ETL orchestration.
Integrate with CI/CD flows across environments using Azure DevOps.
Produce clear technical documentation of the solution to ensure maintainability post-delivery.
Experience
2+ years hands-on experience with Azure Databricks, including data validation, transformation, and optimization.
Expertise in PySpark/Spark SQL.
Knowledge of Unity Catalog and modern Azure Databricks features, as well as data best practices and concepts.
Proficiency building end-to-end data pipelines with Delta Lake/Lakehouse architecture.
Experience implementing CI/CD pipelines (Azure DevOps preferred).
Experience supporting BI reporting layers (Power BI or similar) is nice to have.
Insurance experience is nice to have.
Disclaimer
Questions about this role
How do I apply to this Data Engineer role at Ryan Specialty Group?
Click "Apply with AI Applyd" above. We auto-fill the application from your resume and answer screening questions in seconds. No copy and paste, no juggling tabs.
What's the typical salary for Data Engineer in United Kingdom?
Compensation for Data Engineer roles in United Kingdom varies widely by seniority, employer size, and remote vs onsite arrangement. Check the salary range on this listing when published, or browse our Data Engineer hub for United Kingdom medians across recent openings.
How fast does AI Applyd auto-apply?
Most applications complete in under 90 seconds. You can track the status in your dashboard and watch the screenshot proof land the moment the application submits.
What ATS does Ryan Specialty Group use?
AI Applyd supports Greenhouse, Lever, Ashby, Workday, iCIMS, SmartRecruiters, LinkedIn Easy Apply, and most other ATS platforms. If we can submit through the platform, we do.
Want AI Applyd to auto-apply to roles like this?
We tailor your resume per posting, fill the forms, and track replies for you.