Lead Data Engineer – Azure & Databricks_ Nottingham, Hybrid (Lead I - Data Engineering)

Role description

Lead Data Engineer – Azure & Databricks

Nottingham (Hybrid – 3 days onsite)

Start: July 2026

Employment Type: Permanent / Fixed Term

We are seeking a Lead Data Engineer to play a critical role in designing and delivering enterprise-scale data platforms that power advanced analytics and business decision-making.

This is an opportunity to lead from the front, shaping modern data architecture, building scalable data pipelines, and mentoring talented engineering teams within a cloud-first, data-driven environment.

You will work closely with architects, data scientists, and senior stakeholders to deliver secure, high-performing data solutions aligned to strategic business outcomes.

What You’ll Be Doing:

Lead the design and delivery of scalable data platforms using Azure and Databricks

Architect and build batch and real-time data pipelines leveraging distributed processing frameworks

Develop and optimise ETL/ELT pipelines, data ingestion frameworks, and orchestration workflows

Drive adoption of Lakehouse architecture, Delta Lake, and modern data modelling practices

Implement robust data governance, quality, and performance optimisation strategies

Collaborate with cross-functional teams to translate business needs into technical solutions

Champion engineering excellence through code reviews, best practices, and reusable frameworks

Mentor and guide engineers, helping to build high-performing, scalable teams

Lead the implementation of CI/CD pipelines, DevOps practices, and Infrastructure as Code

What You’ll Bring:

Extensive experience in data engineering and cloud-based data platform delivery

Strong hands-on expertise with:

Databricks, PySpark, Spark SQL

Python and/or Scala

Real-time technologies such as Kafka / Event streaming platforms

Deep knowledge of Microsoft Azure services, including:

Azure Data Factory (ADF), ADLS, Synapse Analytics

Azure Functions, Event Hub

Proven experience designing large-scale, enterprise-grade data solutions

Strong understanding of:

Data warehousing, Lakehouse architecture, Delta Lake

Data modelling, governance, and quality frameworks

Experience with DevOps, CI/CD, and Infrastructure as Code (e.g. Azure DevOps, Git, Terraform)

A collaborative mindset with the ability to engage and influence technical and non-technical stakeholders

Hurry & apply for a more detailed conversation!

#UST

Skills

data engineering,microsoft azure services,azure platform,cloud computing,

About UST

UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.