Data Engineer

Description

Contract type: Permanent

Hours: 37.5

Salary: circa £62,000 depending on experience

Location: Canary Wharf

WFH policy: Employees are required to attend the office 2 days/week

Flexible working: Variety of flexible work patterns subject to line manager discretion e.g. Compressed 9-day fortnight.

Reports to: Data Engineering Manager

Deadline Note: We reserve the right to close the advert before the advertised deadline if there are a high volume of applications.

Role Summary:

The Data engineer role will have a specific focus on data and integration, ensuring that they drive a single version of the truth by developing and maintaining reliable solutions to store and manage key data.

The role will source, model, and provide data in a form which is ready for report/dashboard building. They support the data team and participate in the design, development, and maintenance activities for LCCCs databases and data warehouse, as well as ensure following the defined data systems standards that conform to the data architecture.

They will also build and maintain key data governance and management artefacts.

Key Responsibilities

Participate in designing, developing and maintaining activities for LCCC DataWarehouse ensuring reliable data across the organisation

Source, model and provide reliable data in a form that is ready for report/dashboard building

Follow the data governance standards

Build and maintain key data governance and management artefacts e.g., Flow Diagram, Data Dictionary.

Identify patterns, anomalies, and structure of data in preparation for Extract Load and Transformation.

Perform data validation, quality checks, and reconciliation across source and target systems.

Define the low-level design of a data warehouse to ensure robustness e.g., restorability, traceability, ease to support, etc.

Help design and maintain the modern DataWarehouse architecture, implementation, administration, and support

Skills Knowledge and Expertise

Considerable experience in developing data structures using highly scalable database systems

Experience developing, maintaining, and supporting data pipelines and data engineering solutions using Python (preferably PySpark) and SQL.

Experience optimising SQL queries, Python code, and data processing workloads to improve performance, scalability, and reliability.

Experience with Azure and/or AWS and/or GCP

Able to work with large datasets and extrapolate conclusions

Strong analytical and critical thinking abilities

Experience working with stakeholders to gather business requirements and translate them into effective data engineering solutions.

Experience building and maintaining reliable, scalable ETL/ELT solutions on big data platforms and working with a variety of data infrastructure technologies.

Data Engineering experience within the Microsoft technology stack (e.g. Azure Data Factory, Synapse, Databricks, ADLS)

Employee Benefits

As if contributing to and supporting work that makes life better for millions wasn’t rewarding enough, we offer a full range of benefits too. Key benefits that may be available depending on the role include:

Annual performance based bonus, up to 10%

25 days annual leave, plus eight bank holidays

Up to 8% pension contribution

Financial support and time off for study relevant to your role, plus a professional membership subscription

Employee referral scheme (up to £1500), and colleague recognition scheme

Family friendly policies, including enhanced maternity leave and shared parental leave

Free, confidential employee assistance, including financial management, family care, mental health, and on-call GP service

Three paid volunteering days a year

Season ticket loan and cycle to work schemes

Family savings on days out and English Heritage, gym discounts, cash back and discounts at selected retailers

Employee resource groups

About Low Carbon Contracts Company

The Low Carbon Contracts Company (LCCC) exists to help decarbonise the generation of electricity and make it more affordable for the future. Our work is central to the delivery of the Government’s objective to achieve Net Zero target by 2050.

Discover more about LCCC and what it's like to work with us by watching this video:

Please take the time to answer the optional diversity questions

At LCCC, we are powered by curiosity, driven to learn from different perspectives and experiences as we work towards a flexible energy future. We are committed to fostering a diverse and inclusive workplace where everyone can be their authentic selves and feel empowered to own every outcome.

We believe that we are better together – and that diverse teams, reflective of the communities we serve, help us thrive, innovate and deliver greater impact. Your diversity data helps us track how well we're progressing towards our inclusion goals.

Please note that any diversity data you share is completely anonymised and used only in aggregated reports that are not linked to individual candidates.