DataOps Engineer

Purpose of the job

The DataOps Engineer will play a critical role in ensuring the reliability, security and operational excellence of Collinson's modern data platform. As a key member of the Data & Analytics team, you will be responsible for automating platform operations, maintaining cloud infrastructure, supporting CI/CD pipelines and ensuring the platform remains secure, scalable and highly available.

In this hands-on role, you will work closely with Data Engineers, Security, Infrastructure and Product teams to support enterprise-wide data initiatives through automation, observability and platform standardisation.

Key Responsibilities

Manage and maintain Snowflake, Kafka, AWS, MongoDB and supporting data platform infrastructure.

Build and maintain CI/CD pipelines and deployment automation.

Develop and maintain Infrastructure as Code using Terraform.

Manage AWS networking including VPCs, VPC Peering, PrivateLink and secure private networking.

Work with the Central Network team to implement and support enterprise networking solutions.

Support Confluent Kafka platform operations and event-driven data integration patterns.

Perform platform patching, upgrades, and lifecycle management.

Ensure timely remediation of security vulnerabilities and compliance with security standards.

Implement monitoring, alerting and observability using Datadog and platform monitoring tools.

Support production incidents, root cause analysis, and operational improvements.

Maintain platform documentation, operational runbooks, and engineering standards.

Optimize platform performance, reliability, and cloud costs.

Support platform governance, access management, and disaster recovery activities.

Evaluate emerging technologies and recommend improvements to platform engineering practices.

Own operational excellence of the data platform.

Define and improve platform reliability standards.

Drive automation and reduce manual operational effort.

Improve developer experience for data engineering teams.

Develop and maintain operational metrics, SLAs and SLOs to improve platform reliability and availability.

Knowledge, skills and experience required

Mandatory Technical Skills

DataOps & Platform Engineering

AWS fundamentals

Snowflake Administration

MongoDB

Confluent Kafka Platform

Python

SQL

Git

CI/CD pipelines

Infrastructure as Code (Terraform)

Data Observability and Monitoring (Datadog)

Incident Management

Production Support

Security Patching

Vulnerability Management

Performance optimisation

Cost optimisation

AWS Networking

VPC

VPC Peering

AWS PrivateLink

Route 53

Security Groups

IAM

Private networking

Central Network integration

Preferred Skills

AWS Transit Gateway

AWS Direct Connect / VPN concepts

Datadog dashboards and alerting

Airflow

Platform Engineering / SRE practices

Nice to Have

Generative AI fundamentals

LLM integration patterns

AI Agent frameworks

Machine Learning platform awareness

Real-time analytics architectures

Person Specification

Self-motivator with a desire to learn new skills and embrace new technologies in a constantly changing technology landscape

Strong problem-solving and analytical skills.

Passion for automation, reliability and secure platform operations.

Self-motivated with a continuous learning mindset.

Strong stakeholder management and communication skills.

Ability to communicate technical concepts to non-technical audiences.

Collaborative team player who thrives in agile environments.

Quality-focused with strong attention to detail.

Ability to balance business priorities with technical excellence.

Proactive in identifying opportunities for improvement and innovation.

Comfortable working across global teams and multiple business domains.