Databricks Manager

As a Databricks Manager, you will lead the data engineering, architecture and data science teams building and scaling the enterprise data platform for a leading company in the energy sector. Bridge technical delivery and business strategy in a fully remote leadership role.

STRATEGIC DATA PLATFORM

TEAM LEADERSHIP

FULLY REMOTE

LEARNING & GROWTH

Don't tick every box? If you meet around 70% of the requirements above, we'd still encourage you to apply.

ABOUT THE ROLE

We are seeking an experienced Data Manager to lead our data engineering, architecture and data science teams in building and scaling the enterprise data platform on Databricks for a leading energy sector company. In this role, you will oversee the end-to-end lifecycle of our data products, from ingestion and storage to analytics and AI enablement. You will manage a portfolio of cross-functional data projects, ensure strict data governance and quality standards, and drive the adoption of scalable architectures (such as the Medallion architecture) to deliver high-value business insights.

KEY RESPONSIBILITIES

Platform Strategy & Architecture

Lead the design, implementation and optimization of the enterprise data platform using Databricks, Delta Lake and Apache Iceberg.

Architect and maintain a scalable Medallion data architecture (Bronze, Silver, Gold layers) to ensure data is clean, reliable and optimized for downstream consumption by BI tools and AI models.

Guide the migration or integration of legacy data warehouses (e.g., AWS Redshift, Snowflake) into a unified Databricks Lakehouse ecosystem.

Team & Portfolio Leadership

Manage, mentor and scale a high-performing team of data engineers, data scientists and analysts.

Oversee a diverse portfolio of concurrent data and AI projects, ensuring delivery on time, within scope and aligned with business objectives.

Act as the bridge between technical teams and executive stakeholders, translating complex data initiatives into clear business value.

Data Governance & Quality

Implement and enforce robust data governance, security and access controls using Databricks Unity Catalog.

Establish enterprise-wide data quality frameworks and Master Data Management (MDM) practices to ensure a single source of truth across the organization.

Ensure compliance with regional data privacy regulations (e.g., GDPR) within highly regulated enterprise environments.

Advanced Analytics & AI Enablement

Provide the foundational data layer required for advanced machine learning, Generative AI applications and autonomous agent frameworks.

Collaborate with AI engineering leads to implement AI observability and monitor model performance in production.

Drive the rapid prototyping of data products and internal tools using frameworks like Python and Streamlit.

REQUIRED SKILLS & EXPERIENCE

8+ years of experience in data engineering, data architecture or data science, with at least 3+ years in a managerial or leadership role overseeing technical teams.

Deep, hands-on understanding of the Databricks Data Intelligence Platform, Spark and Delta Lake.

Strong proficiency in SQL and Python.

Proven experience designing semantic layers and optimizing data pipelines for business intelligence (e.g., Power BI, Tableau).

Extensive experience with data governance frameworks, MDM and implementing granular access controls (Unity Catalog).

Track record of successfully managing complex, multi-stakeholder data projects in Agile environments.

NICE TO HAVE

Experience integrating Databricks with major cloud service providers (AWS, Azure or GCP).

Familiarity with large language models (LLMs), Agentic AI architectures and deploying GenAI solutions in corporate settings.

Previous experience migrating enterprise data workloads from traditional data warehouses to a Lakehouse architecture.

EDUCATION

Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology or a related field.

PREFERRED CERTIFICATIONS

Databricks Certified Data Engineer Professional.

PMP or Certified Scrum Master (CSM), a plus for the leadership component.

WORKING MODEL

Fully remote position.

ABOUT COGNIZANT

Cognizant (Nasdaq-100: CTSH) engineers modern businesses. We help our clients modernize technology, reimagine processes and transform experiences so they can stay ahead in our fast-changing world. This position supports a leading company in the energy sector; for confidentiality reasons the client's name is not disclosed at this stage of the process.