Senior Data Engineer - Databricks

Essential Technical Skills

Databricks Platform: Proven hands-on experience with Databricks platform including workspace administration, cluster management, and workflow orchestration

Unity Catalog: Demonstrated experience implementing Unity Catalog for unified governance, including metastore configuration, catalog/schema design, and access control policies

Data Modelling: Strong expertise in designing and implementing data models, including dimensional modeling, data vault, and lakehouse architectures

Delta Lake: Deep understanding of Delta Lake features including ACID transactions, time travel, and optimization techniques

Apache Spark: Proficiency in Spark SQL, DataFrames, and performance tuning

Programming: Strong skills in Python, SQL, and/or Scala for data processing

Cloud Platforms: Experience with Azure, AWS, or GCP cloud services

Additional Technical Skills

Data pipeline development and ETL/ELT processes

Data governance frameworks and metadata management

Performance optimization and troubleshooting

CI/CD practices for data platforms

Data quality and validation frameworks

Understanding of data security and compliance requirements

Professional Experience

Minimum 8-10 years in data architecture, engineering, or analytics roles

At least 3-5 years of hands-on experience with Databricks platform

Databricks Certified Associate Developer for Apache Spark (mandatory) Proven track record implementing Unity Catalog in enterprise environments

Experience designing and implementing complex data models for large-scale systems

Background working with Databricks Professional Services or similar partnerships preferred

Experience across multiple industry sectors (Public Service, Financial Services, Healthcare, etc.) is advantageous

Certifications (Preferred) - mandatory to have at least one certification

Data Engineer Professional

Cloud platform certifications (Azure Data Engineer, AWS Data Analytics, or GCP Data Engineer)

Relevant data management or analytics certifications

Soft Skills

Excellent communication and presentation abilities

Strong analytical and problem-solving capabilities

Ability to work collaboratively with Partners and cross-functional teams

Client-focused mindset with relationship-building skills

Self-motivated with ability to manage multiple priorities

Experience working in agile environments

Priority for candidates in Singapore

About CLPS RiDiK

RiDiK is a global technology solutions provider and a subsidiary of CLPS Incorporation (NASDAQ: CLPS), delivering cutting-edge end-to-end services across banking, wealth management, and e-commerce. With deep expertise in AI, cloud, big data, and blockchain, we support clients across Asia, North America, and the Middle East in driving digital transformation and achieving sustainable growth. Operating from regional hubs in 10 countries and backed by a global delivery network, we combine local insight with technical excellence to deliver real, measurable impact. Join RiDiK and be part of an innovative, fast-growing team shaping the future of technology across industries.

Job Type: Contract

Pay: $8,000.00 - $10,300.00 per month

Work Location: In person