Data Engineer Databricks

remote Milan Rome

intermediate

data governance

Description of activities:

We are seeking mid-level Data Engineers to strengthen our Data & Analytics team.

These candidates will be involved in designing, building, and optimizing data pipelines on the Azure platform, with a particular focus on Databricks and expertise in Azure Synapse Analytics.

Ideal candidates have experience transforming business needs into scalable and reliable data engineering solutions.

Responsibility:

Design, develop, and maintain data ingestion, transformation, and orchestration pipelines on Databricks and Azure Synapse Analytics

Manage complex ELT/ETL processes, ensuring quality, reliability, and performance.

Develop code in Python / PySpark / SQL for highly scalable data processing

Implement optimized data models (Delta Lake, Parquet, medallion architecture)

Collaborate with data analysts, data scientists, and project stakeholders to define requirements and solutions.

Monitor pipelines through logging, alerting, and performance tuning systems.

Ensure security, compliance, and data governance throughout the data lifecycle.

Support the evolution of data architecture by contributing to best practices and technical standards.

Technical Skills:

Excellent knowledge of Databricks (PySpark, notebooks, job clusters, Delta Lake).

Experience with Azure Synapse Analytics (Dedicated / Serverless SQL Pools, pipelines).

Excellent skills in Python, PySpark and SQL.

Knowledge of Azure services:

or Azure Data Lake Storage (ADLS Gen2)

or Azure Data Factory / Synapse Pipelines

or Azure Key Vault

or Azure Monitor / Log Analytics

Familiarity with lakehouse architecture concepts, data modeling, and columnar formats.

Experience with Git, DevOps and CI/CD processes

Additional skills appreciated:

o Familiarity with cloud environments (AWS, Azure, or GCP).

o Knowledge of Databricks Unity Catalog.

o Knowledge of PowerBI or BI tools.

or Azure Certifications (DP-203 or similar).

Soft Skills:

Excellent analytical skills and attention to detail.

Ability to work in a team and manage projects independently.

Problem-solving orientation and proactivity.

Excellent communication and interpersonal skills.

Project data:

MUST HAVE: Proven experience with Databricks and knowledge of Azure Synapse Analytics

NICE TO HAVE: Experience with PowerBI or other similar tools.

Project in Milan or Genoa, at least once a week.

Academic background:

Graduated

Master's Degree in Computer Science or Mathematics or Physics

– Language skills : Italian and English, minimum level B1/B2

Certifications and specializations: (master's degrees, courses, etc.)

Nice to HAVE: Certificazione Databricks.

Ibrido/Cliente

NOTE: Necessaria presenza da cliente 1 volta a settimana (Milano o Genova)

Note Aggiuntive: (automunito, patente, disponibilità a trasferte con indicazione del raggio di spostamento)

Disponibilità a trasferta nel territorio nazionale

Cosa Offriamo: (RAL, pacchetto retributivo, benefit/flexible benefit)

RAL: 36k-40k (in relazione alle competenze dimostrate)

Informazioni sul Contesto Interno:

K2 DataSyn è specializzata in soluzioni di data management e data governance, utilizzando tecnologie leader di mercato. Si tratta di un ambiente giovane, dinamico e fortemente collaborativo, che promuove l’innovazione e la crescita professionale dei propri membri. I servizi offerti spaziano dalla consulenza tecnica e tecnologica, alla formazione tecnica rivolta ai clienti finali, fino alla consulenza strategica e funzionale in progetti di data governance e data management. Il ruolo offre l’opportunità di ampliare le proprie competenze tecniche su altre tecnologie di data management, data governance e piattaforme cloud come Google e AWS, favorendo quindi un percorso di crescita continua e approfondimento specialistico.