Senior Data Engineer
Skills
About the role
Berlin
ABOUT THE TEAM:
We're a passionate team, consisting of a Head of Data, a Data Engineer, an Analytics Engineer and a Senior Data Analyst dedicated to all things data. You'll be at the centre of our expanding Data team. We're enthusiastic about exploring new tools and technologies, and we thrive on brainstorming to solve challenges and apply best practices. Our team is set to grow soon, welcoming Data Engineers, Analytics Engineers, Analysts, and Data Scientists, all playing a pivotal role in Talon.One's development.
ABOUT THE ROLE:
As a Senior Data Engineer / Data Ops, you will be responsible for all engineering tasks related to the data infrastructure, data ingestion and DWH pipelines. You will own our data ingestion workflows (currently based on a Kafka stream) and will make sure that the data from our PostgresDB instances with a very high amount of data is ingested live into BigQuery. Besides, you will manage our overall data platform infrastructure, recommend improvement and make sure to always follow best practices. Finally, you will also of course be involved in the Data Engineering pipelines, assisting in the modelling of various data sources helping literally all departments within the company making better decisions.
ONCE YOU ARE HERE YOU WILL:
Own the data ingestion streams for all of our client’s DBs, from Postgres to BigQuery
Own the overall data infrastructure: set up, maintain and improve our stack with new technologies for more efficiency and best practices. E.g. improve orchestration
Write DWH pipelines and improve our overall DWH code to apply best practices and bring more efficiency.
Be part of a data team composed of various profiles, be at the center of all infrastructure decisions and work closely with other stakeholders from the R&D department, especially the DevOps team.
WHAT WE NEED YOU TO BRING TO THE TABLE:
3 -5 years of experience in the Data Engineering / Data Ops field, ideally working on some big data warehouse projects.
You are familiar with the modern data stack and are able to recommend, set up and maintain all different kinds of components from Data ingestion to automation.
You have experience with a wide range of tools and technologies within the modern data stack: Kafka, Airflow, Dagster, DBT Core, BigQuery, Lambda functions etc..
You have experience with general infrastructure / DevOps management technologies: ArgoCD, Kubernetes, Docker, Github, Postgres, GCP etc..
You always thrive for applying data engineering best practices: consistency checks, testing data reliability, monitoring on top of ingestion pipelines, no double business logic in the code.
ABOUT TECHNOLOGY:
Kubernetes running on Google Cloud, ArgoCD, Terraform
PostgreSQL
Aiven Kafka Connect, Strimzi, Debezium
DBT cloud, GCP, BigQuery, Fivetran
We use Go for our API, core logic, and internal tooling
Cypress for automated end-to-end testing
Other odds & ends in JavaScript and shell script
WHAT'S IN IT FOR YOU:
A Research and Development Department of 90+ of engineers, product managers and product designers in Berlin
Leaders with 8+ years of experience building our promotions engine
€1,000 annual learning budget, full LinkedIn Learning access, and free German language courses to boost your skills
30 days of annual leave, plus extra paid days for your birthday and moving day
Home office setup budget, a monthly home office allowance
Freedom to work from abroad for up to 90 days worldwide!
Mental health support with nilo.health and a discounted Urban Sports Club membership
20% company subsidy on your pension contributions
Subsidised BVG public transport ticket and a dog-friendly Berlin office where your furry friend is welcome
Lease your ideal bike through BusinessBike
WHY YOU SHOULD WORK FOR US:
The right attitude: modern methods and a diverse, creative workspace with an open and international culture
Everyone for the product: Together we create a flexible, highly scalable product with state-of-the-art technologies. We can only succeed if everyone works as a team
Healthy Growth: Growing our company means growing everyone in the team. We love to share knowledge and learn
A great environment: Flexible and family-friendly environment, bright and easily accessible offices, modern software and hardware
High flexibility degree: Prefer to work early or late at night? Do you have to pick up your children from kindergarten? Do you prefer working abroad? We believe in results and motivated employees
Do you want this job?
We’d love to hear from you! Apply directly via the form.
Questions about this role
Want AI Applyd to auto-apply to roles like this?
We tailor your resume per posting, fill the forms, and track replies for you.