Data Engineer (f/m/d)

Deine Aufgaben

The Role

We are looking for a driven and motivated Data Engineer who wants to help us build the streaming data lakehouse of Germanys governments. At DKSR, we are building an urban data hub for cities and regions; helping them use their data more efficiently for the benefit of all. We currently operate our core product CIVORA for over 20 cities and regions, and we still have plenty of improvements and new developments in store.

You will join the product development team to get hands-on with building and operating the data infrastructure that powers CIVORA. Working hand in hand with our Data Architect, you will bring concepts and blueprints into production-ready systems. You will also get the chance to support us on cutting-edge use cases; paving the path for the project delivery team and our most advanced users.

Please note: We are currently only considering candidates who already reside in Germany and are legally authorized to work in Germany. Unfortunately, we cannot provide visa sponsorship or relocation support for this position.

What You'll Do

Contribute to the continued development of the data infrastructure that powers CIVORA - from platform components to internal tooling

Collaborate with product and project delivery teams to shape a reusable, scalable and well-documented data infrastructure

Design and maintain data pipelines (batch & streaming) that serve multiple cities and use cases

Support the project delivery team on the most complex and mission-critical use cases - setting a track record of best practices and design patterns for all to learn from

Write clean, maintainable code – you are as much a software engineer as a data engineer

Propose and prototype new approaches; challenge existing patterns when you see a better way – you will be able to take ownership

Dein Profil

What You Bring

Must have:

1–3 years of relevant experience in data engineering and software development

B.Sc. in Computer Science, Data Science, Data Engineering, or related field (M.Sc. preferred; equivalent professional experience also works)

Python – data processing (pandas, NumPy, scikit-learn) as well as structured software development (modular design, clean APIs, testable code)

SQL – understanding of relational database design and confident querying

Pipeline orchestration – hands-on experience with Apache Airflow or similar

Streaming systems – familiarity with the Kafka protocol or similar

Docker – containerization as part of your daily workflow

Cloud & IaC – working knowledge of cloud concepts and infrastructure-as-code principles (Helm, Terraform)

English – comfortable in both spoken and written communication

Communication – proactive team player and direct communicator

Experience with agentic development (GitHub, CoPilot or Claude is enough, no need for crazy sub-agent workflows)

Nice to have:

Kubernetes – experience with container orchestration and cluster operations

Cloud platforms – hands-on with AWS, Azure, or GCP

Additional languages – able to read and poke Java, JavaScript, Rust, or Go alongside Python

Experience with parts of our stack – willingness to learn, understand, and operate matters more than ticking every box:

Infra & deployment: Helm, OpenTofu (Terraform), MinIO/SeaweedFS

Data & analytics: Apache Superset, Apache Iceberg (Lakekeeper catalog), Redpanda (Redpanda Connect, Kafka Connect), Trino, MLFlow

German – not required, but highly valuable for external stakeholder communication

Who You Are

You don't just want to write code – you want to understand the business problem, refine the requirements, design the system and you want it to matter. You're the kind of person who'll dig into a problem, propose a solution, and then actually build it and deliver it end-to-end. You're comfortable working closely with a data architect without needing hand-holding on every step. When something's unclear, you ask. When something's wrong, you say so. When you disagree, you say no. You care about doing things well, but you also know when good enough ships and perfect doesn't.

Warum wir?

What We Offer

Genuine appreciation and plenty of trust

Job Ticket or Job Bike – for a sustainable commute

Professional development budget – you grow, we invest

30 days of vacation, plus time off on December 24th and December 31st

Corporate Benefits

Subsidy for Urban Sports Club

Open feedback culture – honest, respectful, and on equal footing

A team full of bright minds – with genuine team spirit instead of ego trips

Support when you need it – and space when you want it

Über uns

Wir sind ein Team aus Expertinnen für Stadtentwicklung, Stadtplanung, Nachhaltigkeit und für Daten. Uns eint eine klare Vision: Ökologisch wertvolle, sozial gerechte und wirtschaftlich attraktive Städte und Regionen, die ihre komplexen Herausforderungen zielsicher meistern, weil sie alle Informationen haben, die sie dazu brauchen.

Gemeinsam zum Ziel

Für gute Lösungen

Nachhaltige Entwicklung gelingt in unseren Augen nur, wenn viele gute Lösungen zusammenkommen. Deshalb ist Kooperation und Gemeinschaft eine wichtige Basis unserer Arbeit. Wir arbeiten eng mit unseren Kundinnen, Partnerinnen und als Team zusammen, um gemeinsam zukunftsfähige Lösungen zu realisieren. Auch unsere Datentechnologien sollen Kooperation ermöglichen, weshalb wir sie weitestmöglich als Open Source Lösungen entwickeln. Als Praxispartner von Fraunhofer und durch unsere enge Zusammenarbeit mit Expertinnen urbaner Domänen, wie Klima, Energie, Mobilität und Gesundheitsversorgung, wollen wir die Grundlage dafür schaffen, dass Städte und Regionen ihren Weg zur Smart City zielsicher gehen können.