Job Opportunities API

Permanent contract, Full or Part-Time, Remote or Cologne / Darmstadt / Düsseldorf / Berlin Who we are We are the tech powerhouse behind Kaufland’s international online marketplaces and a company within the Schwarz Group. Driven by a start-up mentality and working on an equal footing within flat hierarchies, we develop the best marketplace solutions for our customers, sellers and partners. #FromEuropeForEurope Day by day, our Tech & Product Team of about 400 experts pursues the goal of creating the best possible customer shopping experience for our online marketplace. Through innovative technical developments, they not only create an outstanding shopping experience but also lay the foundation for an optimal selling experience for our sellers. Learn more about our division, areas, and cross-functional teams here ! Your tasks – this is what awaits you in detail You design, develop and maintain our streaming and CDC backbone (Apache Kafka, Debezium, Schema Registry, BigQuery Sinks) and our self-built workflow management platform Navarch, running on Kubernetes You drive architectural initiatives across the platform end-to-end — from idea to production — spanning streaming, orchestration, the warehouse and the observability layer that sits across them You operate and evolve our BigQuery multi-project setup, shaping access management, partitioning, slot strategy and cost-aware design patterns You shape how the platform supports domain analysts who ship their own pipelines — clear ownership boundaries, quality safeguards, and less hand-off friction between producers and the platform team You build and maintain observability across the data platform (Datadog, Slack-native alerting, cost dashboards) and you take care of our CI/CD pipelines on our self-hosted GitLab instance You shape how we manage BigQuery and Kafka cost at platform scale — FinOps is a live practice on this team, not a one-off You bring a senior perspective into architectural decisions across the platform — design reviews, merge-request reviews, and the multi-quarter initiatives the team runs Your profile – this is what we expect from you You have several years of senior-level data-engineering experience, demonstrated by independent ownership of production systems — running on-call, shipping cross-component changes, and influencing architecture without process scaffolding around you You have strong problem-solving skills with a demonstrated ability to troubleshoot complex, cross-component issues (schema evolution, broker lag, query performance, cost anomalies) You have professional experience in software engineering using Python and you have a working command of SQL on top of cloud data warehouses — partitioning, clustering, query cost, idempotency Strong experience with object-oriented programming and software design patterns, applied to data engineering applications You have hands-on experience with at least four of the following technologies: Message brokers, ideally Apache Kafka (broker operations, schema registry, KRaft) Change data capture, ideally Debezium Orchestration tools (in-house, Airflow, Dagster or similar) Public Cloud Providers, ideally Google Cloud Platform Container orchestration, ideally Kubernetes (Helm, operators, KEDA/VPA) Infrastructure as Code, ideally Terraform and/or Ansible Data modeling and transformation, ideally dbt or comparable You can articulate trade-offs in your past decisions — batch vs. stream, build vs. buy, latency vs. cost, isolation vs. coupling — with concrete numbers from your own work You thrive in a Kanban-style, low-process environment where seniors organise their own work and rotate triage weekly You are fluent in English (C1) and enjoy working in a dynamic, international environment What we offer Create your own work-life balance: You have the flexibility to choose between working remotely (within Germany) or from one of our