Job Opportunities API

Senior Data Engineer Lisbon - Hybrid Do you want to help shape software that affects thousands of lives? Who are we? We are ranked as the UK’s #1 construction specific software player and our mission is simple; to provide market leading end-to-end software solutions to the construction and construction like industries across the entire build life cycle. If you are looking to build an exceptional career with an award-winning company you’ve come to the right place. Our teams are based in the UK, Europe, and India, working on products that are used on a global scale. We have a clear and defined road map to deliver over the next 3 years, which is centred around a large-scale digital transformation as well as continuing our growth and expansion. We embrace diversity and equality and want our employees to be comfortable bringing their whole selves to work. We are committed to building a team with a variety of backgrounds, skills and views. Creating a culture of Equality isn’t just the right thing to do, it improves every aspect of our business. Purpose The Senior Data Engineer plays a central role in building Causeway’s next-generation data platform on Databricks, a platform that unifies data from across the Causeway product estate and a wide range of third-party sources into a typed, entity-resolved digital twin that AI agents can reason over. The Senior Data Engineer owns significant slices of the medallion pipeline (bronze to silver to gold), the modelling layer that turns raw Delta tables into typed object and relationship tables, and the serving layer that makes the graph queryable by agents with interactive latency. The role is expected to design for scale, set the bar for engineering quality across the team, and make architectural decisions that are durable. The key areas of responsibility for the Senior Data Engineer include: • Medallion Pipeline & Graph Engineering, • Data Quality & Governance, • Technical Leadership & Collaboration. Key Responsibilities Medallion Pipeline & Graph Engineering • Design and own ingestion into the bronze layer from a variety of sources, selecting the appropriate pattern per source. Including Auto Loader, API pull, event-driven, database replica/CDC, and CQRS read models and agreeing data contracts with Architects and Product teams. • Build and maintain the silver and gold medallion layers as Delta Live Tables and PySpark notebooks, handling deduplication, entity resolution (deterministic and probabilistic), canonical ID assignment, and projection into typed object and relationship tables. • Generate and maintain the typed relationship graph that transforms disconnected gold tables into a traversable digital twin. • Own and evolve the serving layer that makes the graph queryable by AI agents at interactive latency. • Contribute to the design and evolution of the broader Causeway data platform architecture, ensuring solutions are scalable, maintainable, and aligned with cloud-native best practices. Data Quality & Governance • Own the data quality and testing story end-to-end, implementing automated frameworks that validate completeness, accuracy, consistency, and schema conformance across pipeline stages. • Deliver governance via Unity Catalog, covering multi-tenant isolation, row-level security, lineage, audit logging, and the tenant-scoped extension schema that supports custom objects from external customer systems. • Ensure data assets are catalogued correctly with appropriate metadata, security classifications, and sensitivity labels in line with company data governance standards. • Monitor pipeline health and data quality metrics, proactively identifying and resolving issues before they affect downstream consumers or agent behaviour. Technical Leadership & Collaboration • Mentor engineers across the data team, lead architectural discussions, conduct PR reviews