Senior Data Engineer - Databricks - Financial Services

<p> Senior Data Engineer | Outside IR35 Contract | Databricks <p></p><p></p><p> Are you a senior data engineer who builds pipelines, not just transforms data within them?</p><p></p><p> This is a contract role for someone who wants genuine ownership of a modern data platform - not ticket-taker work, but real engineering: designing pipelines, refactoring architecture, and shaping how a Databricks-first platform evolves in a regulated financial services environment. </p><p></p><p> What you'll be doing </p><p></p><ul><li> Building and refactoring data pipelines in Databricks (this is the core platform — Synapse is out)</li><li> Designing ETL/ELT processes and medallion architecture (bronze → silver → gold)</li><li> Contributing to data warehouse design using dimensional modelling </li><li> Working across the full Azure data stack — ADF, ADLS, and beyond </li><li> Collaborating with analysts and architects to solve real business problems </li><li> Helping build team resilience and engineering capability </li></ul><p></p><p> What the tech stack looks like </p><p></p><ul><li> Databricks (primary — strong experience essential)</li><li> Azure Data Factory </li><li> Azure Data Lake Storage </li><li> PySpark / Spark SQL </li><li> CI/CD with Azure DevOps </li><li> Dimensional modelling / Kimball methodology </li></ul><p></p><p> What you'll need </p><p></p><ul><li> Strong, demonstrable Databricks experience - hands-on, not theoretical </li><li> Proven pipeline development skills - you set up pipelines, you don't just work inside them </li><li> Experience with PySpark / Spark SQL </li><li> Background in medallion architecture and data warehouse design </li><li> Comfortable in an Agile, CI/CD environment </li><li> Financial services experience </li></ul><p></p><p> Why this one is worth a look </p><p></p><p> This isn't a body-shop contract. You'll be joining at a senior level, working on a platform that's actively evolving, with real scope to influence technical decisions. The team is moving away from legacy tooling and leaning into Databricks — so if that's where your strengths are, you'll be in your element from day one. </p><p></p><p> If this sounds like your next move, drop me a message or apply with your CV and day rate expectations. </p><p></p>