Senior Databricks Engineer (Contract, £550-600 p/d)

<p>Layke is working with a new client on a contract requirement for a <strong>Senior Data Engineer</strong> to support the next stage of a major data platform build.</p><p><br><br>Make sure to apply quickly in order to maximise your chances of being considered for an interview Read the complete job description below.<br></p><p>We are looking for a hands-on <strong>Senior Data Engineer</strong> to support the continued development of an enterprise data and analytics platform built on <strong>Azure Databricks</strong> and Lakehouse architecture. The core Databricks architecture has already been established and initial data domains have been imported. This role is focused on <strong>engineering delivery, pipeline build, data quality, governance, and platform enhancement</strong>, rather than designing the architecture from scratch.</p><p><br></p><p>Key Responsibilities</p><ul><li>Build and maintain data pipelines within <strong>Azure Databricks</strong> and Azure Lakehouse environments.</li><li>Work within established <strong>medallion architecture</strong> patterns.</li><li>Develop data flows using <strong>Azure Data Factory</strong>, Python/PySpark, SQL, and Azure data services.</li><li>Support data modelling, data integration, and data product development.</li><li>Implement data quality, validation, lineage, and integrity controls.</li><li>Work with business and technology stakeholders to document requirements and deliver technical solutions.</li><li>Support reporting and analytics outputs, including Power BI where required.</li><li>Work within CI/CD environments using Git.</li><li>Ensure data governance, security, and regulatory requirements are reflected in platform delivery.</li></ul><p><br></p><p>Required Experience</p><ul><li>5+ years’ enterprise data engineering experience.</li><li>Strong hands-on experience with <strong>Azure Databricks</strong>.</li><li>Experience with lakehouse platforms and medallion architecture.</li><li>Strong Azure Data Factory, Azure Data Lake, Python/PySpark, SQL, MS SQL/Azure SQL experience.</li><li>Good understanding of data modelling, ETL/ELT, data quality, governance, and lineage.</li><li>Experience working in financial services or another regulated environment.</li></ul><p><br></p><p>Desirable Experience</p><ul><li>Wealth management, investment management, pensions, banking, or insurance experience.</li><li>Experience on data integration, migration, or acquisition-related programmes.</li><li>Power BI exposure. xwzovoh </li><li>Unity Catalog or Databricks governance experience.</li></ul><p><br></p><p>Contract details</p><ul><li><strong>Role:</strong> Senior Data Engineer</li><li><strong>Contract:</strong> Initial contract engagement</li><li><strong>Location:</strong> UK remote with occasional Midlands presence possible</li><li><strong>Rate:</strong> £550-600 per day</li><li><strong>Start:</strong> within 4 weeks</li></ul>