Senior Databricks Data Engineer

<p><strong>About ISx4</strong></p><p>ISx4 is a dynamic and innovative team, we harness the power of artificial intelligence and cloud computing to drive real-world impact. We work at the forefront of Analytics and AI technology, leveraging leading cloud platforms to build scalable, intelligent solutions. We provide Insight through Strategy, Solutions, Services & Support (Sx4). Our industry experience help derive competitive advantage for our clients, taking them on the journey from Hindsight, through Insight to Foresight.</p><p><br><br>Increase your chances of an interview by reading the following overview of this role before making an application.<br></p><p>We create, deliver and manage Analytics and AI solutions across all sectors including finance, government, life sciences, private sector and sport. Our services are increasingly in demand as Analytics and AI services become a core competency in every area of the business. ISx4 are formal certified partners with Microsoft, AWS, GCP, SAS, IBM and Databricks and have customers & staff located globally.</p><p><br></p><p>These strategic partnerships allow us to remain vendor-neutral and focused on our core competency area of analytics services delivery. ISx4 have an ambitious hiring plan for the next few years with new hires at all levels to support the strategic growth of the firm.</p><p><br></p><p><strong>The Role</strong></p><p>We are seeking a <strong>Senior Databricks Data Engineer</strong> to lead delivery of data engineering workstreams within large-scale data platform and migration programmes.</p><p><br></p><p>This role combines <strong>hands-on technical expertise with consulting leadership</strong>, ensuring the successful design, delivery and operation of modern data platforms while working closely with client stakeholders.</p><p><br></p><p>You will play a key role in shaping architecture decisions, mentoring engineers and driving delivery across complex engagements.</p><p><br></p><p><strong>What You’ll Do</strong></p><ul><li>Lead design and implementation of <strong>enterprise-scale data pipelines and lakehouse architectures</strong></li><li>Provide technical leadership across <strong>Databricks, Spark and cloud data platforms</strong></li><li>Drive delivery of <strong>data engineering workstreams within Agile programmes</strong></li><li>Engage with client stakeholders to translate business objectives into technical solutions</li><li>Mentor engineers and establish engineering best practices</li><li>Lead architecture and design discussions with architects and platform teams</li><li>Oversee performance optimisation and platform reliability</li><li>Support <strong>data migration strategy and execution</strong></li><li>Ensure governance, security and compliance standards are met</li><li>Produce architecture documentation, design artefacts and delivery roadmaps</li></ul><p><br></p><p><strong>Must-Have Requirements</strong></p><ul><li>7+ years experience in <strong>data engineering or data platform development</strong></li><li>Strong experience with <strong>Databricks, Spark and distributed data processing</strong></li><li>Experience with <strong>Unity Catalog, Delta Lake and xwzovoh streaming architectures</strong></li><li>Advanced <strong>Python </strong>and <strong>Microsoft SQL Server</strong> development</li><li>Experience designing <strong>enterprise data architectures</strong></li><li>Proven experience leading engineering teams or workstreams</li><li>Strong stakeholder engagement and consulting skills</li><li>Working knowledge of <strong>Hadoop</strong></li><li>Experience with <strong>test-driven development </strong>and <strong>CI/CD</strong></li><li><strong>REST APIs </strong>and <strong>Kafka </strong>experience</li></ul><p><br></p><p><strong>Nice to Have</strong></p><ul><li>Experience leading <strong>data platform migrations</strong></li><li>Cloud architecture expertise (AWS preferred)</li><li>Experience managing delivery in <strong>large transformation programmes</strong></li><li>Experience delivering projects in <strong>regulated environments</strong></li></ul><p><br></p><p>Please note, this role is hybrid and will require 3 days on site per week in Belfast city centre.</p>