Lead Data Engineer

<p>Job Description</p><br>Apply promptly! A high volume of applicants is expected for the role as detailed below, do not wait to send your CV.<br><ul><li>Gloucester location - hybrid working when possible</li><li>Must hold active Enhanced DV Clearance (West)</li><li>Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus</li><li>Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL, Team Leadership</li></ul><p>Who Are We?</p><p>Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You'll work with cutting-edge technologies, including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth.</p><p>What will the Lead Data Engineer be Doing?</p><p>You will develop mission-critical data solutions for National Security clients, working with cutting-edge technologies such as AI/DS, Cyber, Cloud, DevOps/SRE, and Platform Engineering. You'll collaborate directly with customers across National Security, Defence, and Intelligence to solve complex, high-stakes challenges. The role involves designing and implementing sophisticated data pipelines to connect operational systems with analytics and business intelligence platforms.</p><p>Responsibilities include:</p><ul><li>Design, build, and maintain data pipelines, including ingestion, orchestration, and enrichment</li><li>Develop data-streaming and ETL solutions (e.g. NiFi)</li><li>Model databases and integrate data from diverse sources</li><li>Ensure data quality, consistency, and security</li><li>Monitor and optimise system performance</li><li>Write clean, secure, reusable, test-driven code</li><li>Apply systems integration expertise within agile teams</li><li>Decompose user needs into epics and stories</li><li>Promote reuse of data flows and best practices across teams</li><li>Champion data engineering standards across government</li></ul><p>The Lead Data Engineer Should Have:</p><ul><li>Active eDV clearance (West)</li><li>Willingness to work full-time on-site in Gloucester when required.</li></ul><p>Required experience in the following:</p><ul><li>Apache Kafka</li><li>Apache NiFI</li><li>SQL and NoSQL databases (e.g. MongoDB)</li><li>ETL processing languages such as Groovy, Python or Java</li><li>Understand and interpret technical and business stakeholder needs</li><li>Manage expectations through clear, proactive communication</li><li>Lead and support challenging conversations with teams and senior stakeholders</li></ul><p>To be Considered:</p><p>Please either apply by clicking online or emailing me directly to . For further information please call me on / - I can make myself available outside of normal working hours to suit from 7am until 10pm. If unavailable, please leave a message and either myself or one of my colleagues will respond. By applying for this role, you give express consent for us to process & submit (subject to required skills) your application to our client in conjunction with this vacancy only. xwzovoh Also feel free to follow me on Twitter @SearchableHenry or connect with me on LinkedIn, just search Henry Clay-Davies (searchability). I look forward to hearing from you.</p><p>KEY SKILLS:</p><p>DATA ENGINEER / DATA ENGINEERING / DEFENCE / NATIONAL SECURITY / DATA STRATEGY / DATA PIPELINES / DATA GOVERNANCE / SQL / NOSQL / APACHE / NIFI / KAFKA / ETL / GLOUCESTER / DV / SECURITY CLEARED / DV CLEARANCE</p>