Data Engineer - MI5 - The Security Service - HEO

<p><strong>Location:</strong> London</p> <p><strong>Use data engineering to help keep the UK safe</strong></p> <p>We're looking for <strong>Data Engineers</strong> with hands on experience designing and building data solutions to join multidisciplinary product teams delivering secure, high impact systems at the heart of UK national security.</p> <p><strong>The role</strong></p> <p>As a Data Engineer, you'll sit within a <strong>multidisciplinary product team</strong>, working alongside software engineers, data scientists, product owners, business analysts and delivery managers.</p> <p>You'll design, build and operate <strong>secure data applications and products</strong>, using a mix of modern cloud technologies, on premise platforms and long established systems. You'll follow Agile and DevSecOps principles to deliver reliable solutions that support MI5's critical operations.</p> <p><strong>What you'll be doing</strong></p> <p>In this role, you will:</p> <ul> <li>Design and implement <strong>moderate to complex data pipelines and data flows</strong> </li> <li>Build and manage data integration solutions across multiple sources</li> <li>Support analytics, business intelligence and investigative capabilities</li> <li>Work closely with users to deliver new features and improve existing products</li> <li>Identify and fix defects, creating <strong>automated tests</strong> to maintain assurance</li> <li>Take ownership of complex problems, breaking them down and prioritising delivery</li> <li>Apply modern engineering approaches, including <strong>CI/CD and Agile practices</strong> </li> <li>Share knowledge, mentor colleagues and help define <strong>what good looks like</strong> </li> <li>Contribute to Communities of Practice and cross organisation initiatives</li> </ul> <p><strong>The technology</strong></p> <p>Our tech stacks vary by product and may include:</p> <ul> <li><strong>SQL and NoSQL databases</strong></li> <li>Commercial and bespoke platforms</li> <li>Data processing and integration tools such as AWS Glue, Apache Spark, Airbyte, NiFi, Fivetran or similar</li> <li>Programming languages including <strong>Python, Java, SQL, Scala, PL/SQL or SAS</strong> </li> <li>Data and analytics tools such as Jupyter, Kibana, SAS and AWS services</li> </ul> <p>You'll work with a wide range of <strong>data models and formats</strong>, from structured and unstructured data to geo enabled and graph based models.</p> <p><strong>Who we're looking for</strong></p> <p>You'll be someone who can demonstrate:</p> <ul> <li>Experience delivering <strong>data engineering solutions</strong> within a development team</li> <li>Confidence designing and implementing data integration and processing pipelines</li> <li>Comfort learning and using a wide range of technologies</li> <li>Experience working with <strong>Agile and CI/CD approaches</strong> </li> <li>An understanding of good design patterns and secure engineering practices</li> <li>Strong communication skills with both technical and non technical colleagues</li> <li>A willingness to support and mentor others in an inclusive environment</li> </ul> <p><strong>Interested?</strong></p> <p>Apply via <strong>Civil Service Jobs</strong> to see full details, including the selection process and security requirements.</p><img src="https://www.jobg8.com/Tracking.aspx?tnOcX87vYBsu6fBKMRciuzEDRi8j2Wfep" width="0" height="0" />