Data Engineer

5 per annum + Pension, Bonus, SharesSurrey, England All potential candidates should read through the following details of this job with care before making an application. Permanent Job title: Data EngineerLocation: Surrey (Hybrid working)Type: PermanentSalary: 50,000-75,000Visa sponsorship: Not availableA UK-based technology business building advanced data-driven capability for a government-facing mission.

The team works with real-world sensor and geospatial data at scale, across cloud and edge/on‐prem environments, and is growing due to increased demand and new programmes. The roleWe're hiring a Data Engineer to design, build and run scalable data pipelines and data models that turn multiple complex sources into reliable, accessible datasets for analytics and machine learning.

You'll support batch, streaming and interactive use cases, including modern approaches such as image embeddings and LLM-enabled conversational analytics. You'll work closely with data scientists, analysts, software engineers and platform engineers in an agile (Kanban) environment.

The platform operates across Microsoft Azure plus edge and on‐prem deployments. What you'll doBuild and maintain robust batch + streaming pipelines (ingestion, transformation, orchestration)Monitor and support production data services; investigate data quality, reliability and performance issues through to resolutionDevelop reusable platform components, internal libraries and tooling to improve engineering productivityImplement automated testing, validation checks and integration plans for pipelines and data productsDesign data models and storage patterns supporting analytics, ML features, embeddings and conversational queryingDocument data flows, schemas, operational processes and technical decisionsWhat we're looking for (must-have)Strong Python (clean, maintainable, production-grade data engineering code)Strong SQL and experience designing relational + analytical data modelsExperience with structured/time-series/high-volume storage (e.g., SQL databases, InfluxDB or similar)Experience building batch and event-driven/streaming data pipelines~3+ years' experience in a data engineering / data platform teamFamiliarity with distributed processing (e.g., Spark, Flink, or similar)Orchestration tooling to schedule/monitor/recover pipelinesUnderstanding of event-driven architecture, message brokers and stream-processing patternsHands-on with Azure data services and cloud data platform patternsComfortable building/debugging Docker containersExperience deploying/operating data workloads on Kubernetes (cloud/edge/on‐prem)Experience developing/consuming APIs for ingestion, access and integrationStrong attention to detail; able to prioritise independently; solid communicatorNice to haveDegree in CS / data engineering / maths (or equivalent experience)TileDB (or similar multidimensional/geospatial/scientific data tech)Geospatial + time-series + image/vector search experience (embeddings)Exposure to RAG / LLM conversational analytics or ML data pipelinesExperience designing for intermittently connected edge environmentsBenefits (summary)Bonus schemePrivate healthcare + cash planLife assurance (4x salary)Share options

Report this job