Lead Data Engineer
Source Group International · London, England ·
Overview
You will lead the design and delivery of scalable data platforms that enable high-quality analytics and data-driven products. In this role, you’ll set standards for reliability, governance, and engineering excellence while partnering with stakeholders to deliver trusted datasets. You’ll own data modelling and performance optimization, shape data products, and guide a team of engineers. This is a chance to influence data architecture at scale within a cross-functional engineering context.
Responsibilities
- Architect and deliver modern data platforms (lakehouse/warehouse) and ETL/ELT pipelines
- Set engineering standards for code quality, testing, security, and operations
- Own data modelling approaches (dimensional, Data Vault, domain-oriented) and optimize cost/performance
- Implement orchestration, monitoring, alerting; manage SLAs and incident response
- Drive data governance: lineage, catalog, access controls, retention policies, GDPR-aligned practices
- Collaborate with analytics, software and platform teams to deliver reusable data products and APIs
- Mentor engineers, conduct code reviews, and contribute to hiring and capability development
Key requirements
- Significant data engineering experience with leadership of teams or major initiatives
- Expert SQL and strong Python and/or Scala
- Cloud data engineering experience (AWS, Azure or GCP) including object storage and managed services
- Experience with modern data warehousing/lakehouse tools (Snowflake, BigQuery, Redshift, Databricks)
- Hands-on orchestration experience (Airflow, Dagster, Prefect) and CI/CD for data pipelines
- Experience with streaming/event-driven data (Kafka, Kinesis, Pub/Sub) is highly desirable
- Proficiency with infrastructure as code (Terraform, CloudFormation) and containerisation (Docker; Kubernetes beneficial)
- Strong understanding of data quality, testing (unit/integration), and observability
- Excellent stakeholder management and communication skills
- stakeholder management
- communication
- leadership
- SQL
- Python
- Scala
Market data from EasyWorkClub, not from the employer
Typical pay for Data scientist in London: £60,000 – £98,900, from 183 adverts
846 live adverts for Data scientist in London
Same role within 50 km
- Senior Data Scientist · Westminster Abbey · 1 km
- Data Engineering Technical Lead · Westminster Abbey · 1 km
- Data Scientist in City · City of London · 2 km
Remote or home office in 13% of 183 Data scientist adverts we list nationwide
More openings at Source Group International
19 other openings we list
- Senior Platform Engineer | Colchester · London
- Senior Full Stack Developer | C#.NET, React | London · London
- Recruitment Consultant – US GTM · London
- SRE | Permanent | London, Hybrid, AWS · London
- C# Developer · London