Data Engineer

UK Tote Group · London, England ·

Full-time
Apply on partner site You apply on the advertiser's own site — nothing is stored here.

Job Title: Data EngineerReference: SW1738295WigDEJob ID: 987263Location: Wigan, Greater Manchester, United KingdomSalary: 60,000 to 75,000Employment: Permanent / Full-timePosted: 2026-11-13Company: UK Tote GroupAre you an experienced Data Engineer who is a self-starter by nature, takes ownership of your work and enjoys designing end-to-end solutions that deliver measurable value?

UK Tote Group are looking for Data Engineers to join the team where you'll play a key role in designing, building, and optimising the Databricks-based Lakehouse that drives real-time data, analytics, and reporting across the Tote.

Our technology powers real-time insights, supports safer gambling, and helps us deliver trusted, customer-first products across the UK and international markets. Data sits at the heart of how we understand our customers and partners, optimise commercial performance and enhance operational processes so this is an essential role in driving business growth and commercial success.

Reporting into the Data Discipline Lead you will build streaming and batch data pipelines on AWS using Apache Spark Structured Streaming, Lakeflow Spark Declarative Pipelines (formerly DLT), and Kafka (MSK), ensuring our business teams have fast, trusted data at their fingertips.

This is a hands-on engineering role where you'll collaborate across engineering and BI, to deliver scalable, secure, and governed data solutions under Unity Catalog. Our BI and Data teams are based in our Wigan Office, where you will be expected to work onsite a minimum of 1 day per week with core business hours Monday to Friday 9am to 5pm.

This role will also form part of our on-call rota, which will be discussed in further detail at interview.

What You'll Be Doing

Designing, building, and optimising streaming and batch pipelines in Databricks Develop robust bronze, silver, and gold delta tables using the Medallion Architecture to serve downstream analytics and APIsImplement and manage integrations from AWS MSK (Kafka), S3, and external APIs into the LakehouseCollaborate with reporting engineers to enable high-performance dashboards through Databricks SQL WarehousesMonitor, tune, and troubleshoot pipeline performance using Databricks metrics, CloudWatch, and AWS Cost ExplorerWhat We Are Looking For: We're looking for experienced Data Engineers with proven expertise in building pipelines in Databricks and a strong grasp of Apache Spark, whether in PySpark, including Structured Streaming.

You should have experience with Kafka (MSK) and real-time data ingestion, as well as a deep understanding of Delta Lake, Declarative Pipelines (DLT) and the Medallion Architecture. A strong AWS background is important, particularly with services such as S3.You'll need to be proficient in Python and SQL for data engineering and analytics, and comfortable implementing CI/CD pipelines using tools such as GitHub Actions, Azure DevOps.

Solid experience with Git, version control, and Spark performance tuning will help you succeed in this role. Most importantly, you'll bring a collaborative, proactive attitude and an ability to balance platform reliability with the pace of delivery.

We are looking for engineers who are analytical, detail-oriented, and motivated by solving complex data challenges. Great communication skills are also essential with the ability to explain data concepts clearly to both technical and non-technical colleagues.

Why Join Us? In return, you'll have the opportunity to work with a modern cloud-based technology stack, tackle complex real-time data challenges, and play a key role in shaping the future of data at Tote. You'll have the autonomy to shape solutions, influence technical direction and solve complex engineering challenges at scale, while working alongside experienced technology and data professionals in a collaborative, agile environment.

Additionally, our company benefits package includes;Competitive Basic SalaryDiscretionary Bonus SchemeCompany Shares Option PlanContributory pension schemeLife insurance (4 x basic salary)Simply Health Cash PlanHoliday entitlement (33 days inclusive of bank holidays)Study Support and opportunity for progression and developmentConfidential 24/7 365 employee assistance helplineAgile and collaborative office environment with free parking, fruit, biscuits, and drinksRegular social events, charity events and volunteering opportunities

Apply on partner site Listing supplied by one of our partner job boards. Last confirmed: 1 day ago.

Report this job

Market data from EasyWorkClub, not from the employer

Typical pay for Data scientist in London: £60,900 – £100,000, from 285 adverts

1983 new adverts for Data scientist in London in the last 30 days

Remote or home office in 45% of 69 Data scientist adverts we list nationwide

UK Tote GroupLondon Apply