Lead Software Engineer
Virtusa · London, England ·
Last confirmed by our partners on 15 Nov 2026.
We are seeking an experienced ETL Developer with strong expertise in end-to-end data ingestion and ETL development. The ideal candidate will have hands-on experience building scalable data pipelines, processing structured and semi-structured data, and working with modern data engineering technologies such as Databricks and Apache Flink.
The candidate should be comfortable developing robust ETL solutions using Java and/or Python. Design, develop, and maintain end-to-end ETL and data ingestion pipelines. Develop scalable data processing solutions using Java/Python, Databricks, and Apache Flink.
Integrate data from multiple source systems and transform it into standardized formats. Process structured and semi-structured data efficiently. Optimize ETL jobs for performance, scalability, and reliability. Ensure data quality, validation, and integrity throughout the data pipeline.
Collaborate with cross-functional teams to understand business and technical requirements. Troubleshoot production issues and provide timely resolutions. Follow coding standards, documentation, and best engineering practices.
Strong hands-on experience in end-to-end ETL development and data ingestion. Proficiency in Java or Python programming. Experience designing and developing scalable data pipelines. Hands-on experience with Databricks for data processing, transformation, and optimization.
Strong experience with Apache Flink for stream and batch data processing. Experience working with multiple file formats, including CSV, JSON, XML, Parquet, and Avro. Experience ingesting data from multiple source systems such as databases, APIs, cloud storage, and messaging systems.
Understanding of data transformation, validation, cleansing, and data quality best practices. Strong debugging, troubleshooting, and performance, Experience with Apache Spark or PySpark. Knowledge of cloud platforms such as AWS, Azure, or Google Cloud Platform.
Experience with Kafka or other messaging/streaming platforms. Familiarity with Delta Lake and Lakehouse architecture. Experience with SQL and relational databases. Knowledge of CI/CD pipelines and DevOps practices. Experience with workflow orchestration tools such as Apache Airflow.
Understanding of data governance, security, and monitoring. Experience working in Agile/Scrum development environments. Job SummaryJob number: CREQ266043Profession: OtherExperience: 7-10Years
Market data from EasyWorkClub, not from the employer
Typical pay for Software developer in London: £55,000 – £105,000, from 740 adverts
3507 new adverts for Software developer in London in the last 30 days
Same role within 50 km
- Senior Lead Software Engineer - Platform / Network · Westminster Abbey · 1 km
- Sr Lead Software Engineer - Market Risk Technology SRE · Westminster Abbey · 1 km
Remote or home office in 42% of 573 Software developer adverts we list nationwide
More openings at Virtusa
14 other openings we list
- Senior Director · London
- VP Niche Sales Capital Markets & Insurance · London
- Senior Software Engineer · London
- Technical Manager · London
- Software Engineer · London