Lead Software Engineer

Virtusa · London, England ·

Last confirmed by our partners on 15 Nov 2026.

Apply on partner site You apply on the advertiser's own site — nothing is stored here.

We are seeking an experienced ETL Developer with strong expertise in end-to-end data ingestion and ETL development. The ideal candidate will have hands-on experience building scalable data pipelines, processing structured and semi-structured data, and working with modern data engineering technologies such as Databricks and Apache Flink.

The candidate should be comfortable developing robust ETL solutions using Java and/or Python. Design, develop, and maintain end-to-end ETL and data ingestion pipelines. Develop scalable data processing solutions using Java/Python, Databricks, and Apache Flink.

Integrate data from multiple source systems and transform it into standardized formats. Process structured and semi-structured data efficiently. Optimize ETL jobs for performance, scalability, and reliability. Ensure data quality, validation, and integrity throughout the data pipeline.

Collaborate with cross-functional teams to understand business and technical requirements. Troubleshoot production issues and provide timely resolutions. Follow coding standards, documentation, and best engineering practices.

Strong hands-on experience in end-to-end ETL development and data ingestion. Proficiency in Java or Python programming. Experience designing and developing scalable data pipelines. Hands-on experience with Databricks for data processing, transformation, and optimization.

Strong experience with Apache Flink for stream and batch data processing. Experience working with multiple file formats, including CSV, JSON, XML, Parquet, and Avro. Experience ingesting data from multiple source systems such as databases, APIs, cloud storage, and messaging systems.

Understanding of data transformation, validation, cleansing, and data quality best practices. Strong debugging, troubleshooting, and performance, Experience with Apache Spark or PySpark. Knowledge of cloud platforms such as AWS, Azure, or Google Cloud Platform.

Experience with Kafka or other messaging/streaming platforms. Familiarity with Delta Lake and Lakehouse architecture. Experience with SQL and relational databases. Knowledge of CI/CD pipelines and DevOps practices. Experience with workflow orchestration tools such as Apache Airflow.

Understanding of data governance, security, and monitoring. Experience working in Agile/Scrum development environments. Job SummaryJob number: CREQ266043Profession: OtherExperience: 7-10Years

Apply on partner site Listing supplied by one of our partner job boards. Last confirmed: 4 days ago.

Report this job

Market data from EasyWorkClub, not from the employer

Typical pay for Software developer in London: £55,000 – £105,000, from 740 adverts

3507 new adverts for Software developer in London in the last 30 days

Same role within 50 km

Remote or home office in 42% of 573 Software developer adverts we list nationwide

More openings at Virtusa

14 other openings we list

VirtusaLondon Apply