Databricks Engineer
Gazelle Global Consulting · London, England ·
We're looking for an experienced Databricks Engineer to join an exciting banking and financial services programme, building and managing enterprise-scale Lakehouse platforms. You'll play a key role in developing secure, scalable and reliable Databricks environments, supporting data engineering teams across multiple environments and cloud platforms.
This is a hands-on opportunity involving platform configuration, automation, deployment and performance optimisation.
Key Responsibilities
Build and maintain Databricks Lakehouse platforms across development, testing and production environments. Develop data pipelines using PySpark, SQL and Delta Lake. Configure Unity Catalog, permissions, access controls and security policies.
Implement CI/CD pipelines and automate platform deployments. Manage Databricks Jobs, Workflows and Declarative Pipelines. Integrate Databricks with AWS services and cloud infrastructure. Support batch and incremental data processing. Optimise platform performance, monitoring and operational reliability. Key
Skills
Strong hands-on experience with Databricks and PySpark. Excellent knowledge of Delta Lake and Lakehouse architecture. Experience with Unity Catalog, Autoloader and Structured Streaming. Knowledge of AWS S3, IAM, KMS, Glue and Lambda.
Experience with Git, CI/CD and data pipeline development. Location: London / Manchester - Hybrid, 3 days onsite. For more information or to apply directly, please email I review applications daily and will contact shortlisted candidates as quickly as possible. AMRT1_UKTJ ...
Market data from EasyWorkClub, not from the employer
More openings at Gazelle Global Consulting
1 other openings we list
- MarTech Tech Lead · East Kilbride