Databricks Architect

DCV Technologies · London, England ·

Apply on partner site You apply on the advertiser's own site — nothing is stored here.

Position: Databricks Architect Location: London / Manchester, UK (Hybrid-3 days a week from office) 4 months contract position The Role You will build, secure, automate, and run enterprise Databricks Lakehouse platforms for banking and financial services clients.

The role covers workspace provisioning, infrastructure-as-code, CI/CD, security hardening, and platform operations across multiple environments and regions. Your

responsibilities

Build, configure, and maintain enterprise Databricks Lakehouse platforms across Dev, Test, UAT, and Production environments. Provision and manage Databricks workspaces, compute resources, cluster configurations, and platform-level settings.

Automate infrastructure provisioning and configuration using Terraform / Infrastructure as Code (IaC). Develop and maintain CI/CD pipelines for Databricks platform configurations, notebooks, jobs, and application deployments.

Configure and administer Unity Catalog, including catalogs, schemas, permissions, and access controls. Implement RBAC, service principals, secrets management, and least-privilege access for secure platform operations. Integrate Databricks with cloud services such as AWS or Azure, including storage, networking, identity, and security services.

Configure and maintain cluster policies, job clusters, compute configurations, and environment standards. Monitor platform health, workloads, jobs, and compute resources and troubleshoot production issues. Implement logging, monitoring, alerting, and operational processes to improve platform reliability.

Optimize Databricks workloads and compute configurations for performance and cost efficiency. Automate repetitive platform administration, deployment, and operational activities. Support multi-environment and multi-region deployments, ensuring consistent platform configurations.

Work with Data Engineering, Cloud, DevOps, Security, Governance, and Application teams on platform integration. Maintain technical documentation, deployment standards, operational procedures, and platform configurations.

Support security hardening and governance requirements appropriate for banking and financial-services environments. Your Profile Essential skills/knowledge/experience: Databricks & Lakehouse Strong hands-on experience with: o Databricks Notebooks o PySpark DataFrame API o SQL transformations o Delta Lake o Databricks Jobs, Job Flows, Workflows o Declarative Pipelines (dpx files, pipeline definitions) Experience with Unity Catalog Databricks Autoloader and Structured Streaming Terraform or IaC experience for Databricks configuration (Optional) Experience building both batch and incremental pipelines.

AWS Stack Strong familiarity with: o S3, IAM, KMS o Glue / Lambda Experience migrating workloads from AWS native tools to D...

Apply on partner site Listing supplied by one of our partner job boards. Last confirmed: 1 day ago.

Report this job

Market data from EasyWorkClub, not from the employer

Typical pay for Architect in London: £70,000 – £110,000, from 366 adverts

3054 new adverts for Architect in London in the last 30 days

Same role within 50 km

Remote or home office in 50% of 239 Architect adverts we list nationwide

More openings at DCV Technologies

5 other openings we list

DCV TechnologiesLondon Apply