Databricks Platform Engineer
What You'll Do
As our markets become increasingly data‑driven and competitive, the ability to ingest, model, and deliver high‑quality data at scale is essential to sustaining our trading advantage. In this role, you'll own a mission‑critical internal platform and play a key part in shaping its standards, reliability, and long‑term direction.
Databricks Platform Engineering
- Design, deploy, and manage Databricks workspaces and environments
- Oversee workspace configuration, cluster policies, access controls, and platform-wide settings
- Define and enforce best practices around reliability, security, and cost governance
- Support and continuously enhance Databricks platform operations
Infrastructure as Code & Automation
- Build and maintain infrastructure using Terraform
- Create repeatable, version-controlled deployment patterns across environments
- Automate operational tasks and platform maintenance using Python and shell scripting
CI/CD & Release Engineering
- Design and maintain CI/CD pipelines for infrastructure and platform configuration
- Implement automated testing, validation, and promotion workflows for configuration changes
- Support Git-based collaboration practices and environment lifecycle management
Systems Engineering
- Troubleshoot platform-level issues and outages
- Manage system configuration, networking components, and access controls
- Improve observability, monitoring, logging, and supporting operational tooling
Security & Reliability
- Implement RBAC, secrets management, and security best practices
- Ensure compliance with internal security and operational standards
- Participate in incident response, root-cause analysis, and reliability improvements
Who You Are
- 2+ years administering Databricks environments
- Strong experience with Terraform and infrastructure-as-code methodologies
- Proficient in Python for automation and internal tooling
- Solid understanding of CI/CD concepts and tools
- Experience with Git and collaborative development workflows
- Comfortable using the Linux command line
- Strong grasp of cloud infrastructure fundamentals (networking, IAM, compute, storage)
- Familiar with monitoring, alerting, and operational best practices
- Experience with AWS infrastructure via Terraform is a plus
- Ideally have experience supporting shared developer platforms, internal tooling, or multi-environment/multi-account setups
- Knowledge of cloud cost optimization and governance is a bonus
FAQs
Congratulations, we understand that taking the time to apply is a big step. When you apply, your details go directly to the consultant who is sourcing talent. Due to demand, we may not get back to all applicants that have applied. However, we always keep your CV and details on file so when we see similar roles or see skillsets that drive growth in organisations, we will always reach out to discuss opportunities.
Yes. Even if this role isn’t a perfect match, applying allows us to understand your expertise and ambitions, ensuring you're on our radar for the right opportunity when it arises.
We also work in several ways, firstly we advertise our roles available on our site, however, often due to confidentiality we may not post all. We also work with clients who are more focused on skills and understanding what is required to future-proof their business.
That's why we recommend registering your CV so you can be considered for roles that have yet to be created.
Yes, we help with CV and interview preparation. From customised support on how to optimise your CV to interview preparation and compensation negotiations, we advocate for you throughout your next career move.