Lead Data Engineer
Responsibilities
- Lead the development of cloud-based data platforms, pipelines, and data products leveraging Python, SQL, Snowflake, and AWS.
- Build scalable solutions for a variety of data sources, including market, alternative, and enterprise datasets.
- Enhance the firm's data platform through APIs, automation, metadata management, and emerging AI-driven capabilities.
- Improve data reliability through quality controls, monitoring, testing, and operational best practices.
- Troubleshoot complex data issues and implement long-term solutions to improve platform stability.
- Design efficient data models and datasets that support analytics, reporting, and quantitative research.
- Collaborate with investment, research, and technology teams to deliver scalable data solutions.
- Provide technical leadership through architecture guidance, code reviews, mentorship, and engineering best practices.
- Drive projects from design through production while influencing the future direction of the data platform.
- Opportunity to mentor and potentially lead a growing team of engineers.
Qualifications
- Experience building and supporting enterprise-scale data platforms and pipelines.
- Strong programming skills in Python and SQL.
- Expertise with Snowflake or a similar modern cloud data warehouse.
- Hands-on experience designing and deploying solutions within AWS.
- Experience with workflow orchestration tools such as Airflow.
- Knowledge of relational and NoSQL database technologies.
- Strong understanding of data modeling, data architecture, and large-scale data processing.
- Proven ability to lead technical initiatives and deliver complex projects.
Preferred Qualifications
- Experience with Go or other backend development languages.
- Background in platform engineering or service-oriented architectures.
- Exposure to AI/LLM-powered data solutions and automation.
- Experience within financial services, investment management, trading, or market data environments.
- Track record of building highly reliable and scalable data systems.
FAQs
Congratulations, we understand that taking the time to apply is a big step. When you apply, your details go directly to the consultant who is sourcing talent. Due to demand, we may not get back to all applicants that have applied. However, we always keep your CV and details on file so when we see similar roles or see skillsets that drive growth in organisations, we will always reach out to discuss opportunities.
Yes. Even if this role isn’t a perfect match, applying allows us to understand your expertise and ambitions, ensuring you're on our radar for the right opportunity when it arises.
We also work in several ways, firstly we advertise our roles available on our site, however, often due to confidentiality we may not post all. We also work with clients who are more focused on skills and understanding what is required to future-proof their business.
That's why we recommend registering your CV so you can be considered for roles that have yet to be created.
Yes, we help with CV and interview preparation. From customised support on how to optimise your CV to interview preparation and compensation negotiations, we advocate for you throughout your next career move.