Senior Data Lake Engineer
The client, a top global hedge fund, is seeking a Senior Data Lake Engineer with hands‑on experience building a data lake from scratch. This is a rare opportunity to own the architecture, design, and development of the firm's next‑generation data platform supporting analytics, BI, machine learning, and quant research.
What You'll Do
- Architect and implement a new enterprise data lake using Apache Iceberg + object storage + Snowflake.
- Build and optimize batch + streaming pipelines with Apache Spark; design real‑time ingestion and enrichment.
- Implement data quality, governance, lineage, and security across the entire platform.
- Work with distributed systems including Apache Ignite / Hazelcast for high‑performance compute.
- Develop production‑ready Python and Java code; deploy via CI/CD and infrastructure‑as‑code.
- Collaborate with portfolio managers and quant teams to maximize data usability and performance.
What They're Looking For
- 5+ years' experience in financial services or top‑tier tech.
- Proven experience building and operating a data lake or lakehouse end‑to‑end.
- Expertise with:
- Apache Iceberg / Delta Lake / Hudi
- S3, GCS, or ADLS + Snowflake
- Spark batch/streaming, Flink, or Kafka Streams
- Ignite or Hazelcast
- Python + Java in distributed environments
- Strong understanding of ETL/ELT, schema evolution, partitioning, and data lifecycle management.
- Cloud experience (AWS/GCP/Azure) and familiarity with monitoring, alerting, and incident response.
Why This Role Stands Out
- Build a mission‑critical, firmwide data platform from the ground up.
- High‑visibility engineering role supporting trading, risk, research, and ML workflows.
- Competitive hedge‑fund compensation and long‑term growth opportunities
FAQs
Congratulations, we understand that taking the time to apply is a big step. When you apply, your details go directly to the consultant who is sourcing talent. Due to demand, we may not get back to all applicants that have applied. However, we always keep your CV and details on file so when we see similar roles or see skillsets that drive growth in organisations, we will always reach out to discuss opportunities.
Yes. Even if this role isn’t a perfect match, applying allows us to understand your expertise and ambitions, ensuring you're on our radar for the right opportunity when it arises.
We also work in several ways, firstly we advertise our roles available on our site, however, often due to confidentiality we may not post all. We also work with clients who are more focused on skills and understanding what is required to future-proof their business.
That's why we recommend registering your CV so you can be considered for roles that have yet to be created.
Yes, we help with CV and interview preparation. From customised support on how to optimise your CV to interview preparation and compensation negotiations, we advocate for you throughout your next career move.