Lead Data Architect
Company Summary
Optiver is seeking a Lead Data Architect to join its Chicago office and play a critical role in advancing the firm's data enablement and research capabilities. As a global market maker operating across 100+ exchanges, Optiver combines cutting-edge technology with world-class talent to improve market liquidity, pricing, and transparency.
In this Lead Data Architect position, you will sit at the intersection of data engineering, quant research, and trading-owning the architecture and evolution of high-performance data systems that directly power real-time decision-making.
Responsibilities:
- Architect, build, and maintain scalable ETL/ELT pipelines using PySpark, Databricks, and Delta Lake
- Transform research workflows into production-grade data systems optimized for performance and reliability
- Develop and optimize streaming and batch data pipelines (Structured Streaming, Kafka)
- Define and enforce data engineering best practices and standards across teams
- Collaborate closely with quant researchers, traders, and global engineering teams
- Create reusable frameworks, templates, and onboarding pathways for data users
- Mentor engineers and drive a culture of DataOps excellence and continuous improvement
- 5+ years of experience in data engineering or data platform roles
Advanced skills in
Python (PySpark), Apache Spark & Databricks- ETL/ELT pipeline development at scale
Strong understanding of s
treaming technologies (Kafka, Spark Streaming), cloud data architectures (preferably AWS) & Delta Lake / Lakehouse design- Experience with distributed systems and performance optimization
- Proven ability to own and deliver complex projects independently
- Strong communication skills with experience partnering across technical teams
- Experience with C++ or Rust
- Exposure to MLOps / MLflow
- Background in high-performance environments (trading firms, advanced data platforms, or similar)
- Competitive compensation structure including base salary and performance-based bonus
- 401(k) match up to 50%
- Comprehensive health, dental, vision, and mental health coverage
- 25 days of paid vacation + market holidays
- Daily meals, snacks, and a highly collaborative office environment
- Regular social events, clubs, and sports leagues
- Opportunity to work with top talent across Chicago, Amsterdam, and Sydney
Apply now or reach out.
FAQs
Congratulations, we understand that taking the time to apply is a big step. When you apply, your details go directly to the consultant who is sourcing talent. Due to demand, we may not get back to all applicants that have applied. However, we always keep your resume and details on file so when we see similar roles or see skillsets that drive growth in organizations, we will always reach out to discuss opportunities.
Yes. Even if this role isn’t a perfect match, applying allows us to understand your expertise and ambitions, ensuring you're on our radar for the right opportunity when it arises.
We also work in several ways, firstly we advertise our roles available on our site, however, often due to confidentiality we may not post all. We also work with clients who are more focused on skills and understanding what is required to future-proof their business.
That's why we recommend registering your resume so you can be considered for roles that have yet to be created.
Yes, we help with resume and interview preparation. From customized support on how to optimize your resume to interview preparation and compensation negotiations, we advocate for you throughout your next career move.