Machine Learning Performance Engineer


New York
Permanent
USD300000 - USD800000
Financial Technology
PR/492313_1767889576
Machine Learning Performance Engineer

What You'll Do

  • Design, build, and optimize high‑performance training and inference pipelines for deep learning workloads.
  • Work deep in the internals of open‑source ML frameworks, improving performance, efficiency, and scalability.
  • Systematically profile, analyze, and remove performance bottlenecks across the full stack-software, hardware, and infrastructure.
  • Collaborate closely with researchers, traders, and engineers to productionize research with strict latency and throughput constraints.
  • Develop a strong understanding of low‑latency trading systems and the performance tradeoffs that underpin them.

What You'll Need

  • Deep knowledge of the internals of modern deep‑learning frameworks such as PyTorch, JAX, TensorFlow, or similar.
  • Strong understanding of computer architecture, memory hierarchies, parallelism, and hardware‑aware optimization.
  • Significant experience writing high‑performance C++ and Python.
  • A rigorous, metrics‑driven approach to performance optimization and debugging.

Nice to Have

  • Experience with the JAX ecosystem, including XLA, Flax, and related tooling.
  • Hands‑on experience optimizing for GPUs or accelerators using CUDA, Triton, Pallas, or similar.
  • Linux systems programming and low‑level debugging experience.
  • Exposure to large‑scale distributed training or inference systems.
  • Contributions to open‑source projects in machine learning, systems, or performance engineering.

FAQs

Congratulations, we understand that taking the time to apply is a big step. When you apply, your details go directly to the consultant who is sourcing talent. Due to demand, we may not get back to all applicants that have applied. However, we always keep your resume and details on file so when we see similar roles or see skillsets that drive growth in organizations, we will always reach out to discuss opportunities.

Yes. Even if this role isn’t a perfect match, applying allows us to understand your expertise and ambitions, ensuring you're on our radar for the right opportunity when it arises.

We also work in several ways, firstly we advertise our roles available on our site, however, often due to confidentiality we may not post all. We also work with clients who are more focused on skills and understanding what is required to future-proof their business. 

That's why we recommend registering your resume so you can be considered for roles that have yet to be created. 

Yes, we help with resume and interview preparation. From customized support on how to optimize your resume to interview preparation and compensation negotiations, we advocate for you throughout your next career move.

Handpicked roles for you