Regulatory Reporting Data Engineer
Data Engineer
My client is seeking a Data Engineer to join a Regulatory Technology and Controls team. This role focuses on working with high‑volume trading data to improve the accuracy, timeliness, and completeness of regulatory reporting and trade recordkeeping. The ideal candidate is passionate about data engineering and interested in financial services.
The Data Engineer will ingest and transform large volumes of Equity trading data in a cloud environment using Synapse, Spark, and Delta Lake. The role also includes migrating legacy SQL Server tables and T‑SQL procedures into a modern cloud data platform.
The position involves enhancing regulatory reporting pipelines, troubleshooting data quality issues, and collaborating with regulatory, trading, and support teams. The engineer will validate that reporting accurately reflects trading activity and help design dashboards and reconciliations that improve oversight and decision‑making.
This is a hybrid role requiring at least three days per week in the office.
Key Responsibilities:
- Maintain and enhance cloud-based Synapse/Spark data pipelines for regulatory reporting.
- Migrate legacy SQL Server/T‑SQL processes to cloud-based Synapse, PySpark, and Delta Lake.
- Understand Equity trading workflows and how they map to data models.
- Analyze high‑volume datasets using Python, Synapse, and Power BI.
- Implement data reconciliations and support critical production reporting.
- Partner with business teams to develop dashboards and reporting tools.
Profile Requirements
My client is looking for a motivated Data Engineer with experience working with high‑volume data on cloud platforms like Azure, Spark, or Delta Lake. Strong coding skills in languages such as Python, C++, Java, C, or C# are required, along with familiarity with version control, automated testing, and CI/CD.
Experience with SQL Server and T‑SQL is preferred. Knowledge of Equity trading or regulatory reporting is a plus. The role involves close collaboration with other engineers and analysts, so strong communication and teamwork skills are essential.
Basic Qualifications:
- 4+ years of experience with Synapse, Spark, or similar cloud data technologies.
- 4+ years of development experience in a modern programming language (Python, C++, Java, etc.).
- Experience with GitHub or similar tools for version control and CI/CD.
- Strong communication and collaboration skills.
Preferred Qualifications:
- Bachelor's or Master's degree in a STEM field.
- 2+ years of experience with SQL Server, T‑SQL, or SSIS.
- Experience building cloud or Kubernetes-based applications.
- Knowledge of Equity trading or regulatory reporting.
FAQs
Congratulations, we understand that taking the time to apply is a big step. When you apply, your details go directly to the consultant who is sourcing talent. Due to demand, we may not get back to all applicants that have applied. However, we always keep your CV and details on file so when we see similar roles or see skillsets that drive growth in organisations, we will always reach out to discuss opportunities.
Yes. Even if this role isn’t a perfect match, applying allows us to understand your expertise and ambitions, ensuring you're on our radar for the right opportunity when it arises.
We also work in several ways, firstly we advertise our roles available on our site, however, often due to confidentiality we may not post all. We also work with clients who are more focused on skills and understanding what is required to future-proof their business.
That's why we recommend registering your CV so you can be considered for roles that have yet to be created.
Yes, we help with CV and interview preparation. From customised support on how to optimise your CV to interview preparation and compensation negotiations, we advocate for you throughout your next career move.