Data Engineer
Selby Jennings has partnered with a long-tenured and leading Boston-based energy trading firm on a search for a new Data Engineer.
Key Responsibilities:
- Design, build, and maintain scalable and secure RESTful APIs using FastAPI and Python.
- Develop and optimize data pipelines and ETL processes to ingest, transform, and load data into Snowflake.
- Integrate and manage data workflows on Microsoft Azure, leveraging services like Azure Data Factory, Azure Functions, and Azure Storage.
- Collaborate with cross-functional teams to understand data requirements and deliver high-quality solutions.
- Monitor and troubleshoot data pipelines and APIs to ensure high availability and performance.
- Implement best practices for API security, versioning, and documentation.
- Participate in code reviews, testing, and deployment processes.
Required Qualifications:
- 3-4 years of professional experience in data engineering or backend development.
- Strong proficiency in Python, with experience building APIs using FastAPI or similar frameworks.
- Hands-on experience with Snowflake for data warehousing and SQL-based data transformations.
- Solid understanding of Azure cloud services, especially those related to data engineering.
- Experience with CI/CD pipelines and version control systems (e.g., Git).
- Familiarity with data modeling, data governance, and API security best practices.
Preferred Qualifications:
- Experience with containerization tools like Docker and orchestration platforms like Kubernetes.
- Knowledge of data serialization formats such as JSON, Parquet, or Avro.
- Exposure to monitoring tools and logging frameworks (e.g., Prometheus, Grafana, ELK Stack).
- Understanding of Agile methodologies and DevOps practices.
FAQs
Congratulations, we understand that taking the time to apply is a big step. When you apply, your details go directly to the consultant who is sourcing talent. Due to demand, we may not get back to all applicants that have applied. However, we always keep your resume and details on file so when we see similar roles or see skillsets that drive growth in organizations, we will always reach out to discuss opportunities.
Yes. Even if this role isn’t a perfect match, applying allows us to understand your expertise and ambitions, ensuring you're on our radar for the right opportunity when it arises.
We also work in several ways, firstly we advertise our roles available on our site, however, often due to confidentiality we may not post all. We also work with clients who are more focused on skills and understanding what is required to future-proof their business.
That's why we recommend registering your resume so you can be considered for roles that have yet to be created.
Yes, we help with resume and interview preparation. From customized support on how to optimize your resume to interview preparation and compensation negotiations, we advocate for you throughout your next career move.