Data Engineer
We are looking for an experienced Data Engineer to join a high-performing technology team in Chicago. This individual will play a key role in designing and supporting scalable data platforms that power critical business operations and analytics. The ideal candidate thrives in a fast-paced, data-intensive environment and enjoys solving complex engineering challenges at scale.
Responsibilities
- Design, implement, and maintain large-scale data infrastructure and distributed data platforms.
- Develop and support real-time and batch data processing systems using modern streaming and big data technologies.
- Build robust data pipelines and workflows to efficiently ingest, transform, and deliver data across the organization.
- Partner with software engineers, platform teams, and business stakeholders to define data models, optimize data flows, and support long-term capacity planning.
- Ensure the reliability, quality, and availability of enterprise data assets.
- Provide technical guidance and subject matter expertise on data architecture, data engineering best practices, and platform capabilities.
- Monitor and troubleshoot data systems, driving root cause analysis and continuous improvement efforts.
Qualifications
- 5+ years of experience designing and supporting data engineering solutions in large-scale production environments.
- Experience building and supporting streaming data platforms, including technologies such as Kafka or similar messaging systems.
- Hands-on experience working with modern data lake, cloud storage, or distributed data platforms such as S3, HDFS, Databricks, Iceberg, or related technologies.
- Strong experience developing data applications using frameworks such as Spark, Flink, or comparable distributed processing technologies.
- Proficiency in Java, Python, and SQL.
- Experience leveraging Python-based analytics, data science, or machine learning libraries.
- Strong understanding of containerization and orchestration technologies, including Docker and Kubernetes.
- Experience with observability, monitoring, and alerting tools in distributed environments.
- Strong analytical and problem-solving skills, with the ability to investigate and resolve complex production issues.
- Experience working in Linux/Unix environments and developing automation through scripting languages such as Python and Bash.
Preferred Background
- Experience supporting real-time, high-throughput data ecosystems.
- Familiarity with data governance, data quality, and operational excellence practices.
- Ability to collaborate effectively across engineering, platform, and business teams in a highly technical environment.
FAQs
Congratulations, we understand that taking the time to apply is a big step. When you apply, your details go directly to the consultant who is sourcing talent. Due to demand, we may not get back to all applicants that have applied. However, we always keep your resume and details on file so when we see similar roles or see skillsets that drive growth in organizations, we will always reach out to discuss opportunities.
Yes. Even if this role isn’t a perfect match, applying allows us to understand your expertise and ambitions, ensuring you're on our radar for the right opportunity when it arises.
We also work in several ways, firstly we advertise our roles available on our site, however, often due to confidentiality we may not post all. We also work with clients who are more focused on skills and understanding what is required to future-proof their business.
That's why we recommend registering your resume so you can be considered for roles that have yet to be created.
Yes, we help with resume and interview preparation. From customized support on how to optimize your resume to interview preparation and compensation negotiations, we advocate for you throughout your next career move.