The senior data engineer will be responsible for:
- Working on data architecture building ETL pipelines
- Cloud migration strategy
- Performing peer code reviews
- Understanding requirements and driving the technical architecture
- Developing test framework, scenarios, and strategies
The qualifications for this role:
- Proficient in Python
- Experience with cloud service providers like Azure, along with data storage and analytic services like Data Lake
- Experience in creating SSIS, Apache NiFi packages for ETL
- Experience with Azure Data Factory and other relevant services
- Expertise in creating tables, procedures, functions, triggers, indexes, views, joins and optimization of complex queries
- Experience with database versioning, backups, restores and migration
- Expertise in data security and integrity
- Ability to perform database performance tuning queries
- Experience in web architecture, providing design and development recommendations and optimizing existing infrastructure
- Experience in object-oriented programming, data structures, algorithms, and software engineering methodologies
- Experience working in Agile and Extreme Programming methodologies in a continuous deployment environment
- Interest in mastering technologies like web server ecosystems, relational DBMS, TDD, CI tools like Jenkins, Hudson and Bamboo, complexity analysis and performance optimization
- Working knowledge of server configuration / deployment Infrastructure
- Experience using source control and bug tracking systems, writing user stories and technical documentation
