Sr.Data Engineer

As a Senior Data Engineer II, you will be an integral part of the data engineering team, contributing to the development activities and providing guidance and training to Data Engineer I. Your role involves close collaboration with various teams including product management, engineering, account management, ETL, data warehouse, business intelligence, and reporting teams. Your primary responsibilities will include developing data pipelines, investigating and troubleshooting issues, and enhancing data structures. **Key Responsibilities:** - Extract, cleanse, and load data efficiently. - Build data pipelines using SQL, Kafka, and other relevant technologies. - Investigate and document new data sets for analysis. - Triage incoming bugs and incidents promptly. - Perform technical operational tasks to ensure smooth data flow. - Troubleshoot issues related to data and data pipelines. - Participate in sprint refinement, planning, and kick-off sessions to estimate stories effectively. - Monitor data pipeline areas and communicate issues to the team. - Implement new quality assurance rules to uphold data consistency and accuracy. **Qualifications Required:** - Solid understanding of data science concepts. - Expertise in data analysis. - Proficiency in ETL tools and BI tools. - Preferred experience in handling DevOps tasks. - Proficiency in Big Data technologies like Hadoop and Kafka. - Extensive experience with ML frameworks such as TensorFlow, Spark, PyTorch, and MLPACK. In terms of technical skills, you should have: - Experience in designing and implementing data warehouse solutions based on Snowflake. - Minimum three years of experience in developing production-ready data pipelines using Java, Spark, Scala, Python. - Hands-on experience with complex data warehouse solutions on platforms like Teradata, Oracle, or DB2. - Expertise in Snowflake internals and its integration with other technologies for data processing. - Knowledge or experience with Excel and analytical tools like Tableau, MicroStrategy, PowerBI would be beneficial. **Additional Details:** You are expected to work independently, collaborate effectively with team members, and be self-motivated in your approach to tasks.,