Senior Data Engineer

Job Overview:

• Extracting, cleansing, and loading data.
• Building data pipelines using SQL, Kafka, and other technologies.
• Investigation and documentation of new data sets
• Triage incoming bugs and incidents.
• Perform technical operation tasks.
• Investigate and troubleshoot issues with data and data pipelines.
• Participation in sprint refinement, planning, and kick-off to help estimate stories, raise awareness and additional implementation details.
• Help monitor areas of the data pipeline and raise awareness to the team when issues arise.
• Performing and implementing new quality assurance rules to maintain consistent and accurate data.

Knowledge:

• A solid understanding of data science concepts is required
• Data analysis expertise
• Working knowledge of ETL tools
• Knowledge of BI tools

• Handling DevOps Task is preferable

• Experience with Big Data technologies such as Hadoop and Kafka
• Extensive experience with ML frameworks and libraries including TensorFlow, Spark, PyTorch, and MLPACK

Skills (Technical):

• Experience designing and implementing a full-scale data warehouse solution based on Snowflake.
• A minimum of three years experience in developing production-ready data ingestion and processing pipelines using Java, Spark, Scala, Python.
• Experience with complex data warehouse solutions on Teradata, Oracle, or DB2 platforms with 2 years of hands-on experience
• Expertise and excellent proficiency with Snowflake internals and integration of Snowflake with other technologies for data processing and reporting.
• Experience or Knowledge of Excel and several analytical tools such as Tableau, MicroStrategy, PowerBI would be added advantage

Abilities (Competencies):

• Work Independently.
• Collaborates with team members.
• Self-motivated.

Interested can drop your CV to bhavani.tirumunadam@cloudangles.com or 9100430249