Sr. Data Engineer

𝗝𝗼𝗯 𝗧𝗶𝘁𝗹𝗲: Sr. Data Engineer

𝗝𝗼𝗯 𝗟𝗼𝗰𝗮𝘁𝗶𝗼𝗻: Chennai, Tamil Nadu, India

𝗝𝗼𝗯 𝗗𝘂𝗿𝗮𝘁𝗶𝗼𝗻: Permanent

𝗝𝗼𝗯 𝗧𝘆𝗽𝗲: On-Site

𝗧𝗵𝗲 𝗖𝗵𝗮𝗹𝗹𝗲𝗻𝗴𝗲:

We are seeking a skilled Sr. Data Engineer with 5-8 years of experience in building and managing data pipelines. The ideal candidate will have a strong proficiency in relational and NoSQL databases, as well as experience with data warehouses and real-time data streaming. This role requires excellent problem-solving skills, attention to detail, and the ability to work effectively in a team environment.

𝗥𝗼𝗹𝗲𝘀 & 𝗥𝗲𝘀𝗽𝗼𝗻𝘀𝗶𝗯𝗶𝗹𝗶𝘁𝗶𝗲𝘀:

• Design, build, and maintain efficient and scalable data pipelines to support data integration and transformation across various sources.
• Work with relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra) to manage and optimize large datasets.
• Utilize Apache Spark for distributed data processing and real-time analytics.
• Implement and manage Kafka for data streaming and real-time data integration between systems.
• Collaborate with cross-functional teams to gather and translate business requirements into technical solutions.
• Monitor and optimize the performance of data pipelines and architectures, ensuring high availability and reliability.
• Ensure data quality, consistency, and integrity across all systems.
• Stay up to date with the latest trends and best practices in data engineering and big data technologies.

𝗘𝘀𝘀𝗲𝗻𝘁𝗶𝗮𝗹 𝗦𝗸𝗶𝗹𝗹𝘀 & 𝗥𝗲𝗾𝘂𝗶𝗿𝗲𝗺𝗲𝗻𝘁𝘀:

𝗠𝘂𝘀𝘁 𝗛𝗮𝘃𝗲:

• 5-8 years of experience in data engineering, with a focus on building and managing data pipelines.
• Strong proficiency in relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).
• Experience in building data pipelines with data warehouses like Snowflake and Redshift.
• Experience in processing unstructured data stored from S3 using Athena, Glue, etc.
• Hands-on experience with Kafka for real-time data streaming and messaging.
• Solid understanding of ETL processes, data integration, and data pipeline optimization.
• Proficiency in programming languages like Python, Java, or Scala for data processing.
• Experience with Apache Spark for big data processing and analytics.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills, with the ability to work effectively in a team environment.

𝗣𝗿𝗲𝗳𝗲𝗿𝗿𝗲𝗱 𝗤𝘂𝗮𝗹𝗶𝗳𝗶𝗰𝗮𝘁𝗶𝗼𝗻𝘀:

• Familiarity with cloud platforms like AWS, GCP, or Azure for data infrastructure.