Data Engineer

Walk-In-Drive for Data Engineers

Role & responsibilities

• Design, implement, and maintain scalable ETL pipelines to extract, transform, and load data from various sources into our data warehouse.
• Develop efficient and robust data integration processes that ensure data accuracy, consistency, and reliability.
• Perform data profiling and analysis to identify data quality issues and implement corrective measures.
• Optimize data pipelines for performance, scalability, and efficiency, considering data volume and query complexity.
• Implement data security and access controls to ensure data privacy and compliance with regulations.
• Monitor and troubleshoot data pipelines to identify and resolve issues in a timely manner.
• Collaborate with the DevOps team to deploy and manage data engineering solutions in a cloud-based environment.
• Document data engineering processes, data flow diagrams, and technical specifications.
• Stay current with industry trends, best practices, and emerging technologies in data engineering and analytics.

Preferred candidate profile

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• Strong programming skills in languages such as Python or Java, Spark and SQL.
• Proven experience as a Data Engineer or similar role, with a track record of designing and implementing data pipelines.
• Proficiency in SQL for data profiling.
• Proficiency in ETL tools and frameworks (e.g., Apache Spark, Flink, Airflow)
• Familiarity with data warehousing concepts, dimensional modeling, and database design principles.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Understanding of Big Data technologies and distributed computing concepts.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills.

Interview Process:

1 Technical round will be conducted virtually on Teams

2nd technical round will be conducted Face-to-Face