Data Engineer

We are seeking a highly motivated and skilled Data Engineer with strong background in data architecture, ETL processes, and data warehousing. As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data pipelines, ensuring the availability of high-quality and reliable data for analytics and reporting.

Responsibilities:

• Design, implement, and maintain scalable ETL pipelines to extract, transform, and load data from various sources into our data warehouse.
• Develop efficient and robust data integration processes that ensure data accuracy, consistency, and reliability.
• Perform data profiling and analysis to identify data quality issues and implement corrective measures.
• Optimize data pipelines for performance, scalability, and efficiency, considering data volume and query complexity.
• Implement data security and access controls to ensure data privacy and compliance with regulations.
• Monitor and troubleshoot data pipelines to identify and resolve issues in a timely manner.
• Collaborate with the DevOps team to deploy and manage data engineering solutions in a cloud-based environment.
• Document data engineering processes, data flow diagrams, and technical specifications.
• Stay current with industry trends, best practices, and emerging technologies in data engineering and analytics.

Qualification:

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• Strong programming skills in languages such as Python or Java, Spark and SQL.
• Proven experience as a Data Engineer or similar role, with a track record of designing and implementing data pipelines.
• Proficiency in SQL for data profiling.
• Proficiency in ETL tools and frameworks (e.g., Apache Spark, Flink, Airflow)
• Familiarity with data warehousing concepts, dimensional modeling, and database design principles.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Understanding of Big Data technologies and distributed computing concepts.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills.
• Ability to work in an agile and fast-paced environment.