Data Engineer

Description

We are looking for an experienced Data Engineer to join our team in India. The ideal candidate will have 5-14 years of experience in designing and building data pipelines, working with large datasets, and collaborating with cross-functional teams to deliver data solutions.

Responsibilities

• Design, develop, and maintain scalable data pipelines and architectures.
• Collaborate with data scientists and analysts to gather requirements and provide data solutions.
• Optimize data processing and storage solutions for performance and efficiency.
• Implement data quality checks and monitoring processes to ensure data integrity.
• Work with both structured and unstructured data from various sources.
• Ensure data security and compliance with regulations.

Skills and Qualifications

• Proficiency in SQL and experience with relational databases such as MySQL, PostgreSQL, or Oracle.
• Strong programming skills in Python, Java, or Scala.
• Experience with big data technologies such as Hadoop, Spark, or Kafka.
• Familiarity with cloud platforms (AWS, Azure, GCP) and their data services.
• Knowledge of ETL tools and data integration processes.
• Experience with data modeling and data warehousing concepts.
• Understanding of data governance and data quality principles.