Data Engineer

Description

We are seeking a skilled Data Engineer to join our team in India. In this role, you will be responsible for designing and implementing scalable data solutions to support our business objectives. You will work closely with cross-functional teams to ensure the availability, quality, and integrity of our data systems.

Responsibilities

• Design, construct, install and maintain large-scale processing systems and data pipelines.
• Develop and manage data models, data architecture, and data warehousing solutions.
• Collaborate with data scientists and analysts to understand data requirements and provide necessary data solutions.
• Implement data security and compliance measures for data handling and processing.
• Perform data validation, cleansing, and ETL processes to ensure data quality and integrity.
• Monitor and optimize data workflows and performance across data systems.

Skills and Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 5-15 years of experience in data engineering or related roles.
• Proficiency in programming languages such as Python, Java, or Scala.
• Strong experience with SQL and NoSQL databases (e.g., PostgreSQL, MongoDB, Cassandra).
• Knowledge of data warehousing solutions (e.g., Amazon Redshift, Google BigQuery).
• Experience with data pipeline orchestration tools (e.g., Apache Airflow, Luigi).
• Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and their data services.
• Understanding of big data technologies (e.g., Hadoop, Spark) and data processing frameworks.