Lead Data Engineer

Engineer II Data & Analytics (Simplified JD)

We are hiring an Engineer II to help build and manage our data pipelines and support analytics across the organization. The role involves working with product teams, analysts, data scientists, and other engineers to ensure smooth, scalable, and reliable data delivery.

Key Responsibilities

• Build and maintain scalable data pipelines for structured, semi-structured, and unstructured data.
  
• Develop ETL processes to ingest, transform, and load data into data warehouses.
  
• Work with business teams to understand data needs and create technical solutions.
  
• Improve performance of data storage, processing, and querying.
  
• Follow data governance, security, and privacy best practices.
  
• Troubleshoot and resolve data issues quickly.
  
• Collaborate effectively with cross-functional teams.
  

Basic Qualifications

• 5+ years of Data Engineering experience + Bachelor’s degree in Technology.
  
• Strong hands-on experience in Python or Java for building data pipelines.
  
• Experience with cloud data warehouses (Snowflake, Redshift).
  
• Experience with Hadoop ecosystem / Spark / Cloudera.
  
• Experience working on AWS (S3, EC2, EMR, Glue, CloudWatch, Athena, Lambda).
  
• Knowledge of Azure or GCP is a plus.
  
• Experience with Docker, Kubernetes.
  
• Experience with CI/CD tools (GitLab, Bitbucket).
  
• Experience with pipeline orchestration tools (Airflow, Jenkins).
  
• Strong SQL, Hive, data modelling skills.
  
• Experience with reporting tools (Power BI, Tableau, MicroStrategy).
  
• Knowledge of data quality tools (Great Expectations) and data governance tools (DataHub).
  
• Experience with Kafka or real-time data processing.
  
• Retail domain experience is a plus.