Data Engineer 2

Job Title: Data Engineer II (Python, SQL)

Experience: 3 to 6 years

Location: Bangalore, Karnataka

Role: Data Engineer II (Python, SQL)

As a Data Engineer II, you will work on designing, building, and maintaining scalable data pipelines. Youll collaborate across data analytics, marketing, data science, and product teams to drive insights and AI/ML integration using robust and efficient data infrastructure.

Key Responsibilities:

• Design, develop and maintain end-to-end data pipelines (ETL/ELT).
  
• Ingest, clean, transform, and curate data for analytics and ML usage.
  
• Work with orchestration tools like Airflow to schedule and manage workflows.
  
• Implement data extraction using batch, CDC, and real-time tools (e.g., Debezium, Kafka Connect).
  
• Build data models and enable real-time and batch processing using Spark and AWS services.
  
• Collaborate with DevOps and architects for system scalability and performance.
  
• Optimize Redshift-based data solutions for performance and reliability.

Must-Have Skills & Experience:

• 3+ years

  in Data Engineering or Data Science with strong ETL and pipeline experience.
• Expertise in

  Python

  and

  SQL

  .
• Strong experience in

  Data Warehousing

  ,

  Data Lakes

  ,

  Data Modeling

  , and

  Ingestion

  .
• Working knowledge of

  Airflow

  or similar orchestration tools.
• Hands-on with

  data extraction techniques

  like

  CDC

  , batch-based, using

  Debezium, Kafka Connect, AWS DMS

  .
• Experience with

  AWS Services

  : Glue, Redshift, Lambda, EMR, Athena, MWAA, SQS, etc.
• Knowledge of

  Spark

  or similar distributed systems.
• Experience with

  queuing/messaging systems

  like

  SQS

  ,

  Kinesis

  ,

  RabbitMQ

  .