Lead Data Engineer

Role: lead data Engineer

Location: Kochi/Trivandrum

Work mode: Hybrid

Full time

Required Qualifications

Experience & Technical Skills:

• Professional Background:

  At least 5 years of relevant experience in data engineering with a strong emphasis on analytical platform development.

• Programming Skills:

  Proficiency in Python and/or PySpark, SQL for developing ETL processes and handling large-scale data manipulation.

• AWS Expertise:

  Extensive experience using AWS services including AWS Glue, Lambda, Step Functions, and S3 to build and manage data ingestion frameworks.

• Data Platforms:

  Familiarity with big data systems (e.g., AWS EMR, Apache Spark, Apache Iceberg) and databases like DynamoDB, Aurora, Postgres, or Redshift.
• API Development: Proven experience in designing and implementing RESTful APIs and integrating them with external and internal systems.
• CI/CD & Agile: Hands-on experience with CI/CD pipelines (preferably with GitLab) and Agile development methodologies

If you are interested, please share updated resume to pramod@intellistaff.in