Data Engineer - 5 to 9 yrs

Data Engineer

Experience:

Location:

Mode of Engagement:

No. of Positions:

Educational Qualification:

Industry:

Notice Period:

What We Are Looking For:

• 5–9 years of strong experience in

  Python-based data engineering

  and

  end-to-end data pipeline development

  .
• Hands-on expertise in

  data extraction, transformation, and automation

  using Python, SQL, and cloud-based tools.
• Proven ability in building

  scalable APIs, microservices, and ETL workflows

  with Docker/Kubernetes.
• Working knowledge of

  AWS

  ,

  PostgreSQL/MySQL

  , and

  CI/CD pipelines

  for deployment and monitoring.
• Experience or familiarity with

  AI/LLM-based automation

  or

  data enrichment workflows

  is an advantage.

Responsibilities:

• Design, build, and maintain

  data ingestion and transformation pipelines

  for analytics and automation systems.
• Develop

  API-driven data delivery frameworks

  ensuring performance, scalability, and security.
• Work on

  data scraping and integration

  from multiple structured and unstructured sources.
• Collaborate with product, AI, and analytics teams to develop

  intelligent, data-driven workflows

  .
• Implement

  data quality, validation, and monitoring standards

  throughout the pipeline lifecycle.
• Deploy and optimize workloads using

  Docker, Kubernetes, AWS Lambda

  , and

  CI/CD automation

  .
• Troubleshoot and optimize system performance for reliability and scalability.

Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
• Proficiency in

  Python, FastAPI/Django, SQL, and RESTful API design

  .
• Hands-on experience with

  scraping tools

  (BeautifulSoup, Scrapy) and

  ETL frameworks

  .
• Good understanding of

  AWS ecosystem

  ,

  Docker

  ,

  Kubernetes

  , and

  Git-based CI/CD workflows

  .
• Excellent problem-solving, analytical, and collaboration skills.