Data Engineer

Talworx Solutions

3 - 8 years

25 - 35 Lacs

Hyderabad Gurugram

Posted:2 weeks ago| Platform:

Apply

Skills Required

Data Engineering Docker AWS Python Kubernetes Airflow redis SQL Ml

Work Mode

Hybrid

Job Type

Full Time

Job Description

Job Summary:

As a member of the Cognitive Engineering team, you will build and maintain enterprise-scale data extraction, automation, and ML model deployment pipelines. You will design resilient, production-ready systems within an AWS-based ecosystem, collaborating with a hands-on, technically strong global team to solve high-complexity problems end-to-end.

Key Responsibilities:

Develop, deploy, and operate data extraction and automation pipelines in production.
Integrate and deploy machine learning models into pipelines (e.g., inference services, batch scoring).
Lead the delivery of complex extraction, transformation, and ML deployment projects.
Scale pipelines on AWS (EKS, ECS, Lambda) and manage DataOps processes with Celery, Redis, and Airflow.
Implement robust CI/CD pipelines on Azure DevOps and maintain comprehensive test coverage.
Strengthen data quality and reliability through logging, metrics, and automated alerts.
Partner with data scientists, ML engineers, and product teams to align on requirements and delivery timelines.

Technical Requirements:

2-6 years of relevant experience in data engineering, automation, or ML deployment.
Expert proficiency in Python, including building extraction libraries and RESTful APIs.
Hands-on experience with task queues and orchestration: Celery, Redis, Airflow.
Strong AWS expertise: EKS/ECS, Lambda, S3, RDS/DynamoDB.
Containerization and orchestration experience: Docker (mandatory), basic Kubernetes (preferred).
Proven experience deploying ML models to production.
Solid understanding of CI/CD practices and hands-on experience with Azure DevOps.
Familiarity with SQL and NoSQL stores (e.g., PostgreSQL, MongoDB)

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Talworx Solutions

Information Technology

Tech City

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Data Engineer