Data Engineer

4 - 8 years

15 - 30 Lacs

Posted:2 weeks ago| Platform: Naukri logo

Apply

Work Mode

Hybrid

Job Type

Full Time

Job Description

We are seeking a highly skilled and innovative Data Engineer to join our dynamic team. This role is ideal for professionals passionate about building scalable data pipelines and enabling machine learning and analytics at scale. Youll play a key role in designing and implementing systems that support real-time and batch data processing for advanced AI-driven use cases, including Retrieval-Augmented Generation (RAG). Key Responsibilities: Develop, maintain, and scale data pipelines using Airflow (preferably Metaflow ) and other orchestration tools. Design microservices-based data solutions to support AI/ML initiatives. Work with vector databases to optimize data retrieval for RAG and generative AI models. Collaborate with data scientists, ML engineers, and software engineers to integrate data engineering solutions into broader systems. Ensure data quality, reliability, and governance across all data pipelines and storage layers. Required Skills: Proficiency in Python for data processing, scripting, and service development. Experience with Airflow (Metaflow preferred) or other workflow orchestration tools. Strong knowledge of Microservices architecture and REST APIs. Familiarity with RAG (Retrieval-Augmented Generation) frameworks and concepts. Experience with Vector databases (e.g., Pinecone, FAISS, Weaviate, Qdrant). Solid understanding of data modeling, ETL/ELT processes, and cloud data platforms.

Mock Interview

Practice Video Interview with JobPe AI

Start Airflow Interview Now

My Connections Satc Marketing

Download Chrome Extension (See your connection in the Satc Marketing )

chrome image
Download Now

RecommendedJobs for You

Kolkata, Mumbai, New Delhi, Hyderabad, Pune, Chennai, Bengaluru

Hyderabad, Chennai, Bengaluru

Chennai, Tamil Nadu, India