Posted:2 weeks ago|
Platform:
Hybrid
Full Time
We are seeking a highly skilled and innovative Data Engineer to join our dynamic team. This role is ideal for professionals passionate about building scalable data pipelines and enabling machine learning and analytics at scale. Youll play a key role in designing and implementing systems that support real-time and batch data processing for advanced AI-driven use cases, including Retrieval-Augmented Generation (RAG). Key Responsibilities: Develop, maintain, and scale data pipelines using Airflow (preferably Metaflow ) and other orchestration tools. Design microservices-based data solutions to support AI/ML initiatives. Work with vector databases to optimize data retrieval for RAG and generative AI models. Collaborate with data scientists, ML engineers, and software engineers to integrate data engineering solutions into broader systems. Ensure data quality, reliability, and governance across all data pipelines and storage layers. Required Skills: Proficiency in Python for data processing, scripting, and service development. Experience with Airflow (Metaflow preferred) or other workflow orchestration tools. Strong knowledge of Microservices architecture and REST APIs. Familiarity with RAG (Retrieval-Augmented Generation) frameworks and concepts. Experience with Vector databases (e.g., Pinecone, FAISS, Weaviate, Qdrant). Solid understanding of data modeling, ETL/ELT processes, and cloud data platforms.
Satc Marketing
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
My Connections Satc Marketing
Kolkata, Mumbai, New Delhi, Hyderabad, Pune, Chennai, Bengaluru
10.0 - 11.0 Lacs P.A.
9.0 - 13.0 Lacs P.A.
0.6 - 1.75 Lacs P.A.
Hyderabad, Ahmedabad
7.0 - 9.0 Lacs P.A.
Hyderabad, Chennai, Bengaluru
7.0 - 11.0 Lacs P.A.
Chennai, Tamil Nadu, India
Salary: Not disclosed
Bengaluru
15.0 - 25.0 Lacs P.A.
4.0 - 12.0 Lacs P.A.
Hyderābād
4.375 - 9.5 Lacs P.A.
Mumbai
Experience: Not specified
3.45 - 7.0 Lacs P.A.