Data Engineer

5 - 8 years

5 - 9 Lacs

Posted:3 hours ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

As a Data Engineer, you will design and implement data pipelines and integrations across cloud platforms to support AI and GenAI workloads. You’ll work closely with Data Scientists and ML Engineers to enable GenAI-powered applications through clean, secure, and optimized data flows.  

Key Responsibilities - Data Engineering 

Build and maintain ETL/ELT pipelines for structured, semi-structured, and unstructured data. 

Work with data warehouses/lakehouses (Snowflake, BigQuery, Databricks, Redshift). 

Develop real-time streaming pipelines using Kafka, Spark, or Flink. 

Ensure data quality, validation, and error handling. 

Prepare and manage data pipelines to feed LLMs and GenAI models. 

Work with vector databases (FAISS, Pinecone, Weaviate, Milvus) for RAG-based solutions. 

Support embedding generation and prompt engineering workflows. 

Collaborate with AI teams to integrate GenAI APIs and frameworks (LangChain, Hugging Face, OpenAI). 

Deploy pipelines on cloud services (AWS Glue, Azure Data Factory, GCP Dataflow/Dataproc). 

Use Airflow, Dagster, or Prefect for orchestration. 

Required Skills  

Proficiency in Python, SQL, PySpark. 

Hands-on experience with ETL pipelines and data modeling. 

Knowledge of cloud data platforms (AWS, Azure, or GCP). 

Experience with vector databases and GenAI frameworks 

Familiarity with Docker, Kubernetes, CI/CD pipelines. 

Preferred Skills 

Exposure to MLOps / LLMOps practices. 

Experience with semantic search, embeddings, or RAG systems. 

Familiarity with data security, compliance, and governance. 

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Cyient logo
Cyient

IT Services and IT Consulting

Hyderabad TS

RecommendedJobs for You