Data Engineer

5 years

0 Lacs

Posted:1 week ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Contractual

Job Description

Data Engineer – AI-Powered Marketing Personalization Platform


Data Engineer


greenfield opportunity


Core Responsibilities


Data Architecture & Infrastructure (40%)

  • Design and implement multi-database systems (MongoDB, Redis, Milvus, Neo4j, BigQuery)
  • Build scalable real-time pipelines and ETL/ELT workflows
  • Implement data governance, quality, and high-throughput optimization


Vector & Graph Systems (25%)

  • Optimize Milvus collections for semantic search
  • Design Neo4j schemas for customer journeys and relationships
  • Develop hybrid search (vector + graph + text) with performance tuning


ML Data Infrastructure (20%)

  • Build data pipelines for LLM fine-tuning and GNN training
  • Manage data versioning, lineage, and A/B testing systems
  • Implement real-time feature computation for contextual models


Analytics & Monitoring (15%)

  • Create BigQuery schemas and real-time dashboards
  • Implement observability (Prometheus, Grafana) and anomaly detection
  • Optimize data costs across cloud environments


Tech Stack


Databases:

Processing:

ML Pipeline:

Cloud & Infra:

Languages:


Requirements


Must-Have

  • 5+ years of data engineering experience in production systems
  • Advanced Python and SQL expertise
  • Experience with 3+ database types (SQL, NoSQL, Vector, Graph)
  • Proven ability to build high-scale data pipelines (>1M records/day)
  • Strong data modeling, validation, and optimization skills
  • Experience with cloud data warehouses (BigQuery, Redshift, or Snowflake)


Preferred

  • Experience with Milvus, Pinecone, or Weaviate
  • Graph databases (Neo4j, Neptune) and embedding-based search
  • ML/Feature store experience
  • Background in marketing technology or CDPs


Key Projects


Phase 1 – Foundation:

Phase 2 – Optimization:

Phase 3 – ML Infrastructure:


Why Join Us


  • Collaborate with ML engineers and data scientists on cutting-edge AI systems
  • High ownership and real product impact
  • Modern tools and a flexible environment
  • Clear growth path to Senior, Lead, or Principal roles
  • Shape the future of AI-driven marketing personalization

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

gurugram, chennai, bengaluru

hyderabad, chennai, bengaluru

pune, chennai, bengaluru

gurugram, haryana, india