Lead Data Engineer

Job Title : Senior Data Engineer / Data Architect (AI & Data Integration)

Location : Offshore (India) Pune, Bangalore , Chennai

Experience : 8-12+ Years

Employment Type : Full-Time

About the Role

We are seeking a highly skilled Senior Data Engineer/Data Architect to design, develop, and support enterprise-scale data integration and AI-ready data platforms. The ideal candidate will possess deep expertise in Informatica, SQL Server, Vector Databases, REST APIs, and modern data integration patterns. This role will work closely with business and technology stakeholders to build scalable data pipelines, enable AI/LLM solutions, and support enterprise application modernization initiatives.

Key Responsibilities

Data Engineering & Integration

Design, develop, and maintain enterprise data pipelines using Informatica.

Build and optimize ETL/ELT workflows for large-volume data processing.

Integrate data from multiple enterprise applications, databases, APIs, and third-party platforms.

Develop data ingestion frameworks for structured, semi-structured, and unstructured data.

Implement data quality, validation, reconciliation, and monitoring mechanisms.

Database & Data Modeling

Design and manage SQL Server databases.

Develop complex SQL queries, stored procedures, views, and performance tuning solutions.

Design logical and physical data models supporting operational and analytical workloads.

Optimize database performance, scalability, and reliability.

AI & Vector Database Enablement

Build and manage vector-based data stores for GenAI and semantic search use cases.

Work with embeddings, vector indexes, and Retrieval Augmented Generation (RAG) architectures.

Integrate enterprise data sources with AI/LLM platforms.

Support document intelligence, knowledge management, and AI search solutions.

API Development & Integration

Develop and consume REST APIs for enterprise integrations.

Implement API security using OAuth, JWT, and token-based authentication.

Integrate cloud and on-premise applications through API-based architectures.

Support event-driven and microservices-based integration patterns.

Architecture & Governance

Define data architecture standards and integration best practices.

Ensure data security, governance, and compliance requirements are met.

Collaborate with business analysts, architects, data scientists, and application teams.

Drive technical design reviews and solution recommendations.

Mandatory Skills

Data Integration

Informatica PowerCenter and/or Informatica IICS

ETL/ELT Development

Data Warehousing Concepts

Data Migration and Data Synchronization

Database

Microsoft SQL Server

Query Optimization

Stored Procedures

Performance Tuning

Data Modeling

API & Integration

REST APIs

JSON/XML

OAuth Authentication

API Integration Frameworks

AI/Data Modernization

Vector Databases (Pinecone, Weaviate, Milvus, Qdrant, Azure AI Search, PgVector)

Embedding Concepts

Semantic Search

RAG Architectures

Development

Python preferred

Git

Agile/Scrum

DevOps CI/CD Practices

Preferred Skills

Azure Data Factory (ADF)

Databricks

Azure Synapse

Snowflake

Kafka/Event Hub

LangChain

OpenAI/Azure OpenAI

Document AI platforms

Knowledge Graphs

Data Lake Architecture

Required Experience

8+ years of Data Engineering experience.

5+ years of Informatica development experience.

Strong hands-on SQL Server expertise.

Experience building enterprise data integration solutions.

Experience working with cloud-based data platforms.

Experience supporting AI/GenAI initiatives is highly desirable.

Strong customer-facing communication skills.

Nice-to-Have Experience

Document Processing Solutions

Intelligent Search Platforms

LLM Integration Projects

AI-powered Knowledge Management Platforms

Healthcare, Manufacturing, Distribution, or Enterprise IT domains