Senior Analyst - Data Engineering

0 - 5 years

0 Lacs

Posted:1 week ago| Platform: Indeed logo

Apply

Work Mode

On-site

Job Description

Designation: Senior Analyst - Data Engineering
Experience: 4 to 7 years Location: Chennai, Tamil Nadu (CHN)
Job Description:
We are seeking an experienced Python Backend Developer with more than 5 years of hands-on experience to build and maintain reliable, scalable, and secure LLM orchestration services. In this role, you'll design reusable and testable modules, implement end-to-end RAG pipelines, and establish robust CI/CD practices with a strong emphasis on security and observability.

Responsibilities:
  • RAG Pipeline Development
  • Design and implement complete RAG pipelines including embeddings generation, vector search, prompt injection, LLM invocation, and post-processing
  • Build modular, maintainable code with clear interfaces for context assembly, retrieval logic, prompt construction, LLM invocation, and data persistence
  • Optimize pipeline performance through token caching strategies, async I/O patterns, intelligent caching, and resource right-sizing
  • Implement best practices for LLM orchestration ensuring efficient token usage and response quality
  • CI/CD & Release Management
  • Design and implement automated CI/CD pipelines with comprehensive test coverage, security scanning, and gated deployments
  • Manage deployment strategies across dev, staging, and production environments
  • Establish branching models, pull request workflows, code review standards, and merge strategies with quality gates
  • Observability & Monitoring
  • Implement comprehensive logging, tracing, and metrics collection for RAG pipelines
  • Track key performance indicators including RAG cache hit rates, retrieval latency, LLM response times, and error rates
  • Set up alerting mechanisms and monitoring dashboards using Azure Application Insights or similar tools
  • Utilize structured logging and distributed tracing (OpenTelemetry) for production troubleshooting
  • Code Quality & Best Practices
  • Maintain high code quality standards with well-organized project structures, proper error handling, retry logic, and comprehensive logging
  • Write unit tests, integration tests, and end-to-end tests with appropriate mocking strategies
  • Implement database best practices including stored procedures, proper table design (primary keys, audit fields, indexing)
  • Create and maintain thorough technical documentation
  • Enforce security gates throughout the development lifecycle

Skills:
  • Real-world experience with Azure Functions or similar serverless frameworks Experience with Azure SQL or similar relational databases Strong understanding of testing methodologies: unit testing, integration testing, and end-to-end testing with mocking frameworks Experience with CI/CD pipelines using Azure DevOps or GitHub Actions Knowledge of container builds, scanning, and deployment workflows Familiarity with Git branching strategies, PR workflows, and merge strategies (Good to have)Hands-on experience with LLM orchestration and RAG architectures, including embeddings, vector search, and prompt engineering (Good to have) Experience with LLM orchestration frameworks such as llama_index, LangChain, or similar (Good to have) Proficiency with Azure AI Search, Azure OpenAI
  • Strong grasp of modular design, clean code principles, and API design Experience with error handling, retry mechanisms, and resilience patterns Understanding of asynchronous programming and performance optimization

Job Snapshot
Updated Date
24-11-2025
Job ID
J_4441
Location
Chennai, Tamil Nadu, India
Experience
4 - 7 Years
Employee Type
Permanent

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You