L

Data Engineer

Lexicon Infotech

8 years

25 - 30 Lacs

Chennai

Posted:1 day ago

Job Description

Position Overview

  • Job Title: Lead Data Engineer
  • Experience Required: 8+ Yrs
  • Location: Chennai
  • Payroll Partner: Lexicon Infotech
  • Project Client: BU Soft Tech

Job Description

We are seeking an experienced Senior Data Engineer to design, build, and maintain scalable data pipelines and distributed data processing solutions.

Mandatory / Primary Skills

  • Cloud Platform: AWS or Azure
  • Python
  • PySpark
  • SQL

Experience

  • 5 to 8 years of hands-on experience in Data Engineering and building scalable data solutions.
  • Strong hands-on experience with cloud-based data engineering platforms. AWS experience is preferred, but candidates with Azure experience are also welcome.

Technical Skills

  • Strong hands-on expertise in Python and PySpark for large-scale data processing.
  • Advanced proficiency in SQL, including complex queries, query optimization, and data analysis.
  • Experience with AWS data engineering services is preferred. Relevant Azure data engineering experience is also acceptable.
  • Strong understanding of Apache Spark and distributed data processing systems.
  • Experience designing, developing, and maintaining scalable, high-performance ETL/ELT data pipelines.
  • Experience in data ingestion, transformation, integration, and processing from multiple data sources.
  • Experience working with structured, semi-structured, and unstructured data, including JSON, logs, PDFs, and other file formats.
  • Strong knowledge of relational and non-relational databases.
  • Experience in data quality checks, validation, performance tuning, and optimization.

Secondary Skills – Generative AI (GenAI)

  • Exposure to Generative AI (GenAI) and LLM-based applications.
  • Understanding of RAG (Retrieval-Augmented Generation) and vector databases.
  • Experience integrating LLMs with data pipelines and cloud-based data platforms.
  • Familiarity with frameworks such as LangChain or LlamaIndex.
  • Understanding of data preparation, ingestion, and transformation for GenAI applications.
  • Exposure to embedding generation, document processing, and vector search.
  • Familiarity with AI/ML workflows and GenAI use cases in data engineering.

GenAI experience is an added advantage and is not mandatory.

Analytical & Problem-Solving Skills

  • Ability to perform in-depth data analysis and troubleshoot complex data-related issues.
  • Proven experience building scalable data solutions to address complex business requirements.
  • Strong problem-solving and analytical skills.

Soft Skills

  • Strong verbal and written communication skills.
  • Good organizational and stakeholder-management skills.
  • Proactive self-starter with the ability to work independently and take ownership.

Technical Agility

  • Ability to adapt quickly to new technologies and data platforms.
  • Willingness to stay updated with emerging trends and best practices in Data Engineering, cloud platforms, Big Data technologies, and Generative AI.

Pay: ₹2,511,000.00 - ₹3,000,000.00 per year

Work Location: In person

Skills Required

Payroll Data Processing Cloud Platform AWS Azure Python Pyspark SQL Data Engineering Query Optimization Data Analysis Apache Spark

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
L
Lexicon Infotech

RecommendedJobs for You

Meghaz Software Solutions logo

Data Engineer

Meghaz Software Solutions

Bengaluru

Independent Recruitment Consultant (freelancer) logo

Data Engineer

Independent Recruitment Consultant (freelancer)

India

People Tech Technology logo

Data Engineer

People Tech Technology

Hyderabad

WPP logo

Chennai

Krato Solutions logo

Data Engineer

Krato Solutions

Chennai

Applied Systems logo

Data Engineer

Applied Systems

Bengaluru

HP logo

Bengaluru