Ai Ml Engineer

5 - 8 years

20 - 25 Lacs

Posted:8 hours ago| Platform: Naukri logo

Apply

Work Mode

Hybrid

Job Type

Full Time

Job Description

We are seeking a Senior Data Engineer to design and implement the data foundation for a competitive intelligence MVP. The role involves building automated ingestion pipelines, orchestrating PDF extraction workflows, and creating normalized product datasets in Bronze/Silver/Gold layers using Azure Databricks. You will work in an Azure-first environment (ADF, Databricks, Azure Functions, Azure SQL) and collaborate with AI/ML engineers and BI teams to ensure high-quality, production-ready data pipelines within timeline.

---

Key Responsibilities

  • Data Pipeline Development
  • Build ingestion pipelines to fetch PDFs from file stores and load into Bronze layer.
  • Implement orchestration using Azure Functions and integrate with Document Intelligence or Azure OpenAI for text extraction.
  • Develop transformation and cleaning jobs in Databricks (PySpark) for Silver layer normalization.
  • Data Modeling & Quality
  • Design schemas for Bronze/Silver/Gold layers with Delta Lake.
  • Implement data quality checks (completeness, deduplication, normalization).
  • Standardize units, sizes, and packaging for product data.
  • Integration & Deployment
  • Configure Azure Data Factory or Databricks Jobs for scheduling and monitoring.
  • Deploy Gold layer into Azure SQL for analytics and Power BI consumption.
  • Ensure secure data access and compliance with organizational standards.
  • Collaboration & Documentation
  • Work closely with AI/ML engineers for feature-ready datasets.
  • Provide data dictionaries, lineage documentation, and runbooks for operations.

---

Requirements

Must-Have Skills

  • 5+ years in data engineering with Azure cloud experience.
  • Strong in Databricks (PySpark), Delta Lake, and Azure Data Factory.
  • Experience with Azure Functions, event-driven orchestration, and API integration.
  • Proficient in SQL, data modeling, and performance tuning.
  • Knowledge of Infrastructure as Code (IaC) for provisioning data services.
  • Familiarity with data quality frameworks and monitoring.

Nice-to-Have

  • Exposure to Azure Document Intelligence or OCR/NLP pipelines.
  • Experience with retail/product data normalization.
  • Understanding of MLOps and collaboration with AI/ML teams.
  • Familiarity with Power BI data shaping and optimization.

Mock Interview

Practice Video Interview with JobPe AI

Start Artificial Intelligence Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Valuelabs logo
Valuelabs

IT Services and IT Consulting

Hyderabad Telangana

RecommendedJobs for You

pune, bengaluru, delhi / ncr