Lead Data/AI Engineering

2 - 4 years

13 - 18 Lacs

Posted:2 days ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

  • Create product roadmap and project plan.
  • Design, develop, and maintain scalable ETL pipelines using Azure Services to process, transform, and load large datasets into Cloud platforms.
  • Collaborate with cross-functional teams, including data architects, analysts, and business stakeholders, to gather data requirements and deliver efficient data solutions.
  • Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure.
  • Work together with data scientists/architects and analysts to understand the needs for data and create effective data workflows.
  • Exposure to Snowflake Warehouse.
  • Big Data Engineer with solid background with the larger Hadoop ecosystem and real-time analytics tools including PySpark/Scala-Spark/Hive/Hadoop CLI / MapReduce / Storm / Kafka / Lambda Architecture
  • Implementing data validation and cleansing techniques.
  • Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
  • Experience in designing and hands-on development in cloud-based analytics solutions.
  • Expert level understanding on Azure Data Factory Azure Data Lake, Snowflake, Pyspark is required.
  • Good to have exp in full Stack Development background with Java and JavaScript/CSS/HTML.
  • Knowledge of ReactJs/Angular is a plus.
  • Designing and building of data pipelines using API ingestion and Streaming ingestion methods.
  • Unix/Linux expertise; comfortable with Linux operating system and Shell Scripting.
  • Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is desirable.
  • PL/SQL, RDBMS background with Oracle/MySQL
  • Comfortable with microServices, CI/CD, Dockers, and Kubernetes
  • Strong experience in common Data Vault data warehouse modelling principles.
  • Creating/modifying Dockers and deploying them via Kubernetes.

Mock Interview

Practice Video Interview with JobPe AI

Start JavaScript Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Javascript Skills

Practice Javascript coding challenges to boost your skills

Start Practicing Javascript Now

RecommendedJobs for You

hyderabad, telangana, india

Hyderabad, Telangana, India