Senior Data Engineer

About the Company:

Everest DX – We are a Digital Platform Services company, headquartered in Stamford. Our Platform/Solution includes Orchestration, Intelligent operations with BOTs’, AI-powered analytics for Enterprise IT. Our vision is to enable Digital Transformation for enterprises to deliver seamless customer experience, business efficiency and actionable insights through an integrated set of futuristic digital technologies.

Digital Transformation Services - Specialized in Design, Build, Develop, Integrate, and Manage cloud solutions and modernize Data centers, build a Cloud-native application and migrate existing applications into secure, multi-cloud environments to support digital transformation. Our Digital

Platform Services enable organizations to reduce IT resource requirements and improve productivity, in addition to lowering costs and speeding digital transformation.

Digital Platform - Cloud Intelligent Management (CiM) - An Autonomous Hybrid Cloud Management Platform that works across multi-cloud environments. helps enterprise Digital Transformation get most out of the cloud strategy while reducing Cost, Risk and Speed.

http://www.everestdx.com

Job Title:

Location:

Experience:

Job Summary:

Azure Data Engineer / Lead

Key Responsibilities:

• Design, develop, and optimize large-scale data pipelines using

  Azure Databricks, ADLS, and ADF

  .
• Implement and manage distributed data processing solutions using

  Spark/PySpark

  .
• Write and optimize

  SQL queries

  for data extraction, transformation, and analysis.
• Lead and mentor a small team of data engineers, providing technical guidance and reviewing design solutions.
• Collaborate with stakeholders to translate business requirements into scalable and efficient data solutions.
• Ensure data quality, governance, and compliance across data platforms.
• Support production deployments, troubleshooting, and performance optimization.

Required Skills:

• Strong expertise with

  Azure Databricks, Azure Data Lake, and Azure Data Factory

  .
• Hands-on experience in

  Spark/PySpark

  for distributed data processing.
• Proficiency in

  SQL

  for complex queries and optimization.
• Solid understanding of

  Azure cloud platform

  and its ecosystem.
• Proven experience in

  leading and mentoring teams

  .
• Strong problem-solving and analytical skills.
• Excellent communication and collaboration abilities.