Azure-Databricks Data Engineer | Healthcare Domain | 8+ Years | Remote | Immediate Joiner | Upto 35 LPA

Azure Data Engineer

Mandatory Requirement:

Key Responsibilities

• Develop and enhance Databricks data pipelines

  to support scalable and reliable data processing.
• Work with

  business-critical data

  and closely collaborate with business stakeholders.
• Apply data engineering best practices to build

  high-quality, highly available, and trusted data models

  .
• Scope and implement new entities within the

  unified data model

  .
• Gather business requirements and develop new datasets for the data platform.
• Identify, investigate, and resolve

  data quality issues

  to improve data reliability and user experience.
• Extract, transform, and integrate data from

  diverse and heterogeneous data sources

  .
• Design, implement, and support platforms that provide

  ad hoc access to large datasets

  .
• Model data and metadata to support

  machine learning and AI initiatives

  .

Required Skills

• 8+ years of experience with cloud-based services

  , with a focus on Azure for this Azure Data Engineer role.
• Experience working with

  healthcare data

  , such as claims, encounters, Admission/Discharge/Transfer (ADT), FHIR, and Electronic Health Records (EHR).
• Hands-on experience developing, maintaining, and enhancing

  Databricks data pipelines

  .
• Strong proficiency in

  Python, SQL, and Apache Spark

  .
• Excellent

  SQL and Spark debugging skills

  .
• Strong understanding of

  database structures, theories, principles, and practices

  .
• Knowledge of

  data modeling techniques

  , including normalized, dimensional, star schema, and snowflake schema models.
• Experience following

  Software Development Life Cycle (SDLC) best practices

  , including documentation, coding standards, code reviews, source control management, testing, deployment, and operations.
• Ability to work independently, investigate complex data issues, and proactively improve data quality.
• Strong

  written and verbal communication skills

  with the ability to collaborate effectively with technical and non-technical stakeholders.

Nice-to-Have Skills

• Databricks or Microsoft Azure certifications.
• A master’s degree in a healthcare-related field.
• Experience supporting data integration initiatives involving multiple healthcare systems.

About YMinds.AI

YMinds.AI connects organizations with skilled technology professionals and helps businesses identify talent aligned with their technical and project requirements. We focus on connecting specialized technology expertise with evolving business needs.

Keywords

Principal Azure Data Engineer, Azure Data Engineering, Microsoft Azure, Databricks, Data Pipelines, Python, SQL, Apache Spark, Healthcare Data, Data Engineering, Data Modeling, Data Integration, Data Quality, ETL/ELT, Unified Data Models, Claims Data, ADT, FHIR, EHR, Database Design, SDLC, Cloud Data Platforms.

Hashtags

#AzureDataEngineer #PrincipalDataEngineer #MicrosoftAzure #Databricks #DataEngineering #Python #SQL #ApacheSpark #HealthcareData #DataPipelines #DataModeling #DataQuality #FHIR #EHR #YMindsAI