Senior Data Engineer

Job Title:

Location:

Work Hours:

Employment Type:

About the Role:

Senior Data Engineer

Key Responsibilities:

• Design and develop

  ETL pipelines

  using

  Azure Databricks, Apache Spark, and Azure Data Factory

  for both batch and real-time data integration.
• Implement

  advanced data transformations

  and pipeline development using

  Python/Scala

  .
• Write and optimize

  SQL queries and stored procedures

  for efficient data processing.
• Ingest, prepare, and operationalize data to meet evolving business requirements.
• Architect and implement solutions using

  Azure Synapse, Snowflake, and other cloud-based analytical warehouses

  .
• Build and maintain

  end-to-end data architectures

  including

  Data Lakes, Data Warehouses, and Data Marts

  .
• Leverage

  Azure DevOps, GitHub

  , and orchestration tools for

  CI/CD, automation, and pipeline management

  .
• Apply relational and distributed data processing techniques using

  MS SQL, Delta Lake, Spark SQL

  .
• Ensure

  data quality, consistency, and reliability

  across pipelines and solutions.
• Own the complete

  software development lifecycle

  including design, coding, testing, debugging, and deployment.
• Collaborate with architects and cross-functional teams to define

  forward-looking data and analytics solutions

  .
• Provide

  technical documentation

  and promote

  secure, scalable engineering practices

  .
• Utilize

  Azure services

  such as

  Azure Functions, Data Lake Store, and Cosmos DB

  .
• (Preferred) Work with

  Healthcare domain business data models

  to align solutions with industry requirements.

Qualifications & Skills

• 8+ years

  of Data Engineering experience.
• Hands-on expertise in

  Azure Databricks, Apache Spark, Azure Data Factory

  .
• Strong programming skills in

  Python or Scala

  .
• In-depth knowledge of

  ETL and Data Warehousing concepts, design, and methodologies

  .
• Experience with

  Azure Synapse Analytics, Snowflake, and cloud data warehouses

  .
• Strong understanding of

  Data Lake architecture and big data processing frameworks

  .
• Proficiency with

  SQL, Delta Lake, Spark SQL

  for data transformation and optimization.
• Experience with

  Azure DevOps, GitHub, CI/CD pipelines, and automation

  .
• Strong problem-solving, analytical, and communication skills.

• Healthcare domain experience

  is a plus.