Senior Data Consultant

Senior Data Consultant

Senior Data Consultant (Databricks)

As a Senior Data Consultant, you will play a key role in designing, developing, and optimizing data pipelines, collaborating closely with solution architects, analysts, and cross-functional teams to deliver robust data models and cloud-based solutions that support enterprise analytics and machine learning initiatives

Key Responsibilities

• Design, develop, and maintain end-to-end data pipelines using modern data platforms and tools.
  
• Build and manage ETL/ELT processes for large-scale data transformation in both real-time and batch modes.
  
• Develop and maintain scalable

  data models and schemas

  to support analytics and ML applications.
• Collaborate with data scientists, analysts, and IT teams to gather requirements and deliver high-quality data solutions.
  
• Optimize performance and scalability of data pipelines, ensuring efficient resource usage and data quality.
  
• Implement

  data governance

  best practices, ensuring data integrity, privacy, and security.
• Leverage cloud platforms (

  AWS, Azure, or GCP

  ) to implement and manage data pipelines and infrastructure.
• Monitor, troubleshoot, and resolve data pipeline issues to ensure reliability and uptime.
  
• Automate workflows and implement

  CI/CD pipelines

  for seamless deployment of data applications.
• Stay current with emerging technologies and best practices in data engineering and cloud platforms.
  

• Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.
  
• Proven experience as a

  Senior Data Consultant

  with hands-on expertise in

  Databricks

  .
• Strong understanding of

  data warehousing

  ,

  ETL/ELT

  , and

  data modeling

  principles.
• Experience with

  Delta Lake

  and building scalable, high-performance data pipelines.
• Hands-on experience with

  cloud platforms

  (AWS, Azure, or GCP).
• Familiarity with tools like

  Apache Kafka

  ,

  Airflow

  , or similar orchestration frameworks.
• Knowledge of

  version control

  (e.g., Git) and

  CI/CD

  practices.
• Excellent analytical, problem-solving, and communication skills.