Senior Analyst - Data Platform [T500-19513]

About H.E. Services:

At H.E. Services vibrant tech Center in Hyderabad, you will have the opportunity to contribute to technology innovation for Holman Automotive, a leading American fleet management and automotive services company. Our goal is to continue investing in people, processes, and facilities to ensure expansion in a way that allows us to support our customers and develop new tech solutions.

Holman has come a long way during its first 100 years in business. The automotive markets Holman serves include fleet management and leasing; vehicle fabrication and up fitting; component manufacturing and productivity solutions; powertrain distribution and logistics services; commercial and personal insurance and risk management; and retail automotive sales as one of the largest privately owned dealership groups in the United States.

Join us and be part of a team that's transforming the way Holman operates, creating a more efficient, data-driven, and customer-centric future.

Roles & Responsibilities:

• Design, develop, and maintain data pipelines using

  Databricks

  ,

  Spark

  , and other Azure cloud technologies.
• Optimize data pipelines for performance, scalability, and reliability, ensuring high speed and availability of data warehouse performance.
• Develop and maintain ETL processes using Databricks and Azure Data Factory for real-time or trigger-based data replication.
• Ensure data quality and integrity throughout the data lifecycle, implementing new data validation methods and analysis tools.
• Collaborate with data scientists, analysts, and stakeholders to understand and meet their data needs.
• Troubleshoot and resolve data-related issues, providing root cause analysis and recommendations.
• Manage a centralized data warehouse in

  Azure SQL

  to create a single source of truth for organizational data, ensuring compliance with data governance and security policies.
• Document data pipeline specifications, requirements, and enhancements, effectively communicating with the team and management.
• Leverage AI/ML capabilities to create innovative data science products.
• Champion and maintain testing suites, code reviews, and CI/CD processes.

Must Have:

• Strong knowledge of

  Databricks

  architecture and tools.
• Proficient in

  SQL

  ,

  Python

  , and

  PySpark

  for querying databases and data processing.
• Experience with

  Azure Data Lake Storage (ADLS)

  ,

  Blob Storage

  , and

  Azure SQL

  .
• Deep understanding of distributed computing and Spark for data processing.
• Experience with data integration and ETL tools, including

  Azure Data Factory.

Advanced-level knowledge and practice of:

• Data warehouse and data lake concepts and architectures.
• Optimizing performance of databases and servers.
• Managing infrastructure for storage and compute resources.
• Writing unit tests and scripts.
• Git, GitHub, and CI/CD practices.

Good to Have:

• Experience with big data technologies, such as

  Kafka

  ,

  Hadoop

  , and

  Hive

  .
• Familiarity with

  Azure Databricks Medallion Architecture

  with DLT and Iceberg.
• Experience with semantic layers and reporting tools like

  Power BI

  .

Relevant Work Experience:

• 5+ years of experience as a Data Engineer, ETL Developer, or similar role, with a focus on Databricks and Spark.
• Experience working on internal, business-facing teams.
• Familiarity with agile development environments.

Education and Training:

• Bachelor's degree in computer science, Engineering, or a related field, or equivalent work experience.