Senior ETL Test Engineer - SQL Databricks

Company Description

hiReign Innoways is an IT Services, Consulting, and Business Solutions provider dedicated to helping clients build agile and innovative organizations. We specialize in optimizing current operations to enhance efficiency and cost-effectiveness, enabling clients to unlock new potential for growth and transformation. Our customer-focused methodologies and tailored approaches ensure solutions aligned with your domain and technological needs. Collaboration is at the core of our philosophy, as we work closely with clients to analyze challenges, channel expertise, and achieve successful transformation.

Role Description

This is a full-time hybrid role for a Senior ETL Test Engineer - SQL Databricks, based in Hyderabad, allowing some work-from-home flexibility. The Senior ETL Test Engineer will play a critical role in designing, executing, and automating efficient testing frameworks. Responsibilities include developing and analyzing test cases, performing functional testing, collaborating with development teams, and ensuring data integrity through rigorous ETL testing processes.

Experience

Shift

Mode of work

Location

Notice Period

Qualifications

• 6 - 10+ years in Quality Engineering, particularly in data/ETL testing; leadership in Data Modernization initiatives preferred.
• Proven track record with Azure Databricks, Azure Data Factory, ADLS Gen2, Synapse Analytics, Azure SQL, and Power BI.
• Strong skills in Test Engineering, Test Execution, and Test Cases design
• Proficiency in Testing, including Functional Testing and ETL testing processes
• Experience with SQL, Databricks, and other data processing technologies is highly desirable
• Excellent analytical, problem-solving, and collaboration skills
• Ability to manage tasks in a hybrid work environment and effectively communicate with cross-functional teams

Technical Proficiency

• Strong coding skills in Python, PySpark, Scala, SQL, (Java is a plus) for automation and data validations.
• Expertise in ETL testing, data pipeline frameworks (ingestion, profiling, DataOps) and Unity Catalog.
• Good understanding of data governance, profiling, ingestion, and data quality validation.

Automation & DevOps

• Strong knowledge of test automation frameworks, CI/CD (Azure DevOps, Git), and experience integrating test frameworks into pipelines.

Soft Skills

• Excellent analytical, problem-solving and communication abilities.
• Stakeholder management and coordination skills across matrix environments.
• Self-motivated with proactive mindset.

Education

Bachelor's or Master's in Computer Science, Engineering, IT, or related.

Key Roles & Responsibilities

Strategy & Leadership

• Develop and implement comprehensive test strategies for Azure-Databricks ecosystems
• Lead and mentor QA/testing teams, coaching best practices and maintaining QE documentation.
• Act as the primary point-of-contact for all data testing activities

Test Planning & Execution

• Plan, design, and oversee test cases across functional, UAT, E2E, and performance domains.
• Validate ETL pipelines via SQL, Python, PySpark, Scala; ensure data accuracy in Azure Data Factory, Synapse, and Databricks.

Automation & Tooling

• Build and maintain automated testing frameworks integrated with CI/CD pipelines.
• Utilize test automation tools and data validation frameworks like Great Expectations.
• Use Databricks capabilities such as Delta Live Tables, Unity Catalog, and built-in workflows for monitoring and orchestration.

Performance & Quality

• Identify performance bottlenecks and guide performance/security testing efforts.
• Implement data governance, profiling, data ingestion validation, and pipeline monitoring.
• Documentation & Metrics
• Track QE progress, metrics, and communicate risks to stakeholders.
• Maintain detailed test cases, validation rules, defect logs, and automation artifacts.

Collaboration & Stakeholder Management

• Coordinate with data engineering, infrastructure, and business teams to resolve issues.
• Participate in Agile rituals like sprint planning and retrospectives.

Optional/Domain-specific Add-ons

• Domain experience (e.g., HealthCare Exp)bonus.
• Familiarity with Power BI as ETL visualization tool.
• Certifications in Azure or Databricks (e.g., Azure Data Engineer, Databricks Associate)