Senior Test Engineer - Databricks, ETL, ADF, SQL

Company Description

hiReign Innoways is a provider of IT Services, Consulting, and Business Solutions. We enable our clients to enhance the efficiency of their current operations, making them more cost-effective, which in turn allows investments in innovation and unleashes new potential across organizations. Our customer-focused approach offers specialized services and solutions tailored to specific domain and technology requirements. We believe in collaboration, working closely with clients to understand their business, analyze challenges, and guide them through transformation.

Experience

Shift:

Mode of work

Location

Key Roles & Responsibilities:

Strategy & Leadership

• Develop and implement comprehensive test strategies for Azure-Databricks ecosystems
• Lead and mentor QA/testing teams, coaching best practices and maintaining QE documentation.
• Act as the primary point-of-contact for all data testing activities

Test Planning & Execution

• Plan, design, and oversee test cases across functional, UAT, E2E, and performance domains.
• Validate ETL pipelines via SQL, Python, PySpark, Scala; ensure data accuracy in Azure Data Factory, Synapse, and Databricks.

Automation & Tooling

• Build and maintain automated testing frameworks integrated with CI/CD pipelines.
• Utilize test automation tools and data validation frameworks like Great Expectations.
• Use Databricks capabilities such as Delta Live Tables, Unity Catalog, and built-in workflows for monitoring and orchestration.

Performance & Quality

• Identify performance bottlenecks and guide performance/security testing efforts.
• Implement data governance, profiling, data ingestion validation, and pipeline monitoring.
• Documentation & Metrics
• Track QE progress, metrics, and communicate risks to stakeholders.
• Maintain detailed test cases, validation rules, defect logs, and automation artifacts.

Collaboration & Stakeholder Management

• Coordinate with data engineering, infrastructure, and business teams to resolve issues.
• Participate in Agile rituals like sprint planning and retrospectives.

Qualifications:

Experience

• 6 - 10+ years in Quality Engineering, particularly in data/ETL testing; leadership in Data Modernization initiatives preferred.
• Proven track record with Azure Databricks, Azure Data Factory, ADLS Gen2, Synapse Analytics, Azure SQL, and Power BI.

Technical Proficiency

• Strong coding skills in Python, PySpark, Scala, SQL, (Java is a plus) for automation and data validations.
• Expertise in ETL testing, data pipeline frameworks (ingestion, profiling, DataOps) and Unity Catalog.
• Good understanding of data governance, profiling, ingestion, and data quality validation.

Automation & DevOps

• Strong knowledge of test automation frameworks, CI/CD (Azure DevOps, Git), and experience integrating test frameworks into pipelines.

Soft Skills

• Excellent analytical, problem-solving and communication abilities.
• Stakeholder management and coordination skills across matrix environments.
• Self-motivated with proactive mindset.

Education

Bachelor’s or Master’s in Computer Science, Engineering, IT, or related.

Optional/Domain-specific Add-ons:

• Domain experience (e.g., HealthCare Exp)—bonus.
• Familiarity with Power BI as ETL visualization tool.
• Certifications in Azure or Databricks (e.g., Azure Data Engineer, Databricks Associate)

Background Verification of the candidates will be done.

Strictly NO moonlighting.