Senior Test Engineer - ETL, SQL, Databricks

Experience: Minimum 6 - 8 Years

Shift: 5PM - 2 AM (US Shift)

Mode of work: Work from Home

Location: Hyderabad Only

Qualifications

Experience

• 6 - 10+ years in Quality Engineering, particularly in data/ETL testing; leadership in Data Modernization initiatives preferred.
• Proven track record with Azure Databricks, Azure Data Factory, ADLS Gen2, Synapse Analytics, Azure SQL, and Power BI.

Technical Proficiency

• Strong coding skills in Python, PySpark, Scala, SQL, (Java is a plus) for automation and data validations.
• Expertise in ETL testing, data pipeline frameworks (ingestion, profiling, DataOps) and Unity Catalog.
• Good understanding of data governance, profiling, ingestion, and data quality validation.

Automation & DevOps

• Strong knowledge of test automation frameworks, CI/CD (Azure DevOps, Git), and experience integrating test frameworks into pipelines.

Soft Skills

• Excellent analytical, problem-solving and communication abilities.
• Stakeholder management and coordination skills across matrix environments.
• Self-motivated with proactive mindset.

Education

Bachelor’s or Master’s in Computer Science, Engineering, IT, or related.

Key Roles & Responsibilities

Strategy & Leadership

• Develop and implement comprehensive test strategies for Azure-Databricks ecosystems
• Lead and mentor QA/testing teams, coaching best practices and maintaining QE documentation.
• Act as the primary point-of-contact for all data testing activities

Test Planning & Execution

• Plan, design, and oversee test cases across functional, UAT, E2E, and performance domains.
• Validate ETL pipelines via SQL, Python, PySpark, Scala; ensure data accuracy in Azure Data Factory, Synapse, and Databricks.

Automation & Tooling

• Build and maintain automated testing frameworks integrated with CI/CD pipelines.
• Utilize test automation tools and data validation frameworks like Great Expectations.
• Use Databricks capabilities such as Delta Live Tables, Unity Catalog, and built-in workflows for monitoring and orchestration.

Performance & Quality

• Identify performance bottlenecks and guide performance/security testing efforts.
• Implement data governance, profiling, data ingestion validation, and pipeline monitoring.
• Documentation & Metrics
• Track QE progress, metrics, and communicate risks to stakeholders.
• Maintain detailed test cases, validation rules, defect logs, and automation artifacts.

Collaboration & Stakeholder Management

• Coordinate with data engineering, infrastructure, and business teams to resolve issues.
• Participate in Agile rituals like sprint planning and retrospectives.

Optional/Domain-specific Add-ons:

• Domain experience (e.g., HealthCare Exp)—bonus.
• Familiarity with Power BI as ETL visualization tool.
• Certifications in Azure or Databricks (e.g., Azure Data Engineer, Databricks Associate)

Background Verification of the candidates will be done.

Strictly NO moonlighting.