Job Overview
We are seeking an experienced
Azure QA Engineer
with strong expertise in validating cloud-based data pipelines, ETL workflows, and big data solutions. The ideal candidate will have hands-on experience in Azure Databricks, Azure Data Factory, SQL-based validation, and ETL testing
to ensure data accuracy, reliability, and performance across modern analytics platforms.
Key Responsibilities
- Perform
functional, regression, integration, and end-to-end testing
for Azure-based data solutions. - Validate
ETL pipelines
developed using Azure Data Factory (ADF)
and Azure Databricks
, ensuring data quality and accuracy. - Review mapping documents, data models, and transformation logic to derive effective test scenarios and test cases.
- Conduct
SQL-based data validation
, including complex joins, aggregations, and data profiling. - Verify data ingestion, transformation, and consumption across
Data Lake, Databricks notebooks, ADF pipelines
, and downstream systems. - Perform
data reconciliation
, identify data gaps, and validate large datasets across distributed environments. - Collaborate closely with Data Engineers, Architects, and Product Owners to understand business rules and technical workflows.
- Participate in
CI/CD and automated testing processes
where applicable. - Document test results, defects, and quality metrics with clear communication to stakeholders.
- Ensure adherence to QA best practices, testing standards, and cloud governance guidelines.
Required Skills & Qualifications
- 5-12 years of hands-on QA experience with at least
3+ years in Azure data ecosystem
. - Strong expertise in
Azure Data Factory (ADF)
, Azure Databricks
, and ETL/Data pipeline testing
. - Proficiency in
SQL
for data validation, query optimization, and troubleshooting. - Experience with
Azure Data Lake
, Delta Lake, and related data storage technologies. - Good understanding of
data modeling, data transformation logic, and ETL frameworks
. - Ability to analyze large datasets and validate end-to-end data flows.
- Familiarity with
Agile methodologies
, version control (Git), and DevOps concepts. - Strong analytical, troubleshooting, communication, and documentation skills.
Preferred (Nice to Have)
- Experience with
PySpark / Spark-based validation
. - Exposure to automation frameworks for data testing.
- Knowledge of Azure services such as
Azure Synapse, Azure Functions, Logic Apps
, etc. - Understanding of data security, governance, and compliance in cloud environments.
Location:
PAN India Start Date:
Immediate Work Mode:
WFO Language Requirement:
English (Excellent written and verbal skills)