Big Data Manual QA

Responsibilities:

• Develop and execute test scripts to validate data pipelines, transformations, and integrations.
• Formulate and maintain test strategies including smoke, performance, functional, and regression testing to ensure data processing and ETL jobs meet requirements.
• Collaborate with development teams to assess changes in data workflows and update test cases to preserve data integrity.
• Design and run tests for data validation, storage, and retrieval using Azure services like Data Lake, Synapse, and Data Factory, adhering to industry standards.
• Continuously enhance automated tests as new features are developed, ensuring timely delivery per defined quality standards.
• Participate in data reconciliation and verify Data Quality frameworks to maintain data accuracy, completeness, and consistency across the platform.
• Share knowledge and best practices by collaborating with business analysts and technology teams to document testing processes and findings.
• Communicate testing progress effectively with stakeholders, highlighting issues or blockers, and ensuring alignment with business objectives.
• Maintain a comprehensive understanding of the Azure Data Lake platforms data landscape to ensure thorough testing coverage.

Skills & Experience:

• 3-6 years of QA experience with a strong focus on Big Data testing, particularly in Data Lake environments on Azures cloud platform.
• Proficient in Azure Data Factory, Azure Synapse Analytics and Databricks for big data processing and scaled data quality checks.
• Proficiency in SQL, capable of writing and optimizing both simple and complex queries for data validation and testing purposes.
• Proficient in PySpark, with experience in data manipulation and transformation, and a demonstrated ability to write and execute test scripts for data processing and validation.
• Hands-on experience with Functional & system integration testing in big data environments, ensuring seamless data flow and accuracy across multiple systems.
• Knowledge and ability to design and execute test cases in a behaviour-driven development environment.
• Fluency in Agile methodologies, with active participation in Scrum ceremonies and a strong understanding of Agile principles.
• Familiarity with tools like Jira, including experience with X-Ray or Jira Zephyr for defect management and test case management.
• Proven experience working on high-traffic and large-scale software products, ensuring data quality, reliability, and performance under demanding conditions.

Important Notice: Recruitment Scams