Data Test Engineer

Job Summary:

We are seeking an experienced Data Test Engineer to drive the testing strategy and execution for a project leveraging Databricks, Data Factory pipelines and Power BI. The ideal candidate will have expertise in testing data pipelines using Python, SQL, etc. along with experience in JIRA test management. Additionally, the role requires experience with GitHub/Bitbucket for version control, Jenkins for CI/CD automation, and BDD (Behaviour Driven Development) methodologies.

Key Responsibilities:

1. Test Strategy & Planning:

• Define and implement test strategies, test plans, and test cases tailored for ETL (Databricks, Data Factory, SQL, Blob), Power BI.

• Establish best practices for functional, regression, performance, and automation testing.

• Ensure proper test data management for data pipelines, analytics and reporting validations.

• Ensure test team adhere to J&J SDLC process.

2. Test Execution & Automation

• Lead/Execute manual and automated testing efforts across data pipelines, reports, and dashboards.

• Develop and execute test scripts using Python/SQL.

• Manage and track test execution using X-Ray integrated with JIRA.

• Validate data transformations, ETL processes, and BI visualizations for accuracy and performance.

• Implement test automation within Jenkins CI/CD pipelines to streamline deployment.

3. Defect Management & Reporting

• Identify, document, and track defects using JIRA, ensuring timely resolution.

• Work closely with developers and data engineers to ensure effective debugging and issue resolution.

• Create test summary/compliance report and Ensure Test summary report / CSR are completed and signed off on time for formal cycles

• Provide regular test progress reports and KPIs to stakeholders.

• Use Bitbucket/Github for version control, ensuring test scripts and frameworks are properly maintained.

4. Team Leadership & Collaboration:

• Lead and mentor a team of testers, ensuring alignment with project goals.

• Collaborate with Business Analysts, Platform Leads, Developers, Data Engineers, and Product Owners to ensure test coverage.

• Drive continuous improvement in QA processes, automation, and DevOps integration.

Required Skills & Qualifications:

• 5+ years of experience in data pipeline/ETL testing, with at least 2+ years as a Test Lead.
• Strong experience testing ETL workflows (Databricks, Data Factory workflows), SQL Data Warehouse, BI reports and dashboards.
• Hands-on experience with X-Ray for JIRA test management.
• Solid understanding of ETL testing, SQL queries, and data validation techniques.
• Experience with GitHub/Bitbucket for version control and Jenkins for CI/CD automation.
• Hands-on experience with BDD (Cucumber, SpecFlow, or similar frameworks).
• Experience in Agile methodologies, Scrum/Kanban, and DevOps integration.
• Strong analytical, problem-solving, and communication skills.
• Experience in cloud platforms supporting Databricks, Data Factory and SQL.
• Experience in SQL, Python for test automation in data pipelines.
• Experience with performance testing of BI reports and data warehouses.
• Familiarity in test automation using Robot Framework, Selenium.