Job
Description
As a QA Specialist specializing in ETL & Kafka, your role will involve ensuring data accuracy, system reliability, and seamless integration across distributed systems. You will be responsible for performing comprehensive testing of ETL workflows, data pipelines, and data transformations. Additionally, you will validate data ingestion, streaming, and processing across Kafka topics, producers, and consumers. Your key responsibilities will include: - Performing comprehensive testing of ETL workflows, data pipelines, and data transformations. - Validating data ingestion, streaming, and processing across Kafka topics, producers, and consumers. - Executing functional, integration, regression, and performance testing across big data & streaming systems. - Developing and maintaining detailed test plans, test cases, and test scripts. - Performing SQL-based validation for data integrity, reconciliation, and end-to-end data flow checks. - Troubleshooting issues, performing root-cause analysis, and collaborating with developers & data engineers to close defects. - Working closely with product, QA, and engineering teams to ensure high-quality releases. - Documenting defects in Jira/bug tracking tools and maintaining QA process compliance. To excel in this role, you should possess the following skills and expertise: - 35 years of experience in Software QA, with a strong expertise in ETL/Data Pipeline testing. - Hands-on experience with Apache Kafka, including message validation, offset checks, topic-level testing, and streaming validation. - Strong SQL skills for data validation and reconciliation. - Understanding of data warehousing concepts, ETL tools, and batch/real-time processing. - Familiarity with big data ecosystem tools (Hadoop, Spark, Hive, etc.). - Experience using Jira, Confluence, Test Management tools, and API testing tools (Postman/Swagger). - Ability to debug issues independently and work closely with cross-functional teams. - Strong analytical, communication, and documentation abilities. Good to have skills include exposure to Python/automation for data pipeline validation, experience with CI/CD tools (Jenkins, GitLab, Azure DevOps), and basic knowledge of cloud platforms (AWS/Azure/GCP). Please note that this is a full-time, permanent role with the work location being in person at Noida. As a QA Specialist specializing in ETL & Kafka, your role will involve ensuring data accuracy, system reliability, and seamless integration across distributed systems. You will be responsible for performing comprehensive testing of ETL workflows, data pipelines, and data transformations. Additionally, you will validate data ingestion, streaming, and processing across Kafka topics, producers, and consumers. Your key responsibilities will include: - Performing comprehensive testing of ETL workflows, data pipelines, and data transformations. - Validating data ingestion, streaming, and processing across Kafka topics, producers, and consumers. - Executing functional, integration, regression, and performance testing across big data & streaming systems. - Developing and maintaining detailed test plans, test cases, and test scripts. - Performing SQL-based validation for data integrity, reconciliation, and end-to-end data flow checks. - Troubleshooting issues, performing root-cause analysis, and collaborating with developers & data engineers to close defects. - Working closely with product, QA, and engineering teams to ensure high-quality releases. - Documenting defects in Jira/bug tracking tools and maintaining QA process compliance. To excel in this role, you should possess the following skills and expertise: - 35 years of experience in Software QA, with a strong expertise in ETL/Data Pipeline testing. - Hands-on experience with Apache Kafka, including message validation, offset checks, topic-level testing, and streaming validation. - Strong SQL skills for data validation and reconciliation. - Understanding of data warehousing concepts, ETL tools, and batch/real-time processing. - Familiarity with big data ecosystem tools (Hadoop, Spark, Hive, etc.). - Experience using Jira, Confluence, Test Management tools, and API testing tools (Postman/Swagger). - Ability to debug issues independently and work closely with cross-functional teams. - Strong analytical, communication, and documentation abilities. Good to have skills include exposure to Python/automation for data pipeline validation, experience with CI/CD tools (Jenkins, GitLab, Azure DevOps), and basic knowledge of cloud platforms (AWS/Azure/GCP). Please note that this is a full-time, permanent role with the work location being in person at Noida.
