Senior Quality Engineer

• The Candidate is expected to work on large datasets and will be involved in ETL testing, and thorough validation between the source and target
• Develop and execute test plans, test cases, and scripts to validate data accuracy, completeness, and integrity.
• Perform functional, integration, regression, and performance testing of data pipelines, ETL processes, and databases.
• Identify and investigate data anomalies, inconsistencies, and discrepancies; troubleshoot and resolve data quality issues.
• Collaborate with data engineers, data architects, business analysts, and other stakeholders to understand data requirements and ensure data quality standards are met.
• Document test plans, test results, and data quality issues; communicate findings and recommendations effectively to technical and non-technical stakeholders
• Recommend and implement improvements to data quality processes, tools, and methodologies.
• Automate data validation and testing processes where possible to improve efficiency and accuracy.

Requirements - Must Have Skills:

• 6+ years
  of total technical experience on ETL testing
• Experience in developing ETL test plans, test cases and validating large scale data migrations.
• Strong understanding of ETL processes, SQL, Spark, Hive and data migration
• Advanced proficiency in writing SQL queries, hands-on experience with Hive, Spark, Spark SQL and data frame API.
• Experience with Snowflake data warehousing.
• Experience with data quality automation tools and frameworks.
• Ability to document and present findings clearly and concisely.
• Excellent verbal and written communication skills.
• Strong analytical and problem-solving skills.
• Need to be excellent team player.