Data Quality Engineer

As a Data Quality Engineer (Automation) at our company, you will play a vital role in ensuring the integrity and quality of our data engineering processes. Your responsibilities will include: - Designing, developing, and executing automated test scripts to validate ETL workflows and data pipelines. - Performing end-to-end data validation, reconciliation, and DWH/DB testing across large datasets. - Collaborating with data engineers, analysts, and stakeholders to define test strategies and uphold data quality standards. - Developing reusable and scalable test automation frameworks using Python and SQL. - Integrating automated tests into CI/CD pipelines to guarantee continuous testing and delivery. - Validating data transformation logic and completeness across various cloud platforms such as Azure, AWS, and GCP. - Participating in Agile ceremonies and contributing to sprint planning, retrospectives, and story grooming. Qualifications required for this role include: - 3+ years of experience in ETL automation and Data Warehouse/Data Lake testing. - Proficiency in SQL for data validation and test automation. - Good knowledge of Python for scripting and framework development. - Experience with one or more Test Automation Frameworks. - Exposure to Cloud Data Services across major platforms like Azure (ADF, ADB), AWS (Glue, Lambda, Redshift), and GCP (BigQuery). - Understanding of CI/CD tools and practices such as Jenkins, Git, and Azure DevOps. - Familiarity with Agile/Scrum methodologies. Additionally, it would be beneficial if you have: - Experience working with data observability or data quality tools like Great Expectations or Deequ. - Basic understanding of data governance and metadata management concepts. - Certification in cloud platforms (Azure/AWS/GCP) would be a plus.,