Sr. QA Automation Engineer

Role Overview: You will lead the development of an automated test framework for financial data pipelines using PySpark/Python and AWS services (e.g., Glue, Athena, EMR, Redshift). Your responsibilities will include writing test cases based on product requirements, executing them, and reporting any issues. Additionally, you will automate data validation for financial data sets, ensuring data consistency and correctness across distributed systems. You will collaborate with data analysts, portfolio managers, and quant researchers to define test requirements and ensure data quality in financial data sets. Furthermore, you will optimize test processes, create reports and frameworks for efficiency, and integrate new tools and best practices for cloud-based systems. Key Responsibilities: - Lead the development of an automated test framework for financial data pipelines using PySpark/Python and AWS services. - Write test cases based on product requirements, execute them, and report issues. - Automate data validation for financial data sets to ensure data consistency and correctness across distributed systems. - Collaborate with various teams to define test requirements and ensure data quality in financial data sets. - Optimize test processes, create reports, and frameworks for efficiency in cloud-based systems. Qualifications Required: - Bachelors or MBA/Masters degree in a quantitative, financial discipline, or engineering. - 3 years of hands-on experience in QA automation with a focus on data-driven financial solutions, preferably in an AWS environment. - Strong knowledge of testing frameworks for API and data-driven test automation. - Hands-on experience with integrating test automation into Code Pipeline or cloud-based CI/CD systems. - Proficiency in SQL and MS Excel for working with large financial datasets. - Experience in performance testing and load testing for large financial data applications. - Strong proficiency in Python with extensive experience using PySpark. - Expertise in AWS services including S3, Glue, EMR for designing and automating testing for financial data systems in the cloud. - Basic understanding of financial data analysis workflows and key financial metrics. - Experience with AWS CDK, CloudFormation, or Terraform for infrastructure automation. - Excellent problem-solving skills and communication skills. - Highly motivated, pro-active, and passionate about continuous learning.,