Lead I - Software Testing (Bigdata QA)

4 years

0 Lacs

Posted:4 days ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Role Description

Job Description We are looking for a skilled Big Data QA Engineer tojoin our team and ensure the quality and reliability of our data processingpipelines. This role involves designing and executing both automated and manualtests for batch workflows, validating data integrity across transformationstages, and maintaining a robust Python-based test automation framework. Theideal candidate will have hands-on experience with AWS services, big dataformats, and a strong understanding of testing methodologies in a data-centricenvironment. Preferred Skills and Experience: Design, develop, and executeautomated and manual batch test cases for data processing pipelines. Validatedata integrity and transformation logic across multiple stages of batchworkflows. Monitor and troubleshoot batch job failures, performance issues, anddata mismatches. Maintain and enhance Python-based test automation suite andframework. Evaluates system performance, reproduces issues, and works withdevelopment teams to resolve identified problems. Collaborates effectively withpeers and management to improve application quality and testing processes.Minimum 4 years of experience with a focus on batch testing and datavalidation. Strong proficiency in Python for test automation and scripting.Hands-on experience with AWS services such as S3, Lambda, EMR, and Athena.Experience with data formats like JSON, Parquet, and CSV, and tools like Pandasand PySpark. Familiarity with version control systems (e.g., Git) and CI/CDtools (e.g., Jenkins, GitHub Actions). Solid understanding of software testingmethodologies, including regression, integration, and system testing. Abilityto analyze logs and metrics to identify root causes of failures. Experienceworking with agile methodology. Excellent verbal and written communicationskills, and ability to collaborate with cross-functional teams.Minimum 4 years of experience with a focus on batch testing and datavalidation. Strong proficiency in Python for test automation and scripting.Hands-on experience with AWS services such as S3, Lambda, EMR, and Athena.Experience with data formats like JSON, Parquet, and CSV, and tools like Pandasand PySpark. Familiarity with version control systems (e.g., Git) and CI/CDtools (e.g., Jenkins, GitHub Actions). Solid understanding of software testingmethodologies, including regression, integration, and system testing. Abilityto analyze logs and metrics to identify root causes of failures. Experienceworking with agile methodology. Excellent verbal and written communicationskills, and ability to collaborate with cross-functional teams. Bachelor sdegree in Computer Science or equivalent preferred.

Skills

big data testing,big data,qa,automated testing,

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
UST logo
UST

IT Services and IT Consulting

Aliso Viejo CA

RecommendedJobs for You