Posted:1 day ago|
Platform:
On-site
Full Time
Job Description- Big Data Test Engineer with Python/Shell Script Automation
Role:
Support development and maintain automated test frameworks, tools, and test cases for Data Engineering and Data Warehouse (DWH) applications.
Collaborate with cross-functional teams including software developers, data engineers, and data analysts to ensure comprehensive testing coverage and adherence to quality standards.
Conduct thorough testing of data pipelines, ETL processes, and data transformations using Big Data technologies.
Apply knowledge of Data Warehouse/Data Lake methodologies and best practices to validate data accuracy, completeness, and performance.
Perform end-to-end QE testing across DWH systems, including data ingestion, transformation, storage, and reporting layers.
Identify, document, and track software defects; work closely with development teams to ensure timely resolution.
Participate in code reviews, design discussions, and quality assurance meetings to provide insights and drive improvements.
Base Skill Requirements:
Must Technical
Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
5-9 years of experience in software testing and development, with a focus on data-intensive applications.
Proven experience in testing data pipelines and ETL processes - Test planning, Test Environment planning, End to End testing, Performance testing.
Solid programming skills in Python - proven automation effort to bring efficiency in the test cycles.
Solid understanding of Data models and SQL .
Must have experience with ETL (Extract, Transform, Load) processes and tools (Scheduling and Orchestration tools, ETL Design understanding)
Good understanding of Big Data technologies like Spark, Hive, and Impala.
Understanding of Data Warehouse methodologies, applications, and processes.
Experience working in an Agile/Scrum environment, with a solid understanding of user stories, acceptance criteria, and sprint cycles.
Optional Technical
Experience with scripting languages like Bash or Shell.
Experience working with large-scale datasets and distributed data processing frameworks (e.g., Hadoop, Spark).
Familiarity with data integration tools like Apache NiFi is a plus.
Excellent problem-solving and debugging skills, with a keen eye for detail.
Strong communication and collaboration skills to work effectively in a team-oriented environment.
Eagerness to learn and contribute to a growing team.
Mastercard
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
Practice Python coding challenges to boost your skills
Start Practicing Python Now
15.0 - 30.0 Lacs P.A.
Salary: Not disclosed
pune, maharashtra, india
Salary: Not disclosed
pune, maharashtra, india
Experience: Not specified
Salary: Not disclosed
gurugram, haryana, india
Salary: Not disclosed
hyderabad, telangana, india
Salary: Not disclosed
gujarat, india
Salary: Not disclosed
Salary: Not disclosed
Salary: Not disclosed
noida, uttar pradesh, india
Salary: Not disclosed
