ETL Tester with Java

Role Overview

We are looking for a highly skilled ETL Tester to join our team. In this role, you will collaborate closely with development teams and product managers to design, develop, and maintain robust software applications. You should be comfortable working on both client-side and server-side architectures, ensuring the delivery of scalable, reliable, and high-performing solutions.

Key Responsibilities

Collaborate with development teams and product managers to design and develop software applications.

Design and work with client-side and server-side architectures.

Build reliable, scalable applications and features with responsive design principles.

Test, troubleshoot, debug, and upgrade software to ensure high performance and efficiency.

Develop and maintain well-functioning databases and applications.

Work in an Agile environment using tools such as JIRA boards.

Optimize Spark jobs for performance, including executor/driver sizing, memory management, adaptive query execution, and join strategies.

Must-Have Qualifications

3+ years of hands-on experience building and maintaining ETL/ELT pipelines.

Strong problem-solving skills using data structures and algorithms in Java.

Expertise in Apache Spark performance tuning (executor/driver sizing, memory management, adaptive query execution, broadcast vs. shuffle joins).

Proficiency in SQL (complex joins, window functions, performance tuning) on relational databases such as DB2 or MySQL.

Knowledge of database creation and maintenance (DB2, MySQL).

Working knowledge of at least one scripting language (Shell).

Familiarity with job scheduling/workflow orchestration tools (Control-M).

Good-to-Have Skills

Understanding of microservices architecture.

Basic knowledge of web applications and their working.

Exposure to Linux-based environments.

Experience with source control tools (Git) and CI/CD pipelines (Jenkins).