Big Data & ETL Tester

2 - 7 years

7 - 11 Lacs

Posted:6 hours ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

  • Collaborate with big data engineers to validate data pipelines and ensure data integrity across ingestion, processing, and transformation stages.
  • Write complex

    PySpark

    and

    SQL

    queries to test and validate large-scale datasets.
  • Perform

    ETL testing

    , covering schema validation, data completeness, accuracy, transformation logic, and performance testing.
  • Conduct root cause analysis of data issues using structured debugging approaches.
  • Build automated test scripts in

    Python

    for regression, smoke, and end-to-end data testing.
  • Analyze large datasets to track

    KPIs

    and performance metrics supporting business operations and strategic decisions.
  • Work with data analysts and business teams to translate business needs into testable data validation frameworks.
  • Communicate testing results, insights, and data gaps via reports or dashboards (Superset/Power BI preferred).
  • Identify and document areas of improvement in data processes and advocate for automation opportunities.
  • Maintain detailed documentation of test plans, test cases, results, and associated dashboards.

Required Skills and Qualifications

  • 2+ years of experience in

    big data testing

    and

    ETL testing

    .
  • Strong hands-on skills in

    PySpark

    ,

    SQL

    , and

    Python

    .
  • Solid experience working with

    cloud platforms

    , especially

    AWS (S3, EMR, Glue, Lambda, Athena, etc.)

    .
  • Familiarity with

    data warehouse

    and

    lakehouse

    architectures.
  • Working knowledge of

    Apache Superset

    ,

    Power BI

    , or similar visualization tools.
  • Ability to analyze large, complex datasets and provide actionable insights.
  • Strong understanding of data modeling concepts, data governance, and quality frameworks.
  • Experience with automation frameworks and CI/CD for data validation is a plus.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

pune, gurugram, bengaluru