Data Engineer

4 years

0 Lacs

Posted:2 days ago| Platform: Linkedin logo

Apply

Work Mode

Remote

Job Type

Full Time

Job Description

Job Title: Cloud Data Engineer + QA

Experience:

Location:

Work Timings:

About the Role

Cloud Data Engineer + QA

This role requires a blend of engineering expertise, data migration experience, and strong data validation and quality assurance skills.

Key Responsibilities

  • Design, develop, and implement scalable data platform solutions using

    Azure Data Factory (ADF)

    ,

    Self-hosted Integration Runtime (SHIR)

    ,

    Logic Apps

    ,

    Azure Data Lake Storage Gen2 (ADLS Gen2)

    ,

    Blob Storage

    , and

    Snowflake

    .
  • Review and analyze existing

    on-premises ETL workflows

    built using

    SSIS

    and

    T-SQL

    .
  • Implement

    DevOps and CI/CD pipelines

    using

    Git Actions

    to automate data workflows.
  • Collaborate with cross-functional teams to ensure seamless

    data migration and integration

    across systems.
  • Optimize and troubleshoot

    data pipelines

    for performance, scalability, and reliability.
  • Ensure

    data security

    , governance, and compliance with organizational and industry standards.
  • Conduct

    data validation and QA testing

    to ensure consistency between

    on-premises SQL Server

    and

    cloud-based Azure/Snowflake

    environments.
  • Document all processes, test cases, and validation results clearly and accurately.

Required Qualifications

  • 3–4+ years of experience as a

    Cloud Data Engineer

    or

    Data Engineer (QA)

    .
  • Hands-on experience with

    Azure Cloud data tools

    (ADF, SHIR, Logic Apps, ADLS Gen2, Blob Storage) and

    Snowflake

    .
  • Strong proficiency in

    SQL Server

    ,

    SSIS

    , and

    T-SQL

    for ETL development and data analysis.
  • Working knowledge of

    Python

    or similar scripting languages for data processing and validation.
  • Experience with

    DevOps practices

    and

    CI/CD pipelines

    using Git Actions.
  • Familiarity with

    Agile/Scrum

    methodologies and collaborative development environments.
  • Excellent

    problem-solving

    ,

    analytical

    , and

    debugging

    skills.
  • Strong communication and teamwork abilities.
  • Proven experience in

    data validation

    ,

    unit testing

    , and

    QA documentation

    for data migration projects.

Preferred Skills (Nice to Have)

  • Experience with

    data observability

    tools or frameworks.
  • Knowledge of

    data governance and cataloging

    solutions.
  • Exposure to

    cloud cost optimization

    and

    monitoring best practices

    .

Mock Interview

Practice Video Interview with JobPe AI

Start DevOps Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You

chennai, tamil nadu, india

pune, maharashtra, india

pune, maharashtra, india

pune, maharashtra, india