Senior Data Engineer - Iceberg, AWS, Oracle Migration ( 8+ Yrs Exp. )

8 years

0 Lacs

Posted:3 weeks ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Job Title: Senior Data Engineer – Iceberg, AWS, Oracle Migration,

Location: Offshore/India

Experience Level: 8+ Years


About the Role:

Senior Data Engineer


Key Responsibilities:

  • Design and implement scalable

    batch and real-time data pipelines

    using Apache Iceberg, AWS services, and streaming technologies bi-directional data synch mechanisms.
  • Lead

    data migration projects from Oracle

    to cloud-native data lakes and warehouses.
  • Architect and manage

    real-time data ingress and egress

    using tools like

    Kafka, Kinesis, or Flink

    .
  • Build and maintain

    data abstraction layers

    (e.g., APIs, semantic layers) to enable secure and simplified data access.
  • Optimize data storage, partitioning, and schema evolution strategies in Iceberg.
  • Leverage

    Presto/Trino

    for federated querying and interactive analytics across heterogeneous data sources.
  • Collaborate with business, data scientists, analysts, and engineers to deliver high-quality, reliable data solutions.
  • Implement robust monitoring, alerting, and data quality frameworks.


Required Qualifications:

  • 8+ years of experience in data engineering or related roles.
  • Strong production experience with

    Apache Iceberg

    and

    AWS data stack

    (S3, Glue, Athena, EMR, Redshift).
  • Hands-on experience with

    real-time data processing

    using Kafka, Kinesis, Flink, or Spark Structured Streaming.
  • Proven expertise in

    data migration from Oracle

    , including schema translation and performance optimization.
  • Proficiency in

    SQL

    ,

    Python

    , and

    Spark

    .
  • Experience with

    Presto or Trino

    for distributed querying and federated data access.
  • Familiarity with building

    data abstraction mechanisms

    ,API, Stored Procedures.
  • Experience with CI/CD, infrastructure-as-code (Terraform, CloudFormation), and DevOps practices.
  • Strong understanding of data governance, security, and compliance in cloud environments.


Preferred Qualifications:

  • Experience with other table formats like Delta Lake or Hudi.
  • Familiarity with data cataloging tools (e.g., AWS Glue Data Catalog, Apache Hive Metastore).
  • Oracle Exp
  • Strong experience with

    Oracle RDBMS

    , including PL/SQL, performance tuning, and data extraction strategies.
  • Familiarity with

    Oracle GoldenGate

    or similar tools for real-time data replication and migration.
  • Experience with

    Oracle Data Integrator (ODI)

    or other ETL tools used in Oracle ecosystems
  • Exposure to containerization and orchestration (Docker, Kubernetes).

Experience with data mesh or domain-oriented data architecture.

Mock Interview

Practice Video Interview with JobPe AI

Start DevOps Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now