Data Engineer (TXS38FT RM 3741)

8 years

0 Lacs

pune maharashtra india

Posted:2 days ago| Platform: Linkedin logo

Apply

Skills Required

data hadoop analytics design reliability scalability etl storage security integrity compliance documentation architecture spark hive apache kafka python unix sql oracle server monitoring logging jenkins github engineering algorithms testing junit git

Work Mode

On-site

Job Type

Full Time

Job Description

Position: Data Engineer (TXS38FT RM 3741)

As a Data Engineer on our team, you will work on our Hadoop-based data warehouse, contributing to scalable and reliable big data solutions for analytics and business insights. This is a hands-on role focused on building, optimizing, and maintaining large data pipelines and warehouse infrastructure.

Key Responsibilities

  • Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance.
  • Implement data ETL processes for batch and streaming analytics requirements.
  • Optimize and troubleshoot distributed systems for ingestion, storage, and processing.
  • Collaborate with data engineers, analysts, and platform engineers to align solutions with business needs.
  • Ensure data security, integrity, and compliance throughout the infrastructure.
  • Maintain documentation and contribute to architecture reviews.
  • Participate in incident response and operational excellence initiatives for the data warehouse.
  • Continuously learn mindset and apply new Hadoop ecosystem tools and data technologies.

Required Skills And Experience

  • Proficiency in Hadoop ecosystems such as Spark, HDFS, Hive, Iceberg, Spark SQL.
  • Extensive experience with Apache Kafka, Apache Flink, and other relevant streaming technologies.
  • Proven ability to design and implement automated data pipelines and materialized views.
  • Proficiency in Python, Unix or similar languages.
  • Good understanding of SQL oracle, SQL server or similar languages.
  • Ops & CI/CD: Monitoring (Prometheus/Grafana), logging, pipelines (Jenkins/GitHub Actions).
  • Core Engineering: Data structures/algorithms, testing (JUnit/pytest), Git, clean code.
  • 3 – 8 years of directly applicable experience
  • BS in Computer Science, Engineering, or equivalent experience.

  • More Jobs at Source-Right

    Absli (versant 4) Renewal (TC0FF RM 3375)

    thane, maharashtra, india

    Experience: Not specified

    |

    Salary: Not disclosed

    IDFC Cross-Selling Associate (versant3/4) (TC0FF RM 3373)

    thane, maharashtra, india

    Experience: Not specified

    |

    Salary: Not disclosed

    Yes Bank sales (versant 3) (TC0FF RM 3377)

    thane, maharashtra, india

    Experience: Not specified

    |

    Salary: Not disclosed

    BOI (versant 3) remainder calling / Inbound (TC0FF RM 3381)

    thane, maharashtra, india

    Experience: Not specified

    |

    Salary: Not disclosed

    All DRA collection (versant 3) (TC0FF RM 3379)

    thane, maharashtra, india

    Experience: Not specified

    |

    Salary: Not disclosed

    Mock Interview

    Practice Video Interview with JobPe AI

    Start Python Interview
    cta

    Start Your Job Search Today

    Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

    Job Application AI Bot

    Job Application AI Bot

    Apply to 20+ Portals in one click

    Download Now

    Download the Mobile App

    Instantly access job listings, apply easily, and track applications.

    Google Play App Store
    coding practice

    Enhance Your Python Skills

    Practice Python coding challenges to boost your skills

    Start Practicing Python Now
    Source-Right

    RecommendedJobs for You

    Data Engineer (TXS38FT RM 3741)

    Source-Right

    pune, maharashtra, india

    Data Engineer (TXS38FT RM 3741)

    Source-Right

    pune, maharashtra, india