Data Engineer - PySpark / Kafka

4 - 9 years

8 - 9 Lacs

Posted:1 week ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

Data Engineer - PySpark / Kafka
2 - 4 Years

Role Overview

We are looking for an experienced

Data Engineer

with

2 4 years of hands-on experience

in building scalable data pipelines and processing large datasets. The ideal candidate must have strong expertise in

PySpark

and exposure to real-time or streaming frameworks such as

Apache Flink

. You will work closely with architects, data scientists, and product teams to design and deliver robust, high-performance data solutions.

Key Responsibilities

Design, develop, and maintain scalable

ETL/ELT data pipelines

real-time or near real-time data processing

  • Optimize data workflows for performance, scalability, and reliability.
  • Work with large-scale data platforms and distributed environments.
  • Collaborate with cross-functional teams to integrate data solutions into products and analytics platforms.
  • Ensure data quality, integrity, and governance across pipelines.
  • Conduct performance tuning, debugging, and root-cause analysis of data processes.
  • Write clean, modular, and well-documented code following best engineering practices.
  • Primary Skills

    Strong hands-on experience in (RDD, DataFrame API, Spark SQL). (streaming or batch).
  • Solid understanding of distributed computing concepts.
  • for data engineering workflows.
  • Strong SQL skills for data manipulation and transformation.
  • Experience with data pipeline orchestration tools (Airflow, Step Functions, etc.).
  • Secondary Skills

    • Experience with cloud platforms (AWS / Azure / GCP).
    • Knowledge of data lakes, lakehouse architectures, and modern data stack tools.
    • Familiarity with Delta Lake, Iceberg, or Hudi.
    • Experience with CI/CD pipelines for data workflows.
    • Understanding of messaging/streaming systems (Kafka, Kinesis).
    • Knowledge of DevOps and container tools (Docker).

    Soft Skills

    • Strong analytical and problem-solving capabilities.
    • Ability to work independently and as part of a collaborative team.
    • Good communication and documentation skills.
    • Ownership mindset and willingness to learn and adapt.
    Bachelor s or Master s degree in Computer Science, Engineering, Information Technology, or a related field.

    Why Join Oneture Technologies

    • Opportunity to work on high-impact, cloud-native data engineering projects.
    • Collaborative team environment with strong learning culture.
    • Exposure to modern data platforms, scalable architectures, and real-time data systems.
    • Growth-oriented role with hands-on ownership in end-to-end data engineering initiatives.

    About Oneture Technologies

    Founded in 2016, Oneture is a cloud-first, full-service digital solutions company, helping clients harness the power of Digital Technologies and Data to drive transformations and turning ideas into business realities.
    Our team is full of curious, full-stack, innovative thought leaders who are dedicated to providing outstanding customer experiences and building authentic relationships. We are compelled by our core values to drive transformational results from Ideas to Reality for clients across all company sizes, geographies, and industries. The Oneture team delivers full lifecycle solutions from ideation,
    project inception, planning through deployment to ongoing support and maintenance.
    Our core competencies and technical expertise includes Cloud powered: Product Engineering, Big Data and AI ML. Our deep commitment to value creation for our clients and partners and Startups-like agility with Enterprises-like maturity philosophy has helped us establish long-term relationships with our clients and enabled us to build and manage mission-critical platforms for them.

    Mock Interview

    Practice Video Interview with JobPe AI

    Start Python Interview
    cta

    Start Your Job Search Today

    Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

    Job Application AI Bot

    Job Application AI Bot

    Apply to 20+ Portals in one click

    Download Now

    Download the Mobile App

    Instantly access job listings, apply easily, and track applications.

    coding practice

    Enhance Your Python Skills

    Practice Python coding challenges to boost your skills

    Start Practicing Python Now
    Oneture Technologies logo
    Oneture Technologies

    Information Technology

    Innovation City

    RecommendedJobs for You