Home
Jobs

Lead I - Software Engineering

6 years

0 Lacs

Posted:1 day ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Role Description

We are looking for an

Intermediate Data Engineer

with 6 years of proven experience in building scalable data pipelines and managing large-scale data processing systems. The ideal candidate should have strong hands-on expertise in

PySpark

,

SQL

, and

cloud platforms

(preferably

GCP

), along with experience working on big data technologies and orchestration tools.

Key Responsibilities

  • Design, implement, and optimize data pipelines for large-scale data processing.
  • Develop and maintain ETL/ELT workflows using Spark, Hadoop, Hive, and Airflow.
  • Collaborate with data scientists, analysts, and engineers to ensure data availability and quality.
  • Write efficient and optimized SQL queries for data extraction, transformation, and analysis.
  • Leverage PySpark and cloud tools (preferably Google Cloud Platform) to build reliable and scalable solutions.
  • Monitor and troubleshoot data pipeline performance and reliability issues.

Required Skills

  • 4–6 years of experience in a Data Engineering role.
  • Strong hands-on experience with PySpark and SQL.
  • Good working knowledge of GCP or any major cloud platform (AWS, Azure).
  • Experience with Hadoop, Hive, and distributed data systems.
  • Proficiency in data orchestration tools such as Apache Airflow.
  • Ability to work independently in a fast-paced, agile environment.

Good To Have

  • Experience with data modeling and data warehousing concepts.
  • Exposure to DevOps and CI/CD practices for data pipelines.
  • Familiarity with other programming/scripting languages (Python, Shell scripting).

Educational Qualification

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field

Skills

PySpark,Hadoop,Hive,Gcp

Mock Interview

Practice Video Interview with JobPe AI

Start Software Interview Now
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
UST
UST

IT Services and IT Consulting

Aliso Viejo CA

10001 Employees

1276 Jobs

    Key People

  • Kris Canekeratne

    Co-Founder & CEO
  • Sandeep Reddy

    President

RecommendedJobs for You

Chennai, Tamil Nadu, India

Chennai, Tamil Nadu, India