Posted:6 days ago|
Platform:
Work from Office
Full Time
We are seeking an experienced Lead Engineer with strong expertise in Spark, Scala, GCP, Python/PySpark, Shell Scripting and SQL to build and optimize large-scale data solutions in a cloud environment.
• 8+ years of experience in Big Data and Data Engineering.
• Strong hands-on expertise in Apache Spark (batch & streaming).
• Proficiency in Scala, Python/PySpark, and Shell scripting.
• Solid experience with GCP services (BigQuery, Dataproc, Airflow, etc.).
• Advanced knowledge of Spark-SQL and SQL.
• Understanding of distributed systems and performance optimization.
Roles and Responsibilities• Design and develop scalable data pipelines using Apache Spark and PySpark.
• Implement data processing applications in Scala and Python.
• Leverage Google Cloud Platform (GCP) services for data engineering workflows.
• Write and optimize Spark-SQL and SQL queries for analytics and transformations.
• Automate processes using Shell scripting and ensure system reliability.
• Collaborate with cross-functional teams to deliver high-quality data solutions.
Impetus Technologies
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
Practice Java coding challenges to boost your skills
Start Practicing Java Now
5.5 - 6.0 Lacs P.A.
indore, madhya pradesh
Salary: Not disclosed
noida, indore
12.0 - 17.0 Lacs P.A.
indore, madhya pradesh
Experience: Not specified
Salary: Not disclosed
10.0 - 14.0 Lacs P.A.
10.0 - 14.0 Lacs P.A.
7.0 - 11.0 Lacs P.A.
27.5 - 42.5 Lacs P.A.
mumbai
6.0 - 10.0 Lacs P.A.
pune, chennai, bengaluru
5.0 - 15.0 Lacs P.A.
