Jobs
Interviews
UST logo

5+ YoE - Data Engineer PySpark/Spark Scala with Cloud & SQL - Immediate Joiner - Bengaluru

3 - 7 years

0 Lacs

karnataka

Posted:2 weeks ago| Platform: Shine logo

Apply

Skills Required

scala sql aws azure gcp git hdfs kafka docker kubernetes devops pyspark delta lake cicd

Work Mode

On-site

Job Type

Full Time

Job Description

The ideal candidate for this position should have at least 5 years of experience in designing, developing, and maintaining scalable data pipelines using Spark, specifically with PySpark or Spark with Scala. You will be responsible for building data ingestion and transformation frameworks for structured and unstructured data sources, collaborating with data analysts, data scientists, and business stakeholders to understand requirements, and delivering reliable data solutions. Working with large volumes of data, you will ensure quality, integrity, and consistency while optimizing data workflows for performance, scalability, and cost efficiency on cloud platforms such as AWS, Azure, or GCP. Implementing data quality checks and automation for ETL/ELT pipelines will be part of your responsibilities, along with monitoring and troubleshooting data issues in production and performing root cause analysis. Documenting technical processes, system designs, and operational procedures is also a key aspect of this role. Required skills for this position include at least 3 years of experience as a Data Engineer or in a similar role, hands-on experience with PySpark or Spark using Scala, strong knowledge of SQL for data querying and transformation, experience working with any cloud platform (AWS, Azure, or GCP), solid understanding of data warehousing concepts and big data architecture, and experience with version control systems like Git. Desirable skills that would be beneficial for this role include knowledge of Delta Lake, HDFS, or Kafka, familiarity with containerization tools like Docker or Kubernetes, exposure to CI/CD practices and DevOps principles, and an understanding of data governance, security, and compliance standards. Candidates ready to join immediately can share their details via email to nitin.patil@ust.com. Act fast for immediate attention!,

More Jobs at UST

Architect II - Technical SAP ABAP

Bengaluru

12 - 15 yrs
|

INR 0 - 0 Lacs

Lead I - SAP FICO with PS (Project Systems) and RAR

Bengaluru

5 - 7 yrs
|

INR 0 - 0 Lacs

Lead II - SAP ABAP

Bengaluru

7 - 9 yrs
|

INR 0 - 0 Lacs

Procurement

Bengaluru, Karnataka

Experience: Not specified

|

Salary: Not disclosed

Manual & Python Automation

Bengaluru, Karnataka

Experience: Not specified

|

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start DevOps Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
UST logo
UST

IT Services and IT Consulting

Aliso Viejo CA

RecommendedJobs for You

5+ YoE - Data Engineer PySpark/Spark Scala with Cloud & SQL - Immediate Joiner - Bengaluru

UST

karnataka

5+ YoE - Data Engineer PySpark/Spark Scala with Cloud & SQL - Immediate Joiner - Bengaluru

UST

karnataka