Home
Jobs

Spark & Delta Lake Professional

3 - 5 years

5 - 8 Lacs

Hyderabad

Posted:1 week ago| Platform: Naukri logo

Apply

Skills Required

Spark Git DataStage data modelling Scala Delta Lake CI/CD data warehousing Ab Initio Informatica Python

Work Mode

Work from Office

Job Type

Full Time

Job Description

Understanding of Spark core concepts like RDD s, DataFrames, DataSets, SparkSQL and Spark Streaming. Experience with Spark optimization techniques. Deep knowledge of Delta Lake features like time travel, schema evolution, data partitioning. Ability to design and implement data pipelines using Spark and Delta Lake as the data storage layer. Proficiency in Python / Scala/Java for Spark development and integrate with ETL process. Knowledge of data ingestion techniques from various sources (flat files, CSV, API, database) Understanding of data quality best practices and data validation techniques. Other Skills: Understanding of data warehouse concepts, data modelling techniques. Expertise in Git for code management. Familiarity with CI/CD pipelines and containerization technologies. Nice to have experience using data integration tools like DataStage/Prophecy/ Informatica/Ab Initio.

More Jobs at IDESLABS PRIVATE LIMITED

Bank Fast Platform Engineer

Bengaluru

3.0 - 7.0 yrs
|

INR 5 - 9 Lacs

Risk Business Analyst

Bengaluru

5.0 - 10.0 yrs
|

INR 8 - 13 Lacs

Mainframe TDM Professional

Hyderabad

3.0 - 5.0 yrs
|

INR 4 - 6 Lacs

SharePoint Developer

Pune

4.0 - 9.0 yrs
|

INR 6 - 10 Lacs

Informatica PowerCenter ETL Professional

Bengaluru

5.0 - 10.0 yrs
|

INR 7 - 12 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Spark Interview Now

My Connections IDESLABS PRIVATE LIMITED

Download Chrome Extension (See your connection in the IDESLABS PRIVATE LIMITED )

chrome image
Download Now
IDESLABS PRIVATE LIMITED

396 Jobs

RecommendedJobs for You

IDESLABS PRIVATE LIMITED logo

Spark & Delta Lake Professional

IDESLABS PRIVATE LIMITED

Hyderabad

Intelex Technologies Ulc logo

Microsoft Fabric Architect

Intelex Technologies Ulc

Bengaluru

Course5 Intelligence logo

Data Modeller

Course5 Intelligence

Hyderabad, Gurugram

Blackbaud logo

Data Architect

Blackbaud

Hyderabad

Teamovation Services logo

SAP BTP Consultant 4+years

Teamovation Services

Pune

Witbloom Training & Placement logo

Workday Payroll

Witbloom Training & Placement

Hyderabad, Pune, Chennai, Bengaluru

Cognizant logo

Polarion Consultant

Cognizant

Pune

Tiger Analytics logo

Principal Data Architect - Data Modelling

Tiger Analytics

Hyderabad, Chennai, Bengaluru

Tiger Analytics logo

Principal Data Architect- Data Modelling

Tiger Analytics

Pune, Gurugram, Delhi / NCR

Careerzgraph logo

Azure Data Factory Lead Cloud Integration

Careerzgraph

Bengaluru