5 - 7 years
15 - 18 Lacs
Posted:3 months ago|
Platform:
Work from Office
Full Time
Job Title : Spark & Delta Lake Developer Location : Hyderabad Experience : 3-7 years Job Description : We are seeking an experienced Spark & Delta Lake Developer to join our dynamic team. The ideal candidate will have a deep understanding of Spark core concepts, expertise in Delta Lake , and experience designing and implementing efficient data pipelines . Key Responsibilities : Understand and work with Spark core concepts like RDDs , DataFrames , DataSets , SparkSQL , and Spark Streaming . Apply Spark optimization techniques to enhance performance. Leverage Delta Lake features including time travel , schema evolution , and data partitioning . Design and implement robust data pipelines using Spark and Delta Lake as the data storage layer. Develop solutions using Python , Scala , or Java , and integrate them with the ETL process. Perform data ingestion from various sources including flat files , CSV , APIs , and databases . Ensure data quality through best practices and data validation techniques. Required Skills & Experience : Strong understanding of data warehouse concepts and data modeling techniques. Expertise in Git for code management. Familiarity with CI/CD pipelines and containerization technologies . Experience with DataStage , Prophecy , Informatica , or Ab Initio is a plus. Qualifications : Bachelor's/Masters degree in Computer Science , Engineering , or a related field. Proficiency in Python , Scala , or Java . Hands-on experience with Spark and Delta Lake . If you're passionate about building scalable data solutions and have the required expertise, apply now! Interested candidates can apply by submitting their resumes via Naukri or share your resume on kamna@prointegrate.net Or can call directly on 6362744117 Kamna (HR)
Prointegrate World It Consulting
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
My Connections Prointegrate World It Consulting
15.0 - 18.0 Lacs P.A.
Chennai, Tamil Nadu, India
6.0 - 10.0 Lacs P.A.
Chennai, Tamil Nadu, India
7.0 - 10.0 Lacs P.A.
Bengaluru / Bangalore, Karnataka, India
3.0 - 7.0 Lacs P.A.
Hyderabad / Secunderabad, Telangana, Telangana, India
3.0 - 7.0 Lacs P.A.
Delhi, Delhi, India
3.0 - 7.0 Lacs P.A.
Noida, Uttar Pradesh, India
3.0 - 9.5 Lacs P.A.
Gurgaon / Gurugram, Haryana, India
7.0 - 14.0 Lacs P.A.
Noida, Uttar Pradesh, India
7.0 - 14.0 Lacs P.A.
Patan - Gujarat, Gujrat, India
4.0 - 11.0 Lacs P.A.