Jobs

Interviews
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Jobs

Home
>
Jobs in Pune
>
The IT Firm
>
Big Data Developer - Spark/Scala

Big Data Developer - Spark/Scala

3 years

|

0 Lacs

Pune Maharashtra India

Posted:2 weeks ago| Platform:

Apply

Skills Required

data developer spark scala development hadoop hive kafka mongodb engineering drive technology strategies management processing agile monitoring test unix scripting tdd support etl apache analytics governance versioning security analyze

Work Mode

On-site

Job Type

Full Time

Job Description

Role : Bigdata Developer Scala Spark Exp : 5+ of Work : WFO All 5 : : Any one Level : Immediate to 30 days only serving Description : Total IT / development experience of 3+ years. Experience in Spark (Scala-Spark ) developing Big Data applications on Hadoop, Hive and/or Kafka, HBase, MongoDB. Deep knowledge of Scala-Spark libraries to develop and debug complex data engineering challenges. Experience in developing sustainable data driven solutions with current new generation data technologies to drive our business and technology strategies. Exposure to deploying on Cloud platforms. At least 2 years of development experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Spark-Scala. At least 2 years of development experience in the following Big Data frameworks : File Format (Parquet, AVRO, ORC), Resource Management, Distributed Processing and RDBMS. At least 2 years of developing applications in Agile with Monitoring, Build Tools, Version Control, Unit Test, Unix Shell Scripting, TDD, CI/CD, Change Management to support Responsibilities : Develop and maintain data pipelines using ETL processes Take responsibility for Apache Hadoop development and implementation Work closely with data science team to implement data analytics pipelines Help define data governance policies and support data-versioning processes Maintain security and data privacy, working closely with data protection officer Analyze vast number of data stores to uncover insights (ref:hirist.tech) Show more Show less

More Jobs at The IT Firm

SAP APO Consultant - E2E Implementation

Greater Kolkata Area

10.0 - 10.0 yrs

Salary: Not disclosed

Software Development Engineer - Test - Automation Testing

Chennai, Tamil Nadu, India

Experience: Not specified

Salary: Not disclosed

Backend Engineer - Python/Microservices Architecture

Greater Kolkata Area

Salary: Not disclosed

Android Developer - Java/Kotlin

Chennai, Tamil Nadu, India

47.0 - 47.0 yrs

Salary: Not disclosed

Java Lead - Spring Boot/Microservices Architecture

Chennai, Tamil Nadu, India

812.0 - 812.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Data Interview Now

My Connections The IT Firm

Download Chrome Extension (See your connection in the The IT Firm )

chrome image

9 Jobs

RecommendedJobs for You

Big Data Developer - Spark/Scala

Pune, Maharashtra, India

Big Data Developer - Spark/Scala

Pune, Maharashtra, India