Senior Data Engineer/Architect

5 - 10 years

0 Lacs

Posted:1 day ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

As a Software Developer at our organization, you will work in a constantly evolving environment, due to technological advances and the strategic direction of the organization. Your main responsibilities will include creating, maintaining, auditing, and improving systems to meet specific needs, often as advised by a systems analyst or architect. You will be testing both hardware and software systems to diagnose and resolve system faults. Additionally, you will be writing diagnostic programs, designing, and writing code for operating systems and software to ensure efficiency. When required, you will also make recommendations for future developments. Key Responsibilities: - Develop, test, deploy, and debug Spark Jobs using Scala in the Hadoop Platform - Work with RDDs and Spark SQL in Spark Core - Implement Spark Optimization Techniques and Best Practices - Utilize Scala Functional Programming concepts like Try, Option, Future, and Collections - Apply Scala Object-Oriented Programming concepts such as Classes, Traits, Objects, and Case Classes - Understand Scala Language Features including Type System and Implicit/Givens - Hands-on experience in Hadoop Environment (HDFS/Hive), AWS S3, EMR - Proficient in Python programming - Work with Workflow Orchestration tools like Airflow and Oozie - Perform API calls in Scala - Familiarity with file formats such as Apache AVRO, Parquet, and JSON - Knowledge of Protocol Buffers and Geospatial data analytics is a plus - Write test cases using frameworks like scalatest - Proficient in Build Tools like Gradle & SBT - Experience with GIT, resolving conflicts, and working with branches - Exposure to workflow systems like Airflow - Strong programming skills using data structures and algorithms - Excellent analytical and communication skills Qualifications Required: - 7-10 years of experience in the industry - BE/B.Tech in Computer Science or equivalent If you are passionate about technology and want to work on challenging projects with a talented team, joining us as an Infosys Power Programmer could be a great career choice. Note: The benefits of joining us include working on cutting-edge projects, rapid career growth, mentorship from industry experts, global opportunities, and competitive compensation packages and benefits.,

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Infosys logo
Infosys

IT Services and IT Consulting

Bangalore Karnataka

RecommendedJobs for You