Jobs
Interviews

2 Spark Batch Jobs

Setup a job Alert
JobPe aggregates results for easy application access, but you actually apply on the job portal directly.

2.0 - 6.0 years

0 Lacs

pune, maharashtra

On-site

The Applications Development Intermediate Programmer Analyst position is an intermediate level role where you will be responsible for participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your main objective will be to contribute to applications systems analysis and programming activities. You will be responsible for developing and maintaining Java-based applications using the Spring framework. Additionally, you will design and implement batch processing solutions using Spark Batch for large-scale data processing and build real-time data pipelines using Spark Streaming for processing streaming data. Collaboration with cross-functional teams to define, design, and deliver new features will be a key aspect of your role. You will also be optimizing data processing workflows for performance, scalability, and reliability. Troubleshooting and resolving issues related to data processing, application performance, and system integration will be part of your responsibilities. Writing clean, maintainable, and well-documented code following best practices is essential. You will participate in code reviews, unit testing, and system testing to ensure quality deliverables. Staying updated with emerging technologies and proposing improvements to existing systems will be encouraged. Required Skills and Qualifications: - Education: Bachelors degree in Computer Science, Engineering, or a related field. - Experience: 2 to 5 years of professional experience in Java development. Technical Skills: - Strong proficiency in Java (version 8 or higher) and object-oriented programming. - Hands-on experience with Spring (Spring Boot, Spring MVC, or Spring Data) for building enterprise applications. - Expertise in Spark Batch for large-scale data processing and analytics. - Experience with Spark Streaming for real-time data processing and streaming pipelines. - Familiarity with distributed computing concepts and big data frameworks. - Proficiency with version control systems like Git. - Knowledge of build tools such as Maven or Gradle. - Understanding of Agile/Scrum methodologies. Soft Skills: - Strong problem-solving and analytical skills. - Excellent communication and teamwork abilities. - Ability to manage multiple priorities and work independently. Preferred Skills: - Experience with big data technologies like Hadoop, Kafka, or Hive. - Knowledge of containerization tools like Docker or Kubernetes. - Experience with CI/CD pipelines and tools like Jenkins. - Understanding of data storage solutions like HDFS. This job description provides a high-level overview of the responsibilities and required skills for the Applications Development Intermediate Programmer Analyst position. Other job-related duties may be assigned as required.,

Posted 4 days ago

Apply

5.0 - 10.0 years

5 - 10 Lacs

Bengaluru / Bangalore, Karnataka, India

On-site

Job Description Role Overview: The Big Data Architect will be responsible for the design, implementation, and management of the organizations big data infrastructure. The ideal candidate will have a strong technical background in big data technologies, excellent problem-solving skills, and the ability to work in a fast-paced environment. The role requires a deep understanding of data architecture, data modeling, and data integration techniques. About the Role: Design and implement scalable and efficient big data architecture solutions to meet business requirements. Develop and maintain data pipelines, ensuring the availability and quality of data. Collaborate with data scientists, data engineers, and other stakeholders to understand data needs and provide technical solutions. Lead the evaluation and selection of big data tools and technologies. Ensure data security and privacy compliance. Optimize and tune big data systems for performance and cost-efficiency. Document data architecture, data flows, and processes. Stay up-to-date with the latest industry trends and best practices in big data technologies. About You: Bachelors or Masters degree in Computer Science, Information Technology, or a related field. over all 10+ years exp with 5+ years of experience in big data architecture and engineering. Proficiency in big data technologies such as Hadoop mapredue, Spark batch and streaming, Kafka, HBase, Scala, Elastic Search and others. Experience with AWS cloud platform. Strong knowledge of data modeling, ETL processes, and data warehousing. Proficiency in programming languages such as Java, Scala, Spark Familiarity with data visualization tools and techniques. Excellent communication and collaboration skills. Strong problem-solving abilities and attention to detail.

Posted 1 month ago

Apply
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Featured Companies