45 Spark Core Jobs

Skills-Java, Spark, SQL Experience: 6 to 12 years Location: AIA-Hyderabad Responsibilities and JD in brief along with additional criteria to be considered (if any): At least 6+ years of experience and strong knowledge in Java and related frameworks. Expertise in building robust, scalable and maintainable applications with Java and Spark . Able to write clean, maintainable and efficient Java code following best practices. Having deep understanding of Java core and Java EE concepts, JVM internals such as class loading and memory management. At least 5+ years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies....

Infosys Hirings for PYSPARK DEVELOPER EXPERIENCE: 5-10 YEARS LOCATION: PAN INDIA SKILLS REQUIRED: PYSPARK, PYTHON, SPARK EDUCATION : BTECH/BE/MTECH/ME/BSC/MSC/BCA/MCA

Role Overview: As a Lead Spark Scala Engineer under ICG TTS Operations Technology (OpsTech) Group, you will be responsible for developing and optimizing production-grade Spark applications in Scala. Your role will involve providing technical leadership, conducting code reviews, enforcing best practices, and optimizing performance. Your expertise in Spark, Scala, RDBMS, CI/CD tools, and other relevant technologies will be crucial in contributing to applications, systems analysis, and programming activities. Key Responsibilities: - Develop, test, and deploy production-grade Spark applications in Scala, ensuring optimal performance, scalability, and resource utilization. - Provide technical lea...

Role Overview: As a Solutions Architect at Koantek, you will collaborate with customers to design scalable data architectures utilizing Databricks technology and services. You will build secure, highly scalable big data solutions to achieve tangible, data-driven outcomes while focusing on simplicity and operational effectiveness. Leveraging your technical expertise and business acumen, you will engage in complex technology discussions, demonstrating the value of the Databricks platform throughout the sales process. Working with Account Executives, you will interact with customers" technical leaders to become a trusted advisor who delivers concrete outcomes. This role involves collaborating w...

Role Overview: You will be working as a Lead Spark Scala Engineer under ICG TTS Operations Technology (OpsTech) Group to assist in the implementation of the next generation Digital Automation Platform and Imaging Workflow Technologies. Your role will involve managing development teams in the distributed systems Eco-System and collaborating effectively as a team player. Your primary objective will be to contribute to applications, systems analysis, and programming activities. Key Responsibilities: - Develop, test, and deploy production-grade Spark applications in Scala, ensuring optimal performance, scalability, and resource utilization. - Provide technical leadership and guidance to a team o...

You will be responsible for the following tasks: - Designing Databricks workspaces and Unity Catalog for multi-tenant environments - Architecting Lakehouse solutions with Delta Lake - Demonstrating expertise in Spark core for real-time and batch pipeline designing - Implementing data modeling techniques - Ensuring security and governance using RBAC and ABAC - Managing data lineage and metadata - Orchestrating workflows using Databricks Workflows - Applying best practices for artifact organization and naming conventions in Databricks Qualifications required for this role: - Minimum of 8 years of experience in Azure DB architecture - Proficiency in designing and implementing Databricks workspa...

We are seeking an experienced Apache Spark Developer to design, develop, and optimize big data processing pipelines using Spark . The ideal candidate will have strong expertise in distributed computing , data engineering , and performance tuning , with experience in building scalable data solutions on cloud or on-prem platforms. Key Responsibilities: Design and implement data processing pipelines using Apache Spark (Core, SQL, Streaming). Develop and optimize ETL workflows for large-scale data ingestion and transformation. Work with Spark on Hadoop , Databricks , or cloud-based Spark environments . Collaborate with data engineers , data scientists , and business teams to deliver analytics so...

HIRINGS FOR SPARK-SCALA-PYTHON DEVELOPER Responsibilities : As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction. You will understand requirements, create and review designs, validate the architecture and ensure high levels of service offerings to clients in the technology domain. You will participate in project estimation, provide inputs for solution delivery, conduct technical risk planning, perform code reviews and unit test plan reviews. You will lead and guide your teams towards developing optimized high quality code deliverables, continual knowledge management and ad...

HIRINGS FOR SPARK DEVELOPER Responsibilities : As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction. You will understand requirements, create and review designs, validate the architecture and ensure high levels of service offerings to clients in the technology domain. You will participate in project estimation, provide inputs for solution delivery, conduct technical risk planning, perform code reviews and unit test plan reviews. You will lead and guide your teams towards developing optimized high quality code deliverables, continual knowledge management and adherence to th...

We are seeking an experienced Apache Spark Developer to design, develop, and optimize big data processing pipelines using Spark . The ideal candidate will have strong expertise in distributed computing , data engineering , and performance tuning , with experience in building scalable data solutions on cloud or on-prem platforms. Key Responsibilities: Design and implement data processing pipelines using Apache Spark (Core, SQL, Streaming). Develop and optimize ETL workflows for large-scale data ingestion and transformation. Work with Spark on Hadoop , Databricks , or cloud-based Spark environments . Collaborate with data engineers , data scientists , and business teams to deliver analytics so...

As a Software Developer at our organization, you will work in a constantly evolving environment, due to technological advances and the strategic direction of the organization. Your main responsibilities will include creating, maintaining, auditing, and improving systems to meet specific needs, often as advised by a systems analyst or architect. You will be testing both hardware and software systems to diagnose and resolve system faults. Additionally, you will be writing diagnostic programs, designing, and writing code for operating systems and software to ensure efficiency. When required, you will also make recommendations for future developments. Key Responsibilities: - Develop, test, deplo...

Job Description Primary Skill: Spark, Java programming Strong knowledge in Apache Spark framework Core Spark, Spark Data Frames, Spark streaming Hands-on experience in any one of the programming languages (Java, Scala) Good understanding of distributed programming concepts. Experience in optimizingSparkDAG, and Hive queries on Tez Experience using tools like Git, Autosys, Bitbucket, Jira Mandatory Skills: Apache Spark . Experience: 5-8 Years .

About the Role: We are looking for a skilled and passionate Spark Developer to design, build, and optimize large-scale data processing systems. The ideal candidate will have strong expertise in Apache Spark , Big Data ecosystems , and distributed computing frameworks . Key Responsibilities: Design, develop, and maintain data processing pipelines using Apache Spark (Core, SQL, Streaming, Structured Streaming) . Implement ETL workflows for data ingestion, transformation, and integration across multiple data sources. Optimize Spark applications for performance, scalability, and reliability in distributed environments. Work with large structured and unstructured datasets to support analytical an...

Skills-Java, Spark, SQL Experience: 6 to 12 years Location: AIA-Hyderabad Responsibilities and JD in brief along with additional criteria to be considered (if any): At least 6+ years of experience and strong knowledge in Java and related frameworks. Expertise in building robust, scalable and maintainable applications with Java and Spark . Able to write clean, maintainable and efficient Java code following best practices. Having deep understanding of Java core and Java EE concepts, JVM internals such as class loading and memory management. At least 5+ years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies....

Looking for a skilled professional with expertise in Spark and Delta Lake to join our team. The ideal candidate will have 7-12 years of experience. Roles and Responsibility Design and implement data pipelines using Spark and Delta Lake as the data storage layer. Develop and optimize Spark applications using Python, Scala, or Java. Work with large datasets to ensure data quality and integrity. Implement data partitioning and schema evolution techniques using Delta Lake. Collaborate with cross-functional teams to integrate Spark applications with ETL processes. Troubleshoot and resolve issues related to Spark application performance and data quality. Job Requirements Strong understanding of Sp...

As an experienced candidate with over 8 years of overall experience and 5+ years of relevant experience, your role will involve the following key responsibilities: - Strong understanding of Spark core including RDDs, DataFrames, DataSets, SparkSQL, and Spark Streaming - Proficiency in Delta Lake features such as time travel, schema evolution, and data partitioning - Designing and building data pipelines using Spark and Delta Lake - Solid experience in Python/Scala/Java for Spark development - Knowledge of data ingestion from files, APIs, and databases - Familiarity with data validation and quality best practices - Working knowledge of data warehouse concepts and data modeling - Hands-on expe...

Role Overview: As a seasoned Spark Developer with 5+ years of experience, you have a deep understanding of developing, testing, deploying, and debugging Spark Jobs using Scala on the Hadoop Platform. Your expertise includes proficiency in Spark Core and working with RDDs and Spark SQL, knowledge of Spark Optimization Techniques and Best practices, familiarity with Scala Functional Programming concepts like Try, Option, Future, and Collections, understanding of Scala OOPS principles including Classes, Traits, Objects (Singleton and Companion), and Case Classes, strong grasp of Scala Language Features such as Type System and Implicit/Givens, hands-on experience in Hadoop Environment (HDFS/Hive...

Role Overview: You will be joining the ICG TTS Operations Technology (OpsTech) Group to assist in the implementation of the next generation Digital Automation Platform and Imaging Workflow Technologies. Your role as a Lead Spark Scala Engineer will involve managing development teams in the distributed systems Eco-System and collaborating effectively as a team player. Your primary objective will be to contribute to applications, systems analysis, and programming activities. Key Responsibilities: - Develop, test, and deploy production-grade Spark applications in Scala, ensuring optimal performance, scalability, and resource utilization. - Provide technical leadership and guidance to a team of ...

As an Azure DB Architect with 8+ years of experience, your role will involve: - Designing Databricks workspaces and Unity Catalog for multi-tenant environments - Architecting Lakehouse solutions with Delta Lake - Demonstrating expertise in Spark core for real-time and batch pipeline designing - Implementing data modelling, security & governance using RBAC and ABAC - Ensuring data lineage and metadata management - Orchestrating workflows using Databricks Workflows - Applying best practices for artifact organization and naming conventions in Databricks Qualifications required for this role include: - Minimum of 10 years of experience in the field - Deep understanding of AWS services such as Re...

Looking for a skilled professional with expertise in Spark and Delta Lake to join our team. The ideal candidate will have 7-12 years of experience. Roles and Responsibility Design and implement data pipelines using Spark and Delta Lake as the data storage layer. Develop and optimize Spark applications using Python, Scala, or Java. Work with large datasets to ensure data quality and integrity. Implement data partitioning and schema evolution techniques using Delta Lake. Collaborate with cross-functional teams to integrate Spark applications with ETL processes. Troubleshoot and resolve issues related to Spark application performance and data quality. Job Requirements Strong understanding of Sp...

Role Overview: You will be working as a Lead Spark Scala Engineer under ICG TTS Operations Technology (OpsTech) Group to help in the implementation of the next generation Digital Automation Platform and Imaging Workflow Technologies. Your role will involve managing development teams in the distributed systems Eco-System and being a strong team player. It is expected that you will have superior technical knowledge of current programming languages, technologies, and other leading-edge development tools to contribute to applications, systems analysis, and programming activities. Key Responsibilities: - Develop, test, and deploy production-grade Spark applications in Scala, ensuring optimal perf...

Primary Skill: Spark, Java programming Strong knowledge in Apache Spark framework Core Spark, Spark Data Frames, Spark streaming Hands-on experience in any one of the programming languages (Java, Scala) Good understanding of distributed programming concepts. Experience in optimizing Spark DAG, and Hive queries on Tez Experience using tools like Git, Autosys, Bitbucket, Jira Mandatory Skills: Apache Spark.Experience: 5-8 Years.

Role & responsibilities We are looking for a candidate with strong experience into Spark Core/Streaming, Spark RDD API, Spark Dataframes API with Scala with Machine Learning and AI, Should have hands-on programming experience and Good Understanding of Data Structures, Algorithms, Data Transformation, Data Ingestion, Optimization mechanism/techniques, Good understanding of Big Data (Hadoop, MapReduce, Kafka, Cassandra) Technologies. We deal with huge amounts of data at a massive scale, so we are looking for engineers who love solving challenging problems through conducting independent research and collaborating with teams across our product teams to help improve the overall product experience...

Responsibilities * Design, develop, test, and deploy Spark Streaming applications using Scala/Spark Core. * Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions. * Troubleshoot issues in Spark Streaming applications and optimize performance for improved efficiency. * Stay up-to-date with the latest developments in Spark Streaming and contribute to its evolution. Job Requirements * 3-10 years of experience in developing Spark Streaming applications using Scala/Spark Core. * Strong understanding of Spark programming concepts, including RDDs, Dataframes, Datasets, etc. * Experience with big data processing technologies such as Hadoop/Hive/Pig is a pl...

As a Senior Python Developer specializing in Python and Spark programming, you will be responsible for leveraging your thorough and hands-on knowledge to write efficient, reusable, and reliable Python code. You should possess a minimum of 5+ years of experience in Python programming and have a strong proficiency in both Python and Spark programming. Your key responsibilities will include implementing Spark Core, Spark SQL, and Spark Streaming, working with Spark within the Hadoop Ecosystem, and designing and implementing low-latency, high-availability, and performance applications. Additionally, you will lead and guide a team of junior Python developers, collaborate with other team members a...