876 Apache Spark Jobs - Page 3

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

Role Overview: As a Data Engineer, you will be responsible for handling the flow and storage of data efficiently, ensuring the model has access to the right datasets. Key Responsibilities: - Designing efficient database systems to store large volumes of transactional or behavioral data using SQL, NoSQL, Hadoop, and Spark. - Building ETL pipelines to collect, transform, and load data from various sources into a usable format for analysis. - Integrating different data sources, including transactional data, customer behavior, and external data sources. Qualifications Required: - Experience in database design and management. - Proficiency in ETL pipeline development. - Knowledge of data integrat...

As a Sr Associate Data Analytics Lead, you will be responsible for the following: - Implementing data pipelines - Hands-on development experience in Spark and DataBricks pipeline - Optimization of DataBricks pipeline - Working with AWS services - Utilizing ElasticSearch effectively - Demonstrating strong SQL knowledge and Query Optimization skills - Familiarity with REST API - Leading individual projects using AGILE methodologies - Managing a team of developers through effective planning and execution - Collaborating with product management and business users to define product roadmap - Brainstorming solutions for team productivity, efficiency, and training - Creating tools and systems to en...

Role Overview: As a PySpark Developer, you will be responsible for developing and maintaining PySpark applications. You will work with various technologies within the Big Data ecosystem, such as Apache Spark, Hadoop, and SparkSQL. Additionally, you will be expected to have a good understanding of AWS and Snowflake, as well as experience with CICD and system design. Candidates with prior experience in technologies related to Fund transfer AML will have an added advantage. Strong communication skills, the ability to work under pressure, and a proactive attitude towards learning are essential for this role. Key Responsibilities: - Develop and maintain PySpark applications using Apache Spark and...

Role Overview: As a Scala Spark Developer, you will be responsible for leveraging your expertise in Apache Spark, Big Data Hadoop Ecosystem, SparkSQL, and Scala to design and develop big data platforms. Your deep understanding of modern data processing technology stacks and streaming data architectures will be pivotal in enabling real-time and low-latency data processing. Key Responsibilities: - Possessing 5+ years of Scala and Spark experience, with a focus on Data Engineering - Demonstrating hands-on experience in the design and development of big data platforms - Utilizing expertise in Spark, HBase, Hive, and other Hadoop ecosystem technologies for development using Scala - Understanding ...

Role Overview: At FYERS, you will be part of a fast-scaling, data-first organization that is dedicated to building intelligent data infrastructure to empower real-time, data-driven decisions across the business. As a Senior Data Engineer / Team Lead, your role will involve architecting scalable data platforms and leading a team of high-performing data engineers. You will play a key role in guiding the team while actively contributing to designing and implementing data solutions. Key Responsibilities: - Architect and design scalable, efficient, and reliable data pipelines and platforms - Lead the adoption and best practices for Data Engineering tools - Ensure high standards for data quality, ...

What youll do: We seek Software Engineers with experience building and scaling services in on-premises and cloud environments. As a Principal Software Engineer in the Epsilon Attribution/Forecasting Product Development team, you will design, implement, and optimize data processing solutions using Scala, Spark, and Hadoop. Collaborate with cross-functional teams to deploy big data solutions on our on-premises and cloud infrastructure along with building, scheduling and maintaining workflows. Perform data integration and transformation, troubleshoot issues, Document processes, communicate technical concepts clearly, and continuously enhance our attribution engine/forecasting engine. Strong wri...

What youll do: We seek Software Engineers with experience building and scaling services in on-premises and cloud environments. As a Principal Software Engineer in the Epsilon Attribution/Forecasting Product Development team, you will design, implement, and optimize data processing solutions using Scala, Spark, and Hadoop. Collaborate with cross-functional teams to deploy big data solutions on our on-premises and cloud infrastructure along with building, scheduling and maintaining workflows. Perform data integration and transformation, troubleshoot issues, Document processes, communicate technical concepts clearly, and continuously enhance our attribution engine/forecasting engine. Strong wri...

As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable and efficient data pipelines using PySpark and Databricks. Your key responsibilities will include: - Performing data extraction, transformation, and loading (ETL) from diverse structured and unstructured data sources. - Developing and maintaining data models, data warehouses, and data marts in Databricks. - Being proficient in Python, Apache Spark, and PySpark. - Integrating third-party data from multiple sources with internal data. - Writing and optimizing complex SQL queries for high performance and scalability across large datasets. - Collaborating closely with data scientists, analysts, and bu...