530 Apache Spark Jobs - Page 12

The role of VP Data Scientist in Thane involves driving analytics opportunities in the BFSI sector, overseeing project delivery, managing teams and stakeholders. The ideal candidate should possess a robust background in advanced analytics, with a history of leading impactful analytics solutions and programs for Indian clients. Additionally, the candidate must have experience in establishing and supervising large-scale Business Intelligence units. With over 15 years of relevant experience, the right candidate should showcase expertise in various areas including data processing and data science libraries of Python such as NumPy, Pandas, Scikit learn. They should also demonstrate proficiency in...

As an AWS Big Data Engineer working in a remote location, you will be a crucial part of a company that provides enterprise-grade platforms designed to accelerate the adoption of Kubernetes and Data. Our flagship platform, Gravity, offers developers a simplified Kubernetes experience by handling all the underlying complexities. You will have the opportunity to utilize tailor-made workflows to deploy Microservices, Workers, Data, and MLOps workloads across multiple Cloud Providers. Gravity takes care of various Kubernetes-related orchestration tasks including cluster provisioning, workload deployments, configuration management, secret management, scaling, and provisioning of cloud services. Ad...

Job Summary: We are seeking a highly skilled and experienced Scala Developer with strong hands-on expertise in functional programming , RESTful API development , and building scalable microservices . The ideal candidate will have experience with Play Framework , Akka , or Lagom , and be comfortable working with both SQL and NoSQL databases in cloud-native, Agile environments. Key Responsibilities: Design, develop, and deploy scalable backend services and APIs using Scala . Build and maintain microservices using Play Framework , Akka , or Lagom . Develop RESTful APIs and integrate with internal/external services. Handle asynchronous programming , stream processing , and ensure efficient concu...

You have the opportunity to apply for the position of Senior ETL and Feature Engineer at PrivaSapien, based in Bangalore. PrivaSapien is at the forefront of Privacy Enhancing & Responsible AI Technologies, where you will play a crucial role in setting up the big data ecosystem for the world's first privacy red teaming and blue teaming platform. As an individual contributor, you will work on cutting-edge privacy platform requirements with clients globally, spanning across various industry verticals. Joining as one of the early employees, you will receive a significant ESOP option and collaborate with brilliant minds from prestigious institutions such as IISc and IIMs. Your responsibilities wi...

As the Director of Data Engineering, you will play a strategic leadership role in overseeing the architecture, development, and maintenance of our company's data infrastructure. Your responsibilities will include leading a team of data engineers to design, build, and scale data systems and processes to ensure data quality, accessibility, and reliability. Collaboration with data scientists, analysts, and other stakeholders will be crucial to drive data-driven decision-making across the organization. You will lead and manage a team of 50+ members, including architects and engineers, to ensure high performance and engagement. Designing and implementing end-to-end Azure solutions, maintaining da...

You are a Sr. Data Engineer with a strong background in building ELT pipelines and expertise in modern data engineering practices. You are experienced with Databricks and DBT, proficient in SQL and Python, and have a solid understanding of data warehousing methodologies such as Kimball or Data Vault. You are comfortable working with DevOps tools, particularly within AWS, Databricks, and GitLab. Your role involves collaborating with cross-functional teams to design, develop, and maintain scalable data infrastructure and pipelines using Databricks and DBT. Your responsibilities include designing, building, and maintaining scalable ELT pipelines for processing and transforming large datasets ef...

Global Gen AI Developer Enabling a software-defined, electrified future. Visteon is a technology company that develops and builds innovative digital cockpit and electrification products at the leading-edge of the mobility revolution. Founded in 2000, Visteon brings decades of automotive intelligence combined with Silicon Valley speed to apply global insights that help transform the software-defined vehicle of the future for many of the worlds largest OEMs. The company employs 10,000 employees in 18 countries around the globe. To know more about us click here. Mission of the Role: Facilitate Enterprise machine learning and artificial intelligence solutions using the latest technologies Visteo...

As a Java Developer, you will be responsible for analyzing, designing, programming, debugging, and modifying software enhancements and/or new products used in various computer programs. Your expertise in Java, Spring MVC, Spring Boot, Database design, and query handling will be utilized to write code, complete programming, and perform testing and debugging of applications. You will work on local, networked, cloud-based, or Internet-related computer programs, ensuring the code meets the necessary standards for commercial or end-user applications such as materials management, financial management, HRIS, mobile apps, or desktop applications products. Your role will involve working with RESTful ...

As a Software Engineering Manager at SAP, you will lead the App2App Integration team within SAP Business Data Cloud. Your role is pivotal in driving the design, development, and delivery of integration services that facilitate real-time, secure, and scalable data exchange across SAP's enterprise applications and unified data fabric. Your primary responsibilities will include owning end-to-end delivery of App2App integration components and services using Java, Apache Kafka, RESTful APIs, and modern data pipelines. You will accelerate the App2App integration roadmap by identifying reusable patterns, driving platform automation, and establishing best practices. Additionally, you will drive the ...

The Digital Success Engineering team at our organization is comprised of a diverse group of distributed software engineers, architects, and engineering managers who collaborate to develop Unified Experiences for our Trailblazers. As the pioneers of our products, we leverage Salesforce technology to create an intuitive and expert self-service platform that drives Trailblazer Success. As a Marketing Cloud Engineer (SMTS) in our Customer Engagement Engineering team, you will play a crucial role in providing technical solutions and support to our customers and business users. We are looking for someone with a strong background in the Salesforce Marketing Cloud platform, exceptional technical ski...

You are a Data Engineer with 3+ years of experience, proficient in SQL and Python development. You will be responsible for designing, developing, and maintaining scalable data pipelines to support ETL processes using tools like Apache Airflow, AWS Glue, or similar. Your role involves optimizing and managing relational and NoSQL databases such as MySQL, PostgreSQL, MongoDB, or Cassandra for high performance and scalability. You will write advanced SQL queries, stored procedures, and functions to efficiently extract, transform, and analyze large datasets. Additionally, you will implement and manage data solutions on cloud platforms like AWS, Azure, or Google Cloud, utilizing services such as R...

As a Senior Software Engineer at HSBC, you will play a crucial role in developing and maintaining Oracle systems to meet project requirements. Your responsibilities will include understanding project needs, designing specifications, coding, and ensuring the systems meet established standards. You will collaborate with other solution architects, business analysts, and project managers to deliver high-quality software solutions. Analyzing and troubleshooting production issues, performing system integration and acceptance testing, and providing out-of-hours support for production batches will be part of your routine. Your strong communication skills, both written and verbal, are essential for e...

As a Databricks Architect, you will play a crucial role in leading the adoption and integration of Databricks as the enterprise AI/ML platform. Your responsibilities will include designing and implementing scalable, secure, and compliant Databricks-based architectures to support advanced analytics, data engineering, and machine learning workloads. You will collaborate with internal infrastructure, security, and compliance teams to ensure solutions align with organizational standards and regulatory requirements. Additionally, you will be responsible for architecting and implementing robust data integrations with internal and external sources, enabling efficient data ingestion, transformation,...

To Apply - Mandatory to submit Details via Google Form - https://forms.gle/cCa1WfCcidgiSTgh8 Position : Senior Data Engineer - Total 8+ years Required Relevant 6+ years in Databricks, AWS, Apache Spark & Informatica (Required Skills) As a Senior data Engineer in our team, youll build and nurture positive working relationships with teams and clients with the intention to exceed client expectations Seeking experienced data Engineer to design, implement, and maintain robust data pipelines and analytics solutions using databricks & AWS services. The ideal candidate will have a strong background in data services, big data technologies, and programming languages. Role & responsibilities Technical ...

As a Data Engineer at CLOUDSUFI, a Google Cloud Premier Partner, you will be responsible for designing, developing, and deploying graph database solutions using Neo4j for economic data analysis and modeling. Your expertise in graph database architecture, data pipeline development, and production system deployment will play a crucial role in this position. Your key responsibilities will include designing and implementing Neo4j graph database schemas for complex economic datasets, developing efficient graph data models, creating and optimizing Cypher queries, building graph-based data pipelines for real-time and batch processing, architecting scalable data ingestion frameworks, developing ETL/...

At PwC, our team focused on data and analytics applies data to drive insights and guide strategic business decisions. Utilizing advanced analytics techniques, we assist clients in optimizing operations and achieving their goals. As a member of our data analysis team, you will specialize in leveraging sophisticated analytical methods to extract valuable insights from extensive datasets, enabling data-driven decision-making. Your role will involve utilizing skills in data manipulation, visualization, and statistical modeling to support clients in resolving intricate business challenges. We are seeking a visionary Generative AI Architect at the Manager level to join PwC US - Acceleration Center...

OneOrigin is an innovative company based in Scottsdale, AZ and Bangalore, India, dedicated to utilizing the power of AI to revolutionize the operations of Higher Education institutions. Their cutting-edge software solutions aim to streamline administrative processes, enhance student engagement, and facilitate data-driven decision-making for colleges and universities. As an AI Developer at OneOrigin in Bangalore, you will be responsible for creating and implementing advanced AI-driven solutions to empower intelligent products and optimize business operations across various domains. Working closely with data scientists, software engineers, product teams, and stakeholders from different departm...

We are looking for an experienced and dedicated Senior Manager of Business Intelligence & Data Engineering to lead a team of engineers. In this role, you will oversee various aspects of the Business Intelligence (BI) ecosystem, including designing and maintaining data pipelines, enabling advanced analytics, and providing actionable insights through BI tools and data visualization. Your responsibilities will include leading the design and development of scalable data architectures on AWS, managing Data Lakes, implementing data modeling and productization, collaborating with business stakeholders to create actionable insights, ensuring thorough documentation of data pipelines and systems, prom...

Experience: 4-10years Location - Pune, Bangalore, Chennai, Noida and Gurgaon Notice period should be Immediate to 30days only Mandatory skill - Apache Spark, JAVA programming Strong knowledge in Apache Spark framework Core Spark, Spark Data Frames, Spark streaming Hands-on experience in any one of the programming languages (Java) Good understanding of distributed programming concepts Experience in optimizing Spark DAG, and Hive queries on Tez Experience using tools like Git, Autosys, Bitbucket, Jira Ability to apply DWH principles within Hadoop environment and NoSQL databases.

As the Lead Data Scientist at Meesho, you will be a key member of the Data Science team, playing a crucial role in solving complex challenges and building intelligent systems for millions of users across various product categories. Your responsibilities will include navigating uncharted territories, discovering new solutions, and leading the team in solving unique customer problems in a rapidly evolving market. Your typical day will involve tasks such as fraud detection, inventory optimization, and platform enhancement. You will mentor a team of data scientists, assisting them in project planning, execution, and issue resolution while also collaborating with machine learning engineers and bi...

As a Data Platform developer at Barclays, you will play a crucial role in shaping the digital landscape and enhancing customer experiences. Leveraging cutting-edge technology, you will work alongside a team of engineers, business analysts, and stakeholders to deliver high-quality solutions that meet business requirements. Your responsibilities will include tackling complex technical challenges, building efficient data pipelines, and staying updated on the latest technologies to continuously enhance your skills. To excel in this role, you should have hands-on coding experience in Python, along with a strong understanding and practical experience in AWS development. Experience with tools such ...

Your journey at Crowe starts here with the opportunity to build a meaningful and rewarding career. At Crowe, you are trusted to deliver results and make an impact while having the flexibility to balance work with life moments. Your well-being is cared for, and your career is nurtured in an inclusive environment where everyone has equitable access to opportunities for growth and leadership. With over 80 years of history, Crowe has excelled in delivering excellent service through innovation across audit, tax, and consulting groups. As a Data Engineer at Crowe, you will provide critical integration infrastructure for analytical support and solution development for the broader Enterprise using m...

As a Data Architect with over 8 years of experience, you will be responsible for designing and implementing scalable, high-performance data solutions. Your expertise in Databricks, Azure, AWS, and modern data technologies will be key in developing data lakes, data warehouses, and real-time streaming architectures. You will work on optimizing data pipelines, Delta Lake architectures, and advanced analytics solutions using Databricks. Additionally, you will be involved in developing and managing cloud-native data platforms on Azure and AWS, designing ETL/ELT pipelines, and working with big data processing tools like Apache Spark, PySpark, Scala, Hadoop, and Kafka. Your role will also include i...

The Applications Development Technology Lead Analyst is a senior-level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. As the Technology Lead Analyst, your primary objective is to lead applications systems analysis and programming activities. You will partner with multiple management teams to ensure appropriate integration of functions, identify and define necessary system enhancements, and deploy new products and process improvements. Your expertise in areas of applications programming will be crucial in ensuring that application design aligns with the overall architecture blueprint. You will re...

As a Senior Software Engineer specializing in Full Stack / Data Engineering, you will be based in Pune with a minimum experience of 5 years. Your primary responsibilities will revolve around designing and developing secure, high-performance systems specifically tailored for financial services. This will involve leveraging your strong programming skills in Python, Java, and JavaScript to build scalable systems within the BFSI / Credit Union domain. You will be expected to utilize your proficiency in Apache Spark and experience with cloud platforms such as GCP or AWS to optimize data pipelines and develop full-stack applications. Your understanding of API development, microservices, and secure...