1597 Spark Jobs - Page 6

Project Role : Application Support Engineer Project Role Description : Act as software detectives, provide a dynamic service identifying and solving issues within multiple components of critical business systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Responsible for engineering Databricks as a scalable enterprise Lakehouse platform. Focus on workspace configuration, governance, Unity Catalog, automation, observability, and cross-platform integrations.Roles & Responsibilities:-Databricks workspace administration-Unity Catalog governan...

Accenture Applied Intelligence practice help our clients grow their business in entirely new ways. Analytics enables our clients to achieve high performance through insights from data - insights that inform better decisions and strengthen customer relationships. From strategy to execution, Accenture works with organizations to develop analytic capabilities - from accessing and reporting on data to predictive modelling - to outperform the competition As part of our Analytics practice, you will join a worldwide network of over 20,000 smart and driven colleagues experienced in leading statistical tools, methods and applications. From data to analytics and insights to actions, our forward-thinki...

Company Profile: Founded in 1976, CGI is among the largest independent IT and business consulting services firms in the world. With 94,000 consultants and professionals across the globe, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems integration, managed IT and business process services and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at ...

Locaton Manyata Tech Park Exp: 2 to 5 yrs, AI ML Engineer Skills Required: Exp. with Data engineering and Data ML pipelines for Analytics and AI ML Models Working with large sets of structured and unstructured data from disparate sources Foundational acquaintance of Data Science and AI ML models SQL, Python, Spark, PySpark Big Data systems - Hadoop Ecosystem (HDFS, Hive, MapReduce) Analytics database like Druid, Data visualization/exploration tools like Superset Understanding of cloud platforms (AWS, Azure or GCP) GIT Secondary Skills (desired/preferred): Apache Airflow, Apache Oozie, Nifi GCP cloud exp Big Query GCP Big Data Ecosystem Trino/Presto Familiar with forecasting algorithms such a...

Role Description: As a Senior Data Engineer at Amgen, you will be responsible for managing and optimizing the company''s data infrastructure and architecture You will design and implement data pipelines, develop data models, perform data integration, and ensure data quality and governance Your expertise in data engineering, big data technologies, and data manipulation will contribute to the effective storage, processing, and utilization of large-scale data sets Key Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines to support structured, semi-structured, and unstructured data processing across the Enterprise Data Engineering for Biotech or Pharma functional knowledge ...

The role is responsible for designing, building, maintaining, analyzing, and interpreting data to provide actionable insights that drive business decisions. This role involves working with large datasets, developing reports, supporting and executing data governance initiativesand visualizing data to ensure data is accessible, reliable, and efficiently managed. The ideal candidate has strong technical skills, experience with big data technologies, and a deep understanding of data architecture and ETL processes Roles & Responsibilities: Design, develop, and maintain data solutions for data generation, collection, and processing Be a key team member that assists in design and development of the...

ABOUT THE ROLE Role Description: The role is responsible for designing, building, maintaining , analyzing, and interpreting data to provide actionable insights that drive business decisions. This role involves working with large datasets, developing reports, supporting and executing data governance initiatives and visualizing data to ensure data is accessible, reliable, and efficiently managed. The ideal candidate has strong technical skills, experience with big data technologies, and a deep understanding of data architecture and ETL processes Roles & Responsibilities: Design, develop, and maintain data solutions for data generation, collection, and processing Be a key team member that assis...

ABOUT THE ROLE Role Description: We are seeking a highly skilled, hands-on Sr Associate Test Automation Engineer with strong experience i n data validation, ETL testing, test automation, CRM iPad Testing and QA process ownership. This role combines deep technical execution with a solid foundation in QA best practices including test planning, defect tracking, and test lifecycle management. You will be responsible for designing and executing manual and automated test strategies for complex real-time and batch data pipelines and in Veeva CRM (iPad App) contributing to the design of automation frameworks, and ensuring high-quality data delivery across our AWS , MuleSoft and Databricks-based plat...

What you will do In this vital role you will be responsible for designing, developing, and maintaining software applications and solutions that meet business needs and ensuring the availability and performance of critical systems and applications This role involves working closely with product managers, designers, and other engineers to create high-quality, scalable software solutions and automating operations, monitoring system health, and responding to incidents to minimize downtime Roles & Responsibilities: Take ownership of complex software projects from conception to deployment Manage software delivery scope, risk, and timeline Possesses strong rapid prototyping skills and can quickly t...

What you will do In this vital role you will be responsible for designing, developing, and maintaining software applications and solutions that meet business needs and ensuring the availability and performance of critical systems and applications. This role involves working closely with product managers, designers, and other engineers to create high-quality, scalable software solutions and automating operations, monitoring system health, and responding to incidents to minimize downtime. Roles & Responsibilities: Take ownership of complex software projects from conception to deployment Manage software delivery scope, risk, and timeline Provide technical guidance and mentorship to junior devel...

What you will do In this vital role you will be responsible for designing, building, maintaining, analyzing, and interpreting data to provide actionable insights that drive business decisions. This role involves working with large datasets, developing reports, supporting and executing data governance initiatives and, visualizing data to ensure data is accessible, reliable, and efficiently managed. The ideal candidate has strong technical skills, experience with big data technologies, and a deep understanding of data architecture and ETL processes Roles & Responsibilities: Design, develop, and maintain data solutions for data generation, collection, and processing Be a key team member that as...

What you will do In this vital role you will be working closely with product managers, designers, and other engineers to create high-quality, scalable software solutions and automating operations, monitoring system health, and responding to incidents to minimize downtime. Design, develop, modify and support Planisware based applications using Planisware L1 configurations. Take ownership of complex software projects from conception to deployment Manage software delivery scope, risk, and timeline Possesses strong rapid prototyping skills and can quickly translate concepts into working code Provide technical guidance and mentorship to junior developers Contribute to both front-end and back-end ...

In this vital role you will be is responsible for designing, developing, and maintaining a Salesforce Service Cloud application and solutions that meet business needs and ensuring the availability and performance of critical systems and applications. This role involves working closely with the product owner, designers, and developers to create high-quality, scalable software solutions and automating operations, monitoring system health, and responding to incidents to minimize downtime. Roles & Responsibilities: Take ownership of complex Salesforce and related projects from conception to deployment Manage software delivery scope, risk, and timeline Possesses strong rapid prototyping skills an...

Role Description: We are looking for highly motivated expert Principal Data Engineer who can own the design & development of complex data pipelines, solutions and frameworks with domain expertise in R&D domain. The ideal candidate will be responsible to design, develop, and optimize data pipelines, data integration frameworks, and metadata-driven architectures that enable seamless data access and analytics. This role prefers deep expertise in big data processing, distributed computing, data modeling, and governance frameworks to support self-service analytics, AI-driven insights, and enterprise-wide data management. Roles & Responsibilities: Architect and maintain robust, scalable data pipel...

In this vital role you will play a key role in a regulatory submission content automation initiative which will modernize and digitize the regulatory submission process, positioning Amgen as a leader in regulatory innovation. The initiative leverages state-of-the-art technologies, including Generative AI, Structured Content Management, and integrated data to automate the creation, and management of regulatory content. Roles & Responsibilities: Possesses strong rapid prototyping skills and can quickly translate concepts into working code Contribute to both front-end and back-end development using cloud technology Develop innovative solution using generative AI technologies Ensure code quality...

What you will do We are seeking a seasoned Principal Data Engineer to lead the design, development, and implementation of our data strategy. The ideal candidate possesses a deep understanding of data engineering principles, coupled with strong leadership and problem-solving skills. As a Principal Data Engineer, you will architect and oversee the development of robust data platforms, while mentoring and guiding a team of data engineers. Roles & Responsibilities: Possesses strong rapid prototyping skills and can quickly translate concepts into working code. Provide expert guidance and mentorship to the data engineering team, fostering a culture of innovation and standard methodologies. Design,...

What you will do In this vital role you will collaborate with business partners, service owners and IS peers to develop predictive models and insights across the US Commercial Organization. This position will innovate and build significant business impact through the use of sophisticated analytics techniques to help Amgen with its mission to serve patients by helping them get the therapies they need. Flexible Commuter role to Amgen India office. You will work on-site 2-3 days a week. This position will be primarily responsible for: Working collaboratively with multi-functional teams on projects and/or programs with aims to systematically derive insights that ultimately derive substantial bus...

The role is responsible for the design, integration, and management of high performance computing (HPC) systems that encompass both hardware and software components into the organizations network infrastructure. This individual will be responsible for all activities related to handling and supporting the Business and platforms including system administration, as well as incorporating new technologies under the challenge of a sophisticated and constantly evolving technology landscape. This role involves ensuring that all parts of a system work together seamlessly to meet the organizations requirements. Roles & Responsibilities: Implement, and manage cloud-based infrastructure that supports HP...

What you will do In this vital role you will design, build and maintain data lake solutions for scientific data that drive business decisions for Research. You will build scalable and high-performance data engineering solutions for large scientific datasets and collaborate with Research stakeholders. The ideal candidate possesses experience in the pharmaceutical or biotech industry, demonstrates strong technical skills, has experience with big data technologies, and understands data architecture and ETL processes Design, develop, and implement data pipelines, ETL/ELT processes, and data integration solutions Contribute to data pipeline projects from inception to deployment, manage scope, tim...

What you will do In this vital role you will be responsible to design, develop, and optimize data pipelines, data integration frameworks, and metadata-driven architectures that enable seamless data access and analytics. This role prefers deep expertise in big data processing, distributed computing, data modeling, and governance frameworks to support self-service analytics, AI-driven insights, and enterprise-wide data management. Design, develop, and maintain complex ETL/ELT data pipelines in Databricks using PySpark, Scala, and SQL to process large-scale datasets Understand the biotech/pharma or related domains & build highly efficient data pipelines to migrate and deploy complex data across...

Overview: As a Sr Data Engineer of the AICOE team, you will develop analytical products and solutions that sit atop vast datasets gathered by retail stores, restaurants, banks, and other consumer-focused companies. The challenge will be to create high-performance algorithms built on data sets measured in the billions of transactions that allow our users to derive insights from big data that in turn drive their businesses with a keen eye for data privacy and governance. Role : - Leads talent acquisition efforts and initiatives, facilitates training programs and conducts performance management for team of direct reports - Lead teams in the creation of portfolio robust ML solutions through effe...

Title and Summary Associate Managing Consultant, Advisors & Consulting Services, Performance AnalyticsAssociate Managing Consultant Performance Analytics Advisors & Consulting Services Services within Mastercard is responsible for acquiring, engaging, and retaining customers by managing fraud and risk, enhancing cybersecurity, and improving the digital payments experience. We provide value-added services and leverage expertise, data-driven insights, and execution. Our Advisors & Consulting Services team combines traditional management consulting with Mastercards rich data assets, proprietary platforms, and technologies to provide clients with powerful strategic insights and recommendations. ...

Position Overview Job Title: Full Stack Developer, Associate Location: Pune, India Role Description Individual is required to possess strong technical skills. Candidate’s primary responsibility will be to work closely with functional teams and provide high-quality solutions that meet functional as well as non-functional requirements. What We’ll Offer You As part of our flexible scheme, here are just some of the benefits that you’ll enjoy Best in class leave policy Gender neutral parental leaves 100% reimbursement under childcare assistance benefit (gender neutral) Sponsorship for Industry relevant certifications and education Employee Assistance Program for you and your family members Compre...

Accenture Applied Intelligence practice help our clients grow their business in entirely new ways. Analytics enables our clients to achieve high performance through insights from data - insights that inform better decisions and strengthen customer relationships. From strategy to execution, Accenture works with organizations to develop analytic capabilities - from accessing and reporting on data to predictive modelling - to outperform the competition As part of our Analytics practice, you will join a worldwide network of over 20,000 smart and driven colleagues experienced in leading statistical tools, methods and applications. From data to analytics and insights to actions, our forward-thinki...

About the Role Love deep data? Love discussing solutions instead of problems? Then you could be our next Data Scientist. In a nutshell, your primary responsibility will be enhancing the productivity and utilisation of the generated data. Other things you will do include working closely with the business stakeholders, transforming scattered pieces of information into valuable data and sharing and presenting your valuable insights with peers. What you will do Develop models and run experiments to infer insights from hard data Improve our product usability and identify new growth opportunities Understand reseller preferences to provide them with the most relevant products Designing discount pro...