12395 Big Data Jobs - Page 46

Your role and responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the pl...

Your role and responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform * Responsibilities * Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS * Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on ...

Your Role Gen AI ,Computer vision, Cloud exp , Azure Need to understand how the products are developed and even more important, as big data touches the privacy of consumers, they need to have a set of ethical Need to have a natural desire to go beneath the surface of a problem. Confident and self-secure as they more often than not will have to deal with situations where there is a lot of unknown. Good knowledge & experience in Artificial Neural Network ( ANN ), AI conversational Chatbot & Needs to be able to write the required Algorithm and coding programming. Preferably in different programming languages such as Python, Tensor Flow, Keras, AWS (ML and DL), Numpy, and Pytorch. Works in the a...

Your Role Design and lead enterprise-scale data architecture solutions that are scalable, secure, and aligned with business objectives. Drive data governance, quality, and integration across platforms while ensuring compliance and performance. Collaborate with cross-functional teams to deliver robust data solutions and provide technical leadership across the organization. Continuously evaluate emerging technologies and develop strategic roadmaps for data architecture evolution. Your Profile 12-16 years of experience in data architecture, engineering, and enterprise data platforms. Expertise in designing and implementing data warehouses, BI platforms, and cloud-based data solutions. Strong ha...

You have 10+ years of software and/or data engineering experience ( specifically data focused or SaaS based products ) Strong experience in technical architecture Architect design patterns that support data ingestion, data movement, transformation, aggregation, machine learning, data science, and much more. ( Minimum 4+ years) Solid understanding of Cloud Big Data and Pipeline services (Azure) Experience with technologies such as Azure Data Lake, Hadoop, and Cassandra . Direct solution experience with message bus and Data ETL and ELT tools Expert in Big Data design patterns and implementation, as well as connected domains (real-time streaming, machine learning, etc.) Experience with Spark/Da...

Designation: Senior Associate Entity: Deloitte LLP Candidate should have 4 to 7 years of experience Team Player and Self-Starter Experience in big data frameworks like Apache Spark, Kafka, or Airflow is a bonus Strong software engineering fundamentals Proficiency in Java or Scala Hands-on experience with AWS technologies (e.g., S3, EMR,EC2) Ability to write unit, integration, and end-to-end tests Experience building and maintaining CI/CD pipelines Familiarity with design patterns, clean code, and modular architecture Good to have: Experience with UI using Javascript/Typescript/React Knowledge of Kubernetes and EKS. Optimizing SQL/NoSQL queries or Java code for performance

Title and Summary Data Scientist II Data Scientist II Job Family: Product Data & Analytics Job Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. We enable secure, simple, smart, and accessible digital payments. Our technology and innovation help people, businesses, and governments realize their greatest potential. Overview The Product Data & Analytics team builds internal analytic partnerships to strengthen focus on: Business health and portfolio optimization Revenue opportunities and initiative tracking New product development and Go-To-Market strategies We provide scalable end-to-end data solutions and influence decisions across Mastercard...

Lead and drive the implementation process while delivering high levels of service to ensure optimal solutions for customers. Transform customer data using SQL to create models for process analysis. Design and implement innovative analyses and operational apps, enriching them with AI or Machine Learning algorithms to make processes transparent and automated. Analyze data to identify inefficiencies and suggest approaches to overcome them. Quantify business and financial potential and present relevant KPIs and improvement areas to management. Translate business requirements into technical specifications and conduct value workshops to develop business cases. Job Requirements Minimum 2 years of e...

We are looking for a highly skilled and experienced Director Data Science to lead our data science team. The ideal candidate will have a strong background in data science and analytics, with excellent leadership and communication skills. Roles and Responsibility Develop and implement data-driven strategies to drive business growth. Lead and manage a team of data scientists and analysts. Collaborate with cross-functional teams to identify business problems and develop solutions. Design and implement data models and algorithms to solve complex problems. Communicate complex technical concepts to non-technical stakeholders. Stay up-to-date with industry trends and emerging technologies. Job Requ...

We are seeking an experienced Data Engineer with 4 to 5 years of experience, and at least 3+ years of expertise in designing and implementing data solutions using the Databricks platform. The ideal candidate will have a solid background in distributed computing, big data technologies, and cloud platforms. Key Responsibilities : Design, implement, and maintain scalable data solutions using Databricks . Work with programming languages such as Python, SQL, or Scala . Collaborate with cross-functional teams to deliver data-driven solutions. Optimize and manage data pipelines using Apache Spark and cloud services (AWS, Azure, or GCP). Leverage DevOps practices to automate deployments and monitor ...

Role & responsibilities Overall 5+ years of experience with software development. Excellent on Big Data Scala/Spark Cloudera development. Experience in writing SQL queries. Excellent problem solving Nice to have : Python

Why Join Capgemini? The choices you make today lay the foundation for change tomorrow. ? Choosing Capgemini means having the opportunity to make a difference, whether for the world’s leading businesses or for society. It means getting the support you need to shape your career in the way that works for you. It means when the future doesn’t look as bright as you’d like, you have the opportunity to make changeto rewrite it. When you join Capgemini, you don’t just start a new job. You become part of something bigger. A diverse collective of free-thinkers, entrepreneurs and experts, all working together to unleash human energy through technology, for an inclusive and sustainable future. At Capgem...

We are looking for a highly skilled and experienced R&D Software Engineer with expertise in C++ and EDA to join our team at Synopsys (India) Private Limited. The ideal candidate will have a strong background in software development and experience working with electronic design automation tools. Roles and Responsibility Design, develop, and test software applications using C++. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain high-quality, reliable, and scalable code. Troubleshoot and debug complex issues in existing software applications. Participate in code reviews and contribute to improving overall code quality. Stay up-to-date ...

We are looking for a highly skilled Data Engineer to join our team at Barclaycard Payments. The ideal candidate will have a strong background in data engineering and excellent problem-solving skills. Roles and Responsibility Design, develop, and implement data pipelines and architectures to support business intelligence and analytics. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems and infrastructure. Ensure data quality, integrity, and security through data validation and testing procedures. Optimize data processing workflows for improved performance and efficiency. Participate in code reviews and contrib...

Project description Looking for motivated and open-minded professional to join brand new team that managing reporting on top of data distribution layer. You will be able to apply your talents in both of tech-stack area as well as in process driving and communication as per your own personal understanding of career development strategy. Top3 investment bank organization ensures multination environment of non-stop 5/24 joint global Software development environment that includes Luxoft, Client, and other vendor Engineers. Application is Enterprise wide system that serves as a golden source of reference/dictionary information about Clients, Client lifecycle Management, and Counterparty Managemen...

Position Summary To be a technology expert architecting solutions and mentoring people in BI / Reporting processes with prior expertise in the Pharma domain. Job Responsibilities o Technology Leadership – Lead guide the team independently or with little support to design, implement deliver complex reporting and BI project assignments. o Technical portfolio – Expertise in a range of BI and hosting technologies like the AWS stack (Redshift, EC2), Qlikview, QlikSense, Tableau, Microstrategy, Spotfire o Project Management – Get accurate briefs from the Client and translate into tasks for team members with priorities and timeline plans. Must maintain high standards of quality and thoroughness. Sh...

Position Summary This Requisition is for the Employee Referrals Campaign This is a Leadership role for a person who will be responsible for leading and managing a team of Managers and senior managers working on multiple project streams for a client. They would be applying domain knowledge for better business decision-making, especially in the areas of Analytics/Technology/Product Engineering/Product Management. Job Responsibilities Leadership – Lead & guide the team independently or with little support to implement & deliver complex project assignments. Logical Thinking – Able to think analytically, use a systematic and logical approach to analyze data, problems, and situations. Must be able...

Position Summary This is the Requisition for Employee Referrals Campaign and JD is Generic. We are looking for Associates with 5+ years of experience in delivering solutions around Data Engineering, Big data analytics and data lakes, MDM, BI, and data visualization. Experienced to Integrate and standardize structured and unstructured data to enable faster insights using cloud technology. Enabling data-driven insights across the enterprise. Job Responsibilities He/she should be able to design implement and deliver complex Data Warehousing/Data Lake, Cloud Data Management, and Data Integration project assignments. Technical Design and Development – Expertise in any of the following skills. Any...

As an Associate Data Scientist at IBM, you will work to solve business problems using leading edge and open-source tools such as Python, R, and TensorFlow, combined with IBM tools and our AI application suites. You will prepare, analyze, and understand data to deliver insight, predict emerging trends, and provide recommendations to stakeholders. In your role, you may be responsible for: Implementing and validating predictive and prescriptive models and creating and maintaining statistical models with a focus on big data & incorporating machine learning. techniques in your projects Writing programs to cleanse and integrate data in an efficient and reusable manner Working in an Agile, collabor...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Automotive ECU Software Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :A talented and motivated Embedded Software Engineer who will play a crucial role in developing the systems for aftermarket and original mounted solutions.Key Responsibilities: Design, develop and/or validate ...

Job description: Iris Software has been a trusted software engineering partner to several Fortune 500 companies for over three decades. We help clients realize the full potential of technology-enabled transformation by bringing together a unique blend of domain knowledge, best-of-breed technologies, and experience executing essential and critical application development engagements. www.irissoftware.com Title - Data Engineer - Scala Location - Noida, Gurugram & Pune Notice: 15 Days OR Immediate joiners only Mode- Hybrid Shift: 1:00 PM- 10:00 PM IST Key Responsibilities: Overall 5+ years of experience with software development. Excellent on Scala/Spark Cloudera development. Experience in writ...

Lead Data Engineer - (Datawarehouse) - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and Airflow Overview Mastercard is looking for a Lead Software Engineer to join the Account Level Management(ALM) team in our Pune office thats focused on building ALM Services with Data warehouse skills The Mastercard Account Level Management platform empowers real-time card level decisioning As consumers progress along their life stages as card holders, with increasing disposable income and more refined preferences, ALM provides services to issuers so they can effectively offer more relevant benefits and rewards at each stage, to drive loyalty and spend. Skill Requirements: MUST Technical 8-12 ...

Design, architect, and implement scalable data solutions on Google Cloud Platform (GCP) to meet the strategic data needs of the organization. Lead the integration of diverse data sources into a unified data platform, ensuring seamless data flow and accessibility across the organization. Develop and enforce robust data governance, security, and compliance frameworks tailored to GCP's architecture. Collaborate with cross-functional teams, including data engineers, data scientists, and business stakeholders, to translate business requirements into technical data solutions. Optimize data storage, processing, and analytics solutions using GCP services such as BigQuery, Dataflow, and Cloud Storage...

Job Overview The Senior Software Engineer will do the design, development, and delivery of advanced big data solutions within the Hadoop ecosystem. This role involves architecting and implementing scalable data processing frameworks, ensuring high performance and reliability across distributed systems. The engineer will research and evaluate emerging technologies to optimize data workflows and meet evolving business needs. Additionally, the position requires hands-on expertise in Cloudera distribution and related tools, ensuring seamless orchestration and integration of data pipelines. The Senior Software Engineer will also be responsible for maintaining operational excellence, meeting SLA r...

ABOUT THE ROLE Role Description: The Commercial Data Management Manager will be responsible for managing the execution of the Data Platforms Operations in partnership with the Technology team, driving continuous innovation, operational excellence, and cost efficiencies. The manager will oversee execution of features aligned with one or more of our Data Platform product teams and work with the global team and functional partners to implement additional capabilities to the platform aligned with business objectives. Also, the manager will partner with the Senior Manager, Data Platforms to initially focus on the transition efforts from the vendor teams, building a highly talented and data-focuse...