33 Big Data Jobs

Role Overview: As a Product Analyst at Visa, you will play a crucial role in managing merchant data platform initiatives globally. Your primary responsibilities will include working closely with product managers and engineering teams to analyze merchant and transaction data, improve data quality across Visa's merchant platform, and distill stakeholder feedback into meaningful roadmap and product programs. Key Responsibilities: - Work with and manage the support team to resolve stakeholder concerns and enhance support processes - Collaborate with Visa business groups utilizing merchant data products to streamline Merchant Product Management processes - Gather feedback to enhance data quality,...

As a highly experienced Senior BI Engineer, your role will involve designing, developing, and managing enterprise Business Intelligence solutions. You will utilize your expertise in SSRS, SSIS, and Tableau to transform complex data into meaningful insights that drive strategic decision-making within the organization. Key Responsibilities: - Design, develop, and maintain BI dashboards and reports using Tableau and SSRS - Build and manage ETL processes and data pipelines using SSIS - Analyze business requirements and translate them into scalable BI solutions - Optimize data models, queries, and reporting performance - Ensure data quality, consistency, governance, and security - Collaborate wit...

JD:Technical Lead Looking for Candidates with 8 to 10 years of experience Hands on experience of implementing data pipelines using traditional DWH, Big data & Cloud ecosystem Good exposure to data architecture design, cost and size estimation Good understanding of handling Realtime/streaming pipelines Have experience of Data Quality and Data Governance Have experience of handling & interacting clients and managing vendors Having knowledge on AI/ML, GenAI is a plus Exposure of managing and leading teams

As a Data/Information Management Analyst 2 at our company, you will be responsible for monitoring, assessing, and analyzing processes and data within your specialty area. Your role will involve identifying policy gaps, formulating policies, interpreting data, making recommendations, and conducting research to interpret factual information. You will also be expected to identify inconsistencies in data, define business issues, and formulate recommendations on policies, procedures, or practices. Additionally, you will integrate established disciplinary knowledge with a basic understanding of related industry practices and develop a working knowledge of industry standards. Key Responsibilities: ...

Role: GCP Data Engineer Exp : 6-8 yrs Location : Bangalore Type: Fulltime Role & responsibilities Engineers for Cornerstone to Lumi Migration Initiative Engineers with strong SQL knowledge Experienced resources with Big data/ Hadoop implementation Well verse with GCP Big Query implementation Preferred candidate profile

Role & responsibilities Hadoop Ecosystem: In-depth knowledge of Hadoop, HDFS, MapReduce, Hive, Pig, HBase, and Spark. Programming: Strong programming skills in Java, Python, or Scala. Big Data Technologies: Experience with big data technologies, including NoSQL databases, data warehousing, and ETL tools. Data Processing: Experience with data processing frameworks, including Hadoop, Spark, and Flink. Communication: Excellent communication and collaboration skills. Preferred candidate profile

As a Manager AI - Gen AI at EY, you will be part of a multi-disciplinary Data and Analytics team responsible for delivering client projects and solutions across various areas including Data Mining & Management, Visualization, Business Analytics, Automation, Statistical Insights, and AI/GenAI. Your role will involve developing and delivering industry-specific solutions for sectors such as Financial services, Consumer, product & Retail, Healthcare & wellness, Manufacturing, Supply chain, telecom, Real Estate, etc., which will be utilized to implement EY SaT mergers and acquisition methodologies. **Role Overview:** You will be proficient in Artificial Intelligence, Machine Learning, deep learni...

Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Informatica Administration Good to have skills : Informatica Big Data Edition Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary : As a Custom Software Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code for multiple clients. Your typ...

Job description, Hiring for GCP Data Engineer with experience range 5 years & above Mandatory Skills: Google Big query, GCP, Bigdata Education: BE/B.Tech/MCA/M.Tech/MSc./MS Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requireme...

As a Data Architect at Caterpillar Inc., you will play a crucial role in shaping the future by working on a robust next-gen data platform. Your expertise in Big Data, Data Warehousing, and real-time data movement will be instrumental in architecting and building Caterpillar's cutting-edge digital platform. Here are the key responsibilities associated with this role: - Perform all programming tasks and oversee architecture assessment and design for development assignments independently, focusing on complex systems work. - Lead the architecture design of enterprise integrations serving multiple business functions. - Design and implement near real-time data movement solutions to enhance core ca...

As a highly skilled and visionary professional at Caterpillar Inc., you will have the opportunity to lead a team of engineers in building a robust next-gen data platform. Your primary responsibilities will include: - Architecting and building Caterpillars state-of-the-art digital platform - Driving innovation in AI and advanced analytics - Leading architecture design for end-to-end enterprise integrations - Designing and implementing near real-time data movement solutions - Defining the overall data architecture strategy aligned with business goals - Establishing data governance policies, standards, and compliance - Developing and maintaining current, planned, and future state architecture b...

SUMMARY About the client: Our client is an IT Technology & Services Management MNC , supporting millions of internal and external customers with state of-the-art IT solutions to everyday problems & dedicated to bringing digital innovations to every aspect of the landscape of insurance. Our Client is a part of one of the major insurance groups based out of Germany and Europe. The Group is represented in around 26 countries worldwide, with Over 37,000 people worldwide, focusing mainly on Europe and Asia & offers a comprehensive range of insurances, pensions, investments and services by focusing on all cutting edge technologies majorly on Could, Digital, Robotics Automation, IoT, Voice Recognit...

Your role and responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform...

Role Overview: At Agoda, you will be a key contributor to the industry-leading front-end websites. Your typical day will involve leading the development of features, experiments, technical projects, and complex systems. You will build high-volume websites using current technologies such as TS, React, and GraphQL, while continuing to evolve the architecture and improve software. Collaboration with server, other client, and infrastructure technical team members will be essential to deliver the best solutions. You will work in a culture that prioritizes quality, tools, and efficiency, always striving for improvement. Key Responsibilities: - Lead the development of features, experiments, technic...

We are seeking an experienced Big Data Developer with strong expertise in Apache Spark , Scala , and Python (PySpark) . The ideal candidate will design and develop data processing pipelines , ETL workflows , and distributed applications , ensuring scalability and performance in large-scale data environments. Key Responsibilities: Develop and maintain data pipelines using Apache Spark , Scala , and PySpark . Apply functional programming principles for clean and efficient Scala code. Optimize Spark jobs for performance , cost efficiency , and scalability . Collaborate with data engineers , data scientists , and cloud teams to deliver robust solutions. Integrate Spark applications with data lak...

As a Technical Consultant at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, inc...

As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Expertise in Data warehousing/ information Management/ Data Integra...

As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. Youll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, youll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, youll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporating a...

As an Associate Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big ...

In your role, you may be responsible for: Implementing and validating predictive and prescriptive models and creating and maintaining statistical models with a focus on big data & incorporating machine learning. techniques in your projects Writing programs to cleanse and integrate data in an efficient and reusable manner Working in an Agile, collaborative environment, partnering with other scientists, engineers, consultants and database administrators of all backgrounds and disciplines to bring analytical rigor and statistical methods to the challenges of predicting behaviours Communicating with internal and external clients to understand and define business needs and appropriate modelling t...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

AIA Hyd drive Role : Data Scientist AIML Experience : 4 to 13 Years Relevant Experience : 2+ Years Location : Pan India Notice Period : Immediate to 60 days Mode of Interview - In-Person (29th November 2025) Job Description: 1. Be a hands on problem solver with consultative approach, who can apply Machine Learning & Deep Learning algorithms to solve business challenges Use the knowledge of wide variety of AI/ML techniques and algorithms to find what combinations of these techniques can best solve the problem Improve Model accuracy to deliver greater business impact Estimate business impact due to deployment of model 2. Work with the domain/customer teams to understand business context , data...

JD: Enterprise Data Architect We are seeking a skilled Data Solution Architect to design Solution and Lead the implementation on enterprise-wide data architecture. The ideal candidate will possess extensive experience in data Architecting, Solution design and data management practices Responsibilities: Architect and design end-to-end data solutions on Cloud Platform, focusing on data warehousing and big data platforms. Collaborate with clients (including business stakeholders), developers, and architecture teams to understand requirements and translate them into effective data solutions. Develop high-level and detailed data architecture and design documentation. Implement data management and...

Role Overview: As a Data Analytics Sr Lead Analyst, you will be a strategic professional closely following the latest trends in data analytics and applying them within your role and the business. You will be part of a select group providing a high level of expertise, requiring excellent communication skills to negotiate internally and guide colleagues from different areas. Your responsibilities will include adapting trends in Data Science, Data Mining, and Big Data for strategic data analysis, making recommendations, and developing data displays. Key Responsibilities: - Serve as the subject matter expert for strategic data analysis, identifying insights and implications - Make strategic reco...

About this role: Wells Fargo is seeking for a Senior Data Management Analyst. In this role, you will: Lead or participate in moderately complex programs and initiatives for data quality, governance, and metadata activities Design and conduct moderately complex analysis to identify and remediate data quality, data integrity, process, and control gaps Analyze, assess, and test data controls and data systems to ensure quality and risk compliance standards are met and adhere to data governance standards and procedures Identify data quality metrics and execute data quality audits to benchmark the state of data quality Develop recommendations for optimal approaches to resolve data quality issues a...