12395 Big Data Jobs - Page 33

Job Purpose Responsible for all Risk related data reporting to Senior Management Team and MD’s office. This position is also responsible for running a robust Daily Pre-approved Offer generation process, campaign control and governance process that would enable excellence in campaign execution and display of Pre-approved offers in the 3in1 App which is a key strategy of the Company. Responsible for creating and implementing Auth BRE process which will be common across all offers generated by campaign governance process or generated online based on customer’s inputs to reduce difference in two processes of offer generation. Enabling all the Risk team with daily/weekly/monthly data with automat...

Data Engineer Pyspark Expertise in Data Architecture, Data Strategy and Roadmap for large and complex organization and systems and implemented large scale end-to-end Data Management & Analytics solutions Experience in transforming traditional Data Warehousing approaches to Big Data based approaches and proven track record of managing risks and data security Expertise with DW Dimensional modeling techniques, Star & Snowflake schemas, modeling slowly changing dimensions and role playing dimensions, dimensional hierarchies, and data classification Experiences in cloud native principals, designs and deployments. Extensive experience working with and enhancing Continuous Integration (CI) and Cont...

As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You''ll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you''ll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you''ll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: * Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorpo...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: * Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. * Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. * Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too. Required education ...

In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporating a variety of statistical and machine learning techniques Designing and implementing various enterprise search applications such as Elasticsearch and Splunk for client requirements Work in an Agile, collaborative environment, partnering with other scientists, engineers, consultants and database administrators of all backgrounds and disciplines to bring analytical rigor and statistical methods to the challenges of predicting behaviours. Build teams or writing programs to cleanse and integrate data in an effici...

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You''ll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you''ll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you''ll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorp...

We are seeking a highly skilled Advanced Analytics Specialist to join our dynamic team. The successful candidate will be responsible for leveraging advanced analytics techniques to derive actionable insights, inform business decisions, and drive strategic initiatives. This role requires a deep understanding of data analysis, statistical modelling, machine learning, and data visualization. In this role, you will be responsible for architecting and delivering AI solutions using cutting-edge technologies, with a strong focus on foundation models and large language models. You will work closely with customers, product managers, and development teams to understand business requirements and design...

As an Associate Data Scientist at IBM, you will work to solve business problems using leading edge and open-source tools such as Python, R, and TensorFlow, combined with IBM tools and our AI application suites. You will prepare, analyze, and understand data to deliver insight, predict emerging trends, and provide recommendations to stakeholders. In your role, you may be responsible for: Implementing and validating predictive and prescriptive models and creating and maintaining statistical models with a focus on big data & incorporating machine learning. techniques in your projects Writing programs to cleanse and integrate data in an efficient and reusable manner Working in an Agile, collabor...

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You''ll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you''ll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you''ll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: * Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, inco...

As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You’ll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you’ll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you’ll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporatin...

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You''ll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you''ll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you''ll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorp...

Create Solution Outline and Macro Design to describe end to end product implementation in Data Platforms including, System integration, Data ingestion, Data processing, Serving layer, Design Patterns, Platform Architecture Principles for Data platform Contribute to pre-sales, sales support through RfP responses, Solution Architecture, Planning and Estimation Contribute to reusable components / asset / accelerator development to support capability development Participate in Customer presentations as Platform Architects / Subject Matter Experts on Big Data, Azure Cloud and related technologies Participate in customer PoCs to deliver the outcomes Participate in delivery reviews / product review...

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You''ll contribute to data gathering, storage, and both batch and real-time processing Collaborating closely with diverse teams, you''ll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you''ll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorpor...

Should have strong experience in ETL testing with 6 to 9 years Should be strong in SQL query writing Experience with data warehousing and ETL processes Proficiency in Hadoop, Spark, and Hive Knowledge of SQL and NoSQL databases Experience with data warehousing and ETL processes This role involves working closely with data engineers, data analysts, and other stakeholders to ensure the accuracy, efficiency, and reliability of big data systems and applications

Job Title: Big Data Engineer (Snowflake) Experience: 5+ Years Budget: Up to 16.5 LPA Employment Type: Full-Time Job Description We are seeking a skilled Big Data Engineer (Snowflake) with strong experience in building scalable data pipelines and cloud-based data platforms. The candidate will work on large-scale data processing systems using Snowflake, Big Data technologies, and cloud platforms (AWS & GCP) . You will collaborate with analytics and engineering teams to deliver high-performance, reliable data solutions. Key Responsibilities Design, develop, and maintain end-to-end Big Data pipelines . Implement and optimize data warehousing solutions using Snowflake . Develop ETL/ELT pipelines ...

WorleyParsons Sdn Bhd is looking for Digital Solutions Consultant II to join our team Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform. Design, implement, and maintain a Data Quality Framework aligned with enterprise governance and compliance standards. Define, develop, and operationalize data quality rules, dimensions, and metrics in collaboration with business data owners and stewards. Conduct data profiling, anomaly detection, and root cause analysis to identify and resolve data quality issues. Implement automated monitoring, validation, and alerting within data pipelines and reporting environments. Manage and uti...

Overview ML Engineering team leads AI/ML deployments across Mastercard platforms. The team is responsible for planning the implementation of solutions, choosing the right technologies, and evaluating the evolution of the architecture as the needs change. For this team, MasterCard is seeking a Senior Data Engineer who is passionate about implementation of AI/ML assets across platform (on premise, on cloud, hybrid). The person would be working closely with Program Team as well as Data Science team. Technical & Other Skills 5+ years of working experience in scalable data pipeline using sparkSQL, Kafka, Nifi, Big data technologies. Experience of working with Databases like Oracle, Netezza and ha...

About the Role: We are looking for a visionary Product Manager to lead critical charters within the Myntra Data Platform. You will have the opportunity to shape our strategy, rebuild trust in data, and drive the execution of our ambitious plan towards a Governed Data Lakehouse. You will work with the Tech teams that build platforms that power everything from our core data infrastructure to our world-class Personalization & AI Engine, as well as self-serve tools like Morpheus (Experimentation) and Personify (Segmentation). This is a pivotal moment for MDP, and you will play a key role in enabling the "Agentic Future" by building the foundational Semantic Layer and Core Data Model. Key Respons...

Role Overview: We are seeking an Associate Architect - CPE to to design, develop, and optimize scalable, secure, and efficient cloud-based solutions. You will be working on cutting-edge technologies - like AI, Cloud and using frameworks like Agentic AI, MCP and RAG to solve complex problems in the domain of security, compliance, observability, developer productivity. You will work closely with cross-functional teams to architect tools, platforms, and infrastructure that empower engineering teams to build, deploy, and manage applications seamlessly. Your role will focus on leveraging cloud technologies, automation, and best practices to enhance platform reliability, performance, and developer...

The role is responsible for the design, integration, and management of high performance computing (HPC) systems that encompass both hardware and software components into the organizations network infrastructure. This individual will be responsible for all activities related to handling and supporting the Business and platforms including system administration, as well as incorporating new technologies under the challenge of a sophisticated and constantly evolving technology landscape. This role involves ensuring that all parts of a system work together seamlessly to meet the organizations requirements. Roles & Responsibilities: Implement, and manage cloud-based infrastructure that supports HP...

Job Summary We are seeking a Sr. Developer with 6 to 8 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in Python LakeHouse Spark Job Definition OneLake SQL and PySpark along with domain experience in Industry Essentials and Billing & Revenue Management. This role involves developing and optimizing data solutions to drive business success. Responsibilities Develop and maintain scalable data solutions using Python LakeHouse and Spark Job Definition to meet business requirements. Collaborate with cross-functional teams to design and implement data architecture solutions that align with company goals. Utilize OneLake and SQL to manage and anal...

Job Summary 5+ years of experience writing and deploying high-quality production code Spark/Pyspark with strong Python SQL. 5+ years of hands on experience in managing and optimizing Big Data ecosystems such as Spark Pyspark to build sustainable technical solutions that verifiably meet specific well-defined business requirements Experience selecting and using industry-standard open source and/or commercial tools and libraries to solve specific prob Responsibilities 8.Roles & Responsibilities Work collaboratively in a small team of engineers maintaining and improving our product Help shape the future of our technology platform. Infuse industry best practices into our team processes and develo...

Design, develop, and implement solutions to complex business problems. Collaborate with stakeholders to understand their needs and requirements. Develop and maintain standardized solutions that meet business needs. Identify and implement technologies and platforms to drive business growth. Lead cross-functional teams to achieve business objectives. Demonstrate leadership and accountability for managing risk and strengthening controls. Disclaimer: This job description has been sourced from a public domain and may have been modified by Naukri.com to improve clarity for our users. We encourage job seekers to verify all details directly with the employer via their official channels before applyi...

Overview: As a Sr Data Engineer of the AICOE team, you will develop analytical products and solutions that sit atop vast datasets gathered by retail stores, restaurants, banks, and other consumer-focused companies. The challenge will be to create high-performance algorithms built on data sets measured in the billions of transactions that allow our users to derive insights from big data that in turn drive their businesses with a keen eye for data privacy and governance. Role : - Leads talent acquisition efforts and initiatives, facilitates training programs and conducts performance management for team of direct reports - Lead teams in the creation of portfolio robust ML solutions through effe...

Role & responsibilities Strong Knowledge on Spark, Scala, Python, PySpark Strong in SQL concepts Good to have Knowledge on Bigdata Technologies like Hive ,Sqoop, Pig, Kafka, Flume. Experience in Version Control tools like SVN, GITHUB as well as experiences in Production deployment process. Basic knowledge in below skill sets: SQL Server Linux Shell Scripting Data Warehousing concepts Interacting with IT Business Analysts and / or our business partners to acquire the information necessary for product design. Following written requirements to help design databases and develop dashboards to support our customers. Translating raw data from multiple sources (ETL) into a single dataset at aggregat...