3177 Data Pipelines Jobs - Page 11

The opportunity Were looking for candidates with strong technology and data understanding in big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team. Your key responsibilities Lead and Architect migration of data analytics environment from Teradata to Snowflake with performance and reliability Develop & deploy big data pipelines in a cloud environment using Snowflake cloud DW ETL design, development and migration of existing on-prem ETL routines to Cloud Service Interact with senior leaders, understand their business goals, contribute to the delivery of the workstreams D...

The opportunity You will be responsible to develop large and complex web applications architecture, composed of components, standards that govern which how data is represented, arranged, integrated and used by users, including the design, build and documents to address business requirements You will be responsible Create sound project plans with the business by engaging with multidisciplinary teams, and by identifying, managing and mitigating risk You will be responsible to develop relationships across the business to understand data requirements, applies deep technical knowledge of data management to solve business problems in areas where solutions may not currently exist, necessitating new...

RoleData Architect DesignationManager Preferred Experience10+ years Key Responsibilities Design and implement robust data architectures on Azure, Google Cloud, or on-premises platforms like Cloudera. Develop and optimize data pipelines, architectures, and data sets for real-time data integration. Ensure data architecture aligns with business requirements and supports the creation of data products. Apply expertise in SQL and data modelling to manage and manipulate large, complex data sets. Utilize data virtualization tools to provide efficient access to various data sources. Implement Master Data Management (MDM) and Data Quality frameworks to maintain high data integrity. Collaborate with cr...

The opportunity As an AI Engineer, part of our EY-DET-FS team, you will be responsible for developing and implementing AI-powered solutions and GenAI applications . You will work hands-on with Large Language Models (LLMs) , Retrieval-Augmented Generation (RAG) frameworks, and cloud-native AI tools to deliver intelligent, scalable, and secure enterprise solutions. Youll collaborate closely with AI Architects, Cloud Engineers, and Product Owners to build and deploy next-generation AI services that transform business processes and enhance user experiences. Your Technical Responsibilities Develop and implement AI and GenAI-based microservices and APIs leveraging frameworks such as LangChain, Lla...

AI Native Engineering_SAP EY is a global leader in assurance, tax, transaction, and advisory services. Technology is at the heart of what we do and deliver at EY. Technology solutions are integrated in the client services we deliver and are key to our innovation as an organization. Fueled by strategic investment in technology and innovation, Client Technology seeks to drive growth opportunities and solve complex business problems for our clients through building a robust platform for business and powerful product engine that are vital to innovation at scale. As part of Client Technology, youll work with technologists and business experts, blending EYs deep industry knowledge and innovative i...

The opportunity Were looking for candidates with strong technology and data understanding in big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team. Your key responsibilities Develop and deploy data lakehouse pipelines in a cloud environment using AWS and Databricks services. Design and implement end-to-end ETL/ELT workflows using Databricks (PySpark, Delta Lake, DLT) and AWS native services such as S3, Glue, Lambda, and Step Functions. Migrate existing on-premises ETL workloads to the AWS + Databricks platform with optimized performance and cost efficiency. Interact wi...

RoleData Architect DesignationManager Preferred Experience10+ years Key Responsibilities Design and implement robust data architectures on Azure, Google Cloud, or on-premises platforms like Cloudera. Develop and optimize data pipelines, architectures, and data sets for real-time data integration. Ensure data architecture aligns with business requirements and supports the creation of data products. Apply expertise in SQL and data modelling to manage and manipulate large, complex data sets. Utilize data virtualization tools to provide efficient access to various data sources. Implement Master Data Management (MDM) and Data Quality frameworks to maintain high data integrity. Collaborate with cr...

Your key responsibilities Technical Excellence Proficient in building and managing data pipelines, models, and integrations in alignment with the Medallion Lake architecture. Hands-on experience with Databricks notebooks and scripting to facilitate advanced analytics solutions. Skilled in supporting cloud-based analytics delivery utilizing Azure, Databricks, and enterprise ERP systems such as SAP and Oracle. Strong understanding of data governance practices to uphold data quality and enable data-driven decision-making across various industries. Experience in implementing data-driven initiatives that enhance business processes and risk management strategies. Skills and attributes To qualify f...

TitleData Engineer EY is a global leader in assurance, tax, transaction and advisory services. Technology is at the heart of what we do and deliver at EY. Technology solutions are integrated in the client services we deliver and are key to our innovation as an organization. Fueled by strategic investment in technology and innovation, Client Technology seeks to drive growth opportunities and solve complex business problems for our clients through building a robust platform for business and powerful product engine that are vital to innovation at scale. As part of Client Technology, youll work with technologists and business experts, blending EYs deep industry knowledge and innovative ideas wit...

Data Engineer Life Sciences R&D (Senior Level) Experience8+ Years Role Overview As a senior Data Engineer, you will be responsible for building robust, scalable, and compliant data pipelines from raw scientific sources to integrated and consumption-ready data products in the R&D landscape. You will partner with architects, domain SMEs, and analysts to develop re-usable components supporting early discovery, development, and regulatory needs. Key Responsibilities Design and implement pipelines across L1L3 layers using Databricks and Spark. Develop modular, parameterized ETL processes for large-scale scientific data integration. Implement and maintain STTM mappings and transformation logic wit...

The opportunity As a Data Analytics Specialist at EY, you will play a pivotal role in designing, managing, and optimizing our data infrastructure. You will be part of the Data Strategy team, contributing to the technological aspects of data infrastructure for Clients & Industries (C&I) and select EY-wide data. Your work will directly enable the business to innovate and stay ahead of the competition. Key responsibilities Translate data-driven insights into actionable decisions. Solve problems with a rapid prototyping mindset and a curiosity about data. Use data visualization to translate statistical models into business value. Uncover hidden potential by pinpointing data optimization patterns...

The opportunity You will be responsible to develop large and complex web applications architecture, composed of components, standards that govern which how data is represented, arranged, integrated and used by users, including the design, build and documents to address business requirements You will be responsible Create sound project plans with the business by engaging with multidisciplinary teams, and by identifying, managing and mitigating risk You will be responsible to develop relationships across the business to understand data requirements, applies deep technical knowledge of data management to solve business problems in areas where solutions may not currently exist, necessitating new...

At Oracle Cloud Infrastructure (OCI), we build the future of the cloud for Enterprises as a diverse team of fellow creators and inventors. We act with the speed and attitude of a start-up, with the scale and customer-focus of the leading enterprise software company in the world. In the OCI AI Science org we are addressing exciting challenges at the intersection of artificial intelligence and cutting-edge cloud infrastructure. As a Data Scientist IV, you will lead the development of large-scale datasets and leverage machine learning and generative AI to advance Generative AI models. You will drive the design of benchmarking frameworks, define best practices for data quality and fairness, and ...

As a Member of Technical Staff engineer, you will be responsible for developing data-centric applications, using AI/ML models to enhance insights provided to our customers. You will implement the complete SDLC , development, testing, first class monitoring, to production. Responsibilities As part of the software engineering division, you will utilize your foundational to intermediate understanding of software architecture to carry out tasks related to developing, debugging, and designing software applications or operating systems, guided by provided design specifications. You will implement enhancements within existing architectures and, at times, recommend improvements. Key responsibilities...

Title and Summary We are seeking a Director-Level Agentic AI Architect who sits at the intersection of massive-scale data engineering and advanced agentic intelligence You will architect the data fabric, the real-time reasoning loops, and the distributed infrastructure required to run AI systems at scalefar beyond prompt engineering This role begins as a hands-on Principal Architect/IC responsible for delivering Phase 0 (PoC) and Phase 1 (MVP) After successful delivery, the role evolves into product engineering leadership, where you will hire and lead a high-impact cross-functional team (AI, Data, Backend, QA) to collaborate with engineering team to scale the platform Core Responsibilities 1...

Project description We are seeking highly skilled and motivated Generative AI Engineers to join our growing AI team. You will be responsible for designing, developing, and deploying cutting-edge Generative AI solutions using LLMs, Transformers, and Diffusion models. This role involves working on enterprise-grade applications such as intelligent chatbots, document summarization, code assistants, and more. Responsibilities Design, prototype, and deploy Generative AI models (LLMs, Transformers, Diffusion models) for real-world enterprise use cases. Build and fine-tune LLM-based applications such as: Chatbots, Document Q&A systems, Report generators, Code assistants and Summarization tools. Appl...

Join us as a Quality Automation Specialist In this key role, youll be undertaking and enabling automated testing activities in all delivery models Well look to you to support teams to develop quality solutions and enable continuous integration and assurance of defect free deployment of customer value Youll be working closely with feature teams and a variety of stakeholders, giving you great exposure to professional development opportunities We're offering this role at associate vice president level What you'll do Joining us in a highly collaborative role, youll be contributing to the transformation of testing using quality processes, tools, and methodologies, significantly improving control,...

Join us as a Data Engineer Were looking for someone to build effortless, digital first customer experiences to help simplify our organisation and keep our data safe and secure Day-to-day, youll develop innovative, data-driven solutions through data pipelines, modelling and ETL design while inspiring to be commercially successful through insights If youre ready for a new challenge, and want to bring a competitive edge to your career profile by delivering streaming data ingestions, this could be the role for you We're offering this role at associate vice president level What youll do Your daily responsibilities will include you developing a comprehensive knowledge of our data structures and me...

As a Snowflake Expertise, you will have the opportunity to leverage your 10+ years of experience in designing, building, optimizing, and maintaining robust and scalable data solutions on the Snowflake platform. Your strong background in data modelling, ETL/ELT, SQL development, performance tuning, scaling, monitoring, and security handling will be crucial in translating business requirements into efficient and reliable architecture of data pipelines and data models. Your passion for unlocking data-driven insights and driving business value through Snowflake's capabilities will be key to your success. Key Responsibilities: - Proficient in Snowflake architecture, including virtual warehouses, ...

As the Technology Enablement and Automation Manager at Flutter, you play a crucial role in delivering elements of the ICFR pillar of the global finance transformation programme. You report directly or indirectly to the Head of Technology Enablement and Automation Transformation. Flutter consists of two commercial divisions (FanDuel and International) and central Flutter Functions; COO, Finance & Legal, where the Flutter Edge is the competitive advantage, driving the ongoing success. Role Overview: - Design, develop, launch, and maintain custom technical solutions to enhance Flutters Internal Controls over Financial Reporting (ICFR) annual cycle. - Continuously improve Finance and IT processe...

Role Overview: As a NiFi Data Engineer at the company, your role involves designing, developing, and maintaining scalable data pipelines using NiFi. You will ensure the efficient flow and transformation of data to support the platform's analytical needs. Key Responsibilities: - Bring the guiding principles to life by enhancing experiences for dealerships and customers, collaborating with colleagues, experimenting with new ideas, taking ownership of work, and adapting to growth and changes. - Collaborate with cross-functional teams to understand data requirements and deliver solutions. - Champion data quality and integrity across the organization. - Apply deep technical knowledge of data engi...

Role Overview: You are a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. Your focus will be on implementing batch and streaming pipelines, applying the bronze-silver-gold data lakehouse model, and ensuring scalable and reliable data solutions. Key Responsibilities: - Design, develop, and operationalize scalable data pipelines on Databricks following medallion architecture principles. - Migrate and transform large data volumes from traditional on-prem systems (Oracle, Hadoop, Exadata) into cloud data platforms. - Develop efficient Spark (PySpark/Scala) jobs for ingestion, transformation, aggregation, an...

As a Data and AI initiatives driver, your main focus will be on revenue recognition and profitability management. You will be responsible for leading a high-performing team, nurturing client and partner relationships, owning the practice's solutioning team, and handling RFP responses. Key Responsibilities: - Provide expert guidance in data engineering including architecture, warehousing, ETL/ELT, data lakes, pipelines, and governance. - Stay updated with AI/ML, big data, and cloud platforms such as AWS, Azure, GCP. - Oversee the design and implementation of scalable and secure data solutions. Qualifications Required: - Minimum 20 years of total experience, ideally transitioning from a data c...

You will be joining a worldwide network of smart and driven colleagues experienced in leading statistical tools, methods, and applications. Your role will involve providing analytically informed, issue-based insights at scale to help clients improve outcomes and achieve high performance. **Roles & Responsibilities:** - Work through the phases of the project - Define data requirements for Data Driven Growth Analytics capability - Clean, aggregate, analyze, interpret data, and carry out data quality analysis - Have knowledge of market sizing and lift ratios estimation - Experience in working with non-linear optimization techniques - Proficiency in Statistical Timeseries models, store clusterin...

As a GMO Data Analytics and MI - Architecture Lead, you will be responsible for client service and operational execution tasks. You must ensure control of risk and enhance controls within your job scope as per regulations. Your role will involve following well-defined procedures, applying judgment based on practice and experience. To excel in this position, you should have previous experience in: - Managing and delivering business reporting functions, including detailed data analytics and designing reports - Using and integrating Business Intelligence Tools (Alteryx, Tableau, SAP BO, POWER BI) with data management platforms like SQL, AWS Redshift, MongoDB - Knowledge of Banking, specifically...