3201 Data Pipelines Jobs - Page 35

We are looking for someone who has: Multi-cloud experience, both public and private cloud. Strong knowledge of continuous delivery, testing, security practices, performance, and disaster recovery. Experience supporting mission-critical, customer facing systems in production environments, including incident management response. Responsibilities: Collaborate with developers to promote the concept of reliability engineering during all phases of the SDLC to detect and correct performance issues early in the lifecycle. Scope tooling and automation, monitoring, workflow management, maintaining and improving data pipelines, CI/CD, etc. Assess gaps in as-is monitoring tool capabilities and develop a...

Your Impact As a Software Data Engineer, you will invent, build, and optimize real-time data pipelines and ETL/ELT workflows using AWS services and Amazon Redshift. Youll ensure our data infrastructure is reliable, scalable, and high performing to support business analytics. Key responsibilities include developing and automating data pipelines, optimizing data models and Redshift schemas, managing AWS data lakes and warehouses, and championing data quality, security, and best practices. Youll also collaborate across teams and mentor others to foster a culture of innovation and excellence. Minimum Qualifications (Required) 8+ years of experience in data engineering, with a focus on AWS cloud-...

Summary We are looking for a Data Engineer to join the Data Engineer team. This is a pivotal role, responsible for supporting multiple Data Analysts and Data Scientists day-to-day and assisting various data-driven requests across the company. The position involves a wide variety of technical skills, from coding to infrastructure, from data analysis to database management. The ideal candidate will have experience working with large-scale data and building automated data ETL processes for large-scale data analysis. ODS or data warehousing experience would be ideal. Key responsibilities include: Designing, implementing, and maintaining the tooling and infrastructure that enables our Analysts an...

Manager, Quality Compliance Role Name: Manager, Quality Compliance Department Name: R&D Quality Role GCF: 5 Role Description: The manager will work within R&D Qualitys Business Intelligence and Data Analytics (BIDA) team to help deliver actionable information and recommendations to key leaders and stakeholders by maintaining and expanding our data pipelines, tools, reporting, and data communication strategies. This role contributes to ensuring Amgens pursuit of life-saving medication is done with the highest regard for quality and compliance to regulations. Roles & Responsibilities: As an integral team member working globally with BIDA, other R&D Quality team members, and R&D Quality stakeho...

Job Summary: We are looking for a highly experienced Senior Lead Data Engineer / Architect specializing in Snowflake data warehousing, with strong skills in Power BI. The ideal candidate will have 8-14 years of experience in data engineering and analytics, with proven leadership in designing, implementing, and optimizing large-scale Snowflake architectures and developing high-impact business intelligence solutions using Power BI. Key Responsibilities: Lead the end-to-end architecture, design, and implementation of enterprise-grade data solutions on Snowflake. Build and maintain complex data pipelines and advanced ETL/ELT frameworks, leveraging Snowflakes native features for scalability and p...

Project description We are seeking a skilled Machine Learning Engineer to develop and deploy Graph Neural Network (GNN) based surrogate models that approximate complex physics simulations for oil & gas pipeline and well networks This is a hands-on role for someone who can build high-fidelity neural network models that replace computationally expensive reservoir and network simulators (Nexus, Prosper) Responsibilities Design and implement Neural Network architectures to model flow dynamics in interconnected pipeline networks Build surrogate models that accurately predict pressure distributions, flow rates, and network behavior under varying operational scenarios (training data is acquired thr...

Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation. Job Description Data Testing Strategy & Execution: Design, develop, and execute comprehensive test plans and test cases for data-centric applications, ETL processes, data warehouses, data lakes, and reporting solutions. SQL-Driven Validation: Utilize advanced SQL queries to perform complex data validation, data reconciliation, data integrity checks, and data quality assurance across various financial data sources. ETL Testing: Conduct thorough testing of ETL (Extract, Transform, Load) processes, ensuring data is accurately extracted, transformed according to business rules, and loaded correctly into ...

We are seeking an Associate Director Lead Security Resilience with 10+ years of deep technical and leadership experience to own and evolve our enterprise-wide security resilience program in a high-velocity, AI-first organization. You will be the authoritative voice on resilience strategyensuring the company can withstand, adapt to, and rapidly recover from cyber attacks, major incidents, and disruptive events without compromising trust, availability, or velocity. You will partner at the highest levels with Engineering, Infrastructure, Product, Risk, and Executive Leadership to turn resilience from a compliance checkbox into a measurable competitive advantage. This is a strategic yet deeply h...

Key Responsibilities : Data Testing Strategy & Execution: Design, develop, and execute comprehensive test plans and test cases for data-centric applications, ETL processes, data warehouses, data lakes, and reporting solutions. SQL-Driven Validation: Utilize advanced SQL queries to perform complex data validation, data reconciliation, data integrity checks, and data quality assurance across various financial data sources. ETL Testing: Conduct thorough testing of ETL (Extract, Transform, Load) processes, ensuring data is accurately extracted, transformed according to business rules, and loaded correctly into target systems. Data Quality Assurance: Implement and monitor data quality checks, ide...

Looking for a talented and enthusiastic individual to join our team as a Trainee - Software in SLK Digital Private Limited. The ideal candidate should have a strong foundation in AI/ML and be eager to learn and grow with our company. Roles and Responsibility Collaborate with cross-functional teams to design, develop, and deploy software applications using AI/ML techniques. Participate in code reviews and contribute to improving the overall quality of the codebase. Develop and maintain large-scale data pipelines and architectures using AI/ML tools and technologies. Work closely with senior developers to identify and prioritize project requirements. Design and implement automated testing frame...

Req ID: 344131 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Power BI-GCP Integration to join our team in Bangalore, Karn?taka (IN-KA), India (IN). We are seeking a skilled and proactive Developer with expertise in Power BI and Google Cloud Platform (GCP) to join our Integrations team. The ideal candidate will be responsible for designing, developing, and maintaining integration solutions that support business intelligence and cloud-based applications. Key Responsibilities: Perform detailed design of application an...

Responsibilities: Developing data pipelines for collecting, processing, and analyzing diverse datasets. Design and implement deep learning architectures for large volumes of data. Conduct experiments and tests to evaluate model performance. Contribute to optimizing and fine-tuning existing machine learning models. Build pipelines for monitoring, managing and constantly improving production ML/DL models.

We are currently looking for Data Integration Developer - SAP BODS to join a fast growing product based Organisation in Pune. If you have strong background in Data Integration and having hands-on development, including table replications, extractors, and transformations, ensuring smooth and accurate data flow between systems such as SAP BODS, data warehouses, and cloud platforms. We'd love to hear from you. Role: Data Integration Developer - SAP BODS Location: Baner, Pune Relevant Experience: 8+ years of experience in data integration development. Strong hands-on experience with SAP BODS, CPI-DS, AecorSoft, or other ETL tools. Experience in replicating and extracting data from SAP applicatio...

Join our digital revolution in NatWest Digital X In everything we do, we work to one aim. To make digital experiences which are effortless and secure. So we organise ourselves around three principles: engineer, protect, and operate. We engineer simple solutions, we protect our customers, and we operate smarter. Our people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. This role is based in India and as such all normal working days must be carried out in India. Job Description Join us as a Quality Manager We'll look to you to provide direction and leadership on all quality matters across the ...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Analytics Good to have skills : NA Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implem...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Palantir Foundry Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Project Role :Lead Data Engineer Project Role Description :Design, build and enhance applications to meet business process and requirements in Palantir foundry.Work experience :Minimum 6 years Must have Skills :Palantir Foundry , PySparkGood to Have Skills : Experience in Pyspark, python and SQL Knowledge on Big Data tools & Technologies Organizational and proj...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Palantir Foundry, MySQL, Python (Programming Language), PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solution...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Snowflake Data Warehouse Good to have skills : Data Engineering, Data Building Tool, Fivetran Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Snowflake Lead, you will build scalable, secure, and high-performance Snowflake pipelines across multiple projects and teams. Your typical day will involve collabo...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Snowflake Data Warehouse, Data Engineering Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Snowflake Sr. Data Engineer, you will build scalable, secure, and high-performance Snowflake pipelines across multiple projects and teams. Your typical day will involve collaborating with T...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Analytics Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implem...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Analytics Good to have skills : NA Minimum 12 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and imple...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Analytics Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and impl...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Analytics Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and impl...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Analytics Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implem...