1700 Dataflow Jobs - Page 10

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. Purpose of the Role: LUMI is company’s largest Big Data Platform, ideally suited for computationally and/or data intensive processing applications. Whether the dat...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. Purpose of the Role: LUMI is company’s largest Big Data Platform, ideally suited for computationally and/or data intensive processing applications. Whether the dat...

Data Engineer - GSR5/GSR6 This role requires a combination of software engineer, data enginner and an ML developer where you're expected to build solutions integrating data pipelines & ML models. It also requires you to have basic knowledge and (preferably) hands-on experience on building back-end services(APIs) which integrate data & applications. Required Skills and Qualifications: 4+ years of professional experience in software development. Strong proficiency and hands-on experience in both Python(Must-have) and Java(Nice to have) . Experience building and maintaining data pipelines (batch or streaming) preferably on Cloud platforms(especially GCP). Experience with at least one major dist...

You are passionate about quality and how customers experience the products you test. You have the ability to create, maintain and execute test plans in order to verify requirements. As a Quality Engineer at Equifax, you will be a catalyst in both the development and the testing of high priority initiatives. You will develop and test new products to support technology operations while maintaining exemplary standards. As a collaborative member of the team, you will deliver QA services (code quality, testing services, performance engineering, development collaboration and continuous integration). You will conduct quality control tests in order to ensure full compliance with specified standards ...

Location : Bangalore, Chennai, or Hyderabad Company : Mastech Digital ( www.mastechdigital.com ) 🧭 Job Summary As a key member of the Data business leadership team, you’ll be responsible for building and expanding GCP data and analytics capabilities, driving technical excellence, and ensuring successful delivery of GCP-based initiatives. This role involves collaboration with clients, delivery teams, alliance partners, and internal stakeholders. 🔹 Key Responsibilities Develop and enhance GCP offerings and accelerators Provide architectural guidance and lead solutioning for proposals Support delivery teams with deep GCP expertise Build and mentor a high-performing GCP team Collaborate with sal...

Design, build, and maintain scalable batch and streaming pipelines using Google Cloud Dataflow, Google Cloud Datastream, Airbyte, and orchestration tools (Airflow/Prefect/Dagster). Develop and optimize ETL/ELT processes across AWS Postgres, Google FHIR Store, and Google BigQuery. Build and maintain unified data models that integrate multiple healthcare data sources (EHR/FHIR, claims/X12, ADT/HL7, CRM, transactional Postgres, Tuva, and third-party APIs). Implement dbt/OBT transformations to create curated semantic layers for AI/LLM, BI, and predictive analytics. Ensure data quality, lineage, validation, and governance while maintaining HIPAA compliance and PHI/PII security. Collaborate with A...

You have over 10 years of experience in data engineering, specializing in cloud-based solutions. Your role involves designing solutions, reviewing team work, and providing guidance. Proficiency in Google Cloud Platform (GCP) and its various data services such as BigQuery, DBT & Streaming, Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer is essential. Your track record should demonstrate your ability to create scalable data pipelines and architectures. Experience with ETL tools, processes, and implementing ETL processes to transfer data to GCP warehouses like BigQuery is required. Your technical skills should include proficiency in DBT & Streaming, Dataflow, Cloud Storage, Cloud Composer,...

As a Google Cloud DevOps Engineer specializing in Terraform and CI/CD Pipeline, you will play a crucial role in provisioning GCP resources based on architectural designs that align with business objectives. Your responsibilities will include monitoring resource availability and usage metrics to provide guidelines for cost and performance optimization. You will be expected to assist IT and business users in resolving GCP service-related issues and provide guidance on cluster automation and migration approaches. Additionally, your role will involve provisioning GCP resources for data engineering and data science projects, including automated data ingestion, migration, and transformation. Key R...

About This Role About This Role We are seeking a high-reaching individual and passionate Associate with technical proficiency to join the Data Strategy & Solutions team. We are a team of seasoned Data Engineers and Platform Engineers building production-grade , cloud-native data products that power BlackRock’s investment decisions With over USD $11 trillion of assets, we have an outstanding responsibility: our technology empowers millions of investors to save for retirement, pay for college, buy a home and improve their financial wellbeing. Being a Data Product and Operation specialist at BlackRock means you get the best of both worlds: working for one of the most successful financial compan...

At Cotality, we are driven by a single mission—to make the property industry faster, smarter, and more people-centric. Cotality is the trusted source for property intelligence, with unmatched precision, depth, breadth, and insights across the entire ecosystem. Our talented team of 5,000 employees globally uses our network, scale, connectivity and technology to drive the largest asset class in the world. Join us as we work toward our vision of fueling a thriving global property ecosystem and a more resilient society. Cotality is committed to cultivating a diverse and inclusive work culture that inspires innovation and bold thinking; it's a place where you can collaborate, feel valued, develop...

DataFlow is looking for an ambitious, energetic and highly skilled Senior Manager within the Equivalence Services within DataFlow. This critical role combines team leadership with high-level operational and project coordination. The individual will foster close working relationships with internal and external stakeholders to ensure timely delivery. The ideal candidate will possess deep expertise in international education systems and qualifications including academic, technical, professional, and vocational, a proven track record of operational leadership to complex credentialing challenges and ensuring the highest standards of service delivery. DataFlow offers a flexible and collaborative w...

Job Description Data Engineer - GSR5/GSR6 This role requires a combination of software engineer, data enginner and an ML developer where you're expected to build solutions integrating data pipelines & ML models. It also requires you to have basic knowledge and (preferably) hands-on experience on building back-end services(APIs) which integrate data & applications. Responsibilities Key Responsibilities: Data Pipeline Development: Design, develop, and maintain scalable and reliable batch data pipelines using Python and Java, leveraging industry standard frameworks like Data proc and Dataflow. ELT Implementation: Implement efficient data extraction, transformation, and loading processes to move...

Role Description Role Proficiency: Act creatively to develop applications by selecting appropriate technical options optimizing application development maintenance and performance by employing design patterns and reusing proven solutions. Account for others' developmental activities; assisting Project Manager in day to day project execution. Outcomes Interpret the application feature and component designs to develop the same in accordance with specifications. Code debug test document and communicate product component and feature development stages. Validate results with user representatives integrating and commissions the overall solution. Select and create appropriate technical options for ...

DataFlow is looking for an ambitious, energetic and highly skilled Senior Manager within the Equivalence Services within DataFlow. This critical role combines team leadership with high-level operational and project coordination. The individual will foster close working relationships with internal and external stakeholders to ensure timely delivery. The ideal candidate will possess deep expertise in international education systems and qualifications including academic, technical, professional, and vocational, a proven track record of operational leadership to complex credentialing challenges and ensuring the highest standards of service delivery. DataFlow offers a flexible and collaborative w...

About AutoZone: AutoZone is the nation's leading retailer and a leading distributor of automotive replacement parts and accessories with more than 6,000 stores in US, Puerto Rico, Mexico, and Brazil. Each store carries an extensive line for cars, sport utility vehicles, vans and light trucks, including new and remanufactured hard parts, maintenance items and accessories. We also sell automotive diagnostic and repair software through ALLDATA, diagnostic and repair information through ALLDATAdiy.com, automotive accessories through AutoAnything.com and auto and light truck parts and accessories through AutoZone.com. Since opening its first store in Forrest City, Ark. on July 4, 1979, the compan...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. You Lead the Way. We’ve Got Your Back. With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you be...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. You Lead the Way. We’ve Got Your Back. With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you be...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. You Lead the Way. We’ve Got Your Back. With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you be...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. You Lead the Way. We’ve Got Your Back. With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you be...

We are seeking a highly motivated and experienced Analytics and Data Engineer to guide the data engineering team. The ideal candidate will have a strong background in data engineering, capable of data-driven decision-making. This role will be crucial in designing, developing, and maintaining our data infrastructure to support our business intelligence and analytics needs. Key Requirements Bachelor's or Master's degree in Computer Science, Data Science, or a related technical field. 6+ years of experience in a data engineering or similar role. Lead a team of data engineers and analysts, providing guidance, mentorship, and technical direction. Key Responsibilities Design, build, and maintain s...

Design and develop robust ETL pipelines using Python, PySpark, and GCP services. Build and optimize data models and queries in BigQuery for analytics and reporting. Ingest, transform, and load structured and semi-structured data from various sources. Collaborate with data analysts, scientists, and business teams to understand data requirements. Ensure data quality, integrity, and security across cloud-based data platforms. Monitor and troubleshoot data workflows and performance issues. Automate data validation and transformation processes using scripting and orchestration tools. Required Skills & Qualifications: Hands-on experience with Google Cloud Platform (GCP), especially BigQuery. Stron...

Key Responsibilities: Data Architecture & Management: Design and implement scalable, cloud-agnostic Data Lake, Data LakeHouse, Data Mesh and Data Fabric architectures to efficiently store, process, and manage structured and unstructured data from various sources. Data Pipeline Development : Design, develop, and maintain robust data pipelines to ingest, process, and transform data from multiple sources into usable formats for analytics and reporting using services like AWS Glue, Azure Data Factory, GCP Dataflow, Apache Spark, or Apache Airflow. Data Integration and ETL: Develop and optimize Extract, Transform, Load (ETL) and ELT processes to integrate disparate data sources into the data lake...

Design and develop robust ETL pipelines using Python, PySpark, and GCP services. Build and optimize data models and queries in BigQuery for analytics and reporting. Ingest, transform, and load structured and semi-structured data from various sources. Collaborate with data analysts, scientists, and business teams to understand data requirements. Ensure data quality, integrity, and security across cloud-based data platforms. Monitor and troubleshoot data workflows and performance issues. Automate data validation and transformation processes using scripting and orchestration tools. Required Skills & Qualifications Hands-on experience with Google Cloud Platform (GCP), especially BigQuery. Strong...

Job Description Some careers shine brighter than others. If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to...

Role Description Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be skilled in ETL tools such as Informatica Glue Databricks and DataProc with coding expertise in Python PySpark and SQL. Works independently and has a deep understanding of data warehousing solutions including Snowflake BigQuery Lakehouse and Delta Lake. Capable of calculating costs and understanding performance issues related to data solutions. Outcomes Act creatively to develop pipelines and applications by selecting appropriate technical options optimizing application dev...