1700 Dataflow Jobs - Page 11

Sr Data Engineer GCP **Experience:** 5-8 years of IT experience, with a minimum of 2-3 years specifically focused on GCP data Services . **Location:** Gurugram or Hyderabad **About the Role:** We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic data and analytics team. The ideal candidate should have strong technical skills in GCP data services , responsible for designing, developing, and implementing robust and insightful data intensive solutions using GCP Cloud . This role requires a deep understanding of data engineering, strong SQL skills, and extensive experience with various GCP services like Bigquery , DataFlow , DataStream , Pub/Sub , Dataproc , C...

Job Description What you’ll do: You will be working as a Data architect within the Healthcare & Life Sciences domain, designing and delivering big data pipelines for structured and unstructured data that are running across multiple geographies, helping healthcare organizations achieve their business goals with use of data ingestion technologies, cloud services & DevOps. You will be working with Architects from other specialties such as Cloud engineering, Software engineering, ML engineering to create platforms, solutions and applications that cater to latest trends in the healthcare industry such as digital diagnosis, software as a medical product, AI marketplace, amongst others. Role & Resp...

It's fun to work in a company where people truly BELIEVE in what they are doing! We're committed to bringing passion and customer focus to the business. Job Responsibilities Be an integral part of large-scale client business development and delivery engagements by understanding the business requirements. Hands-on with Dataflow/Apache beam and Realtime data streaming Engineer ingestion and processing pipelines on GCP using python libraries, Java, BigQuery and composer. Automate the repeatable tasks into a framework that can be reused in other parts of the projects. Handle the data quality, governance, and reconciliation during the development phases. Being able to communicate with internal/ex...

We are looking for a skilled and motivated Data Engineer to join our team and help design, build, and maintain robust data pipelines and infrastructure. You will play a crucial role in ensuring that high-quality, reliable data is available across the organization to drive analytics, reporting, and machine learning initiatives. This role is ideal for candidates who are passionate about working with large datasets, modern data stacks, and solving real-world problems with scalable data solutions. Key Responsibilities Design, develop, and optimize scalable ETL/ELT data pipelines for structured and unstructured data Build and maintain data infrastructure across cloud platforms (e.g., AWS, GCP, Az...

We are seeking a highly skilled and motivated Lead DS/ML engineer to join our team. The role is critical to the development of a cutting-edge reporting platform designed to measure and optimize online marketing campaigns. We are seeking a highly skilled Data Scientist / ML Engineer with a strong foundation in data engineering (ELT, data pipelines) and advanced machine learning to develop and deploy sophisticated models. The role focuses on building scalable data pipelines, developing ML models, and deploying solutions in production to support a cutting-edge reporting, insights, and recommendations platform for measuring and optimizing online marketing campaigns. The ideal candidate should be...

As a Principal Software Engineer, you will play a vital role in the design, development, and deployment of advanced AI and generative AI-based products. Your main responsibilities will include driving technical innovation, leading complex projects, and working closely with cross-functional teams to deliver high-quality, scalable, and maintainable solutions. To excel in this role, you must possess a strong background in software development, AI/ML techniques, and DevOps practices. Additionally, mentoring junior engineers and contributing to strategic technical decisions are key aspects of this position. Your primary responsibilities will involve advanced software development, where you will b...

As a Data Architect with over 10 years of experience, you will be responsible for leading data-related projects focused on Reporting and Analytics. Your tasks will include designing, building, and maintaining scalable data lakes and data warehouses in the cloud, specifically in GCP (Google Cloud Platform). Your expertise will be crucial in gathering business requirements, analyzing business needs, and defining the BI/DW architecture to support and deliver technical solutions to complex business and technical requirements. You will also play a key role in creating solution prototypes, participating in technology selection, performing Proof of Concepts (POCs), and delivering technical presenta...

The company StatusNeo is a global consulting firm that specializes in cutting-edge AI, automation, and cloud-first digital solutions. With a focus on product & platform engineering, the team at StatusNeo includes top-notch software engineers and product designers who are experts in their respective fields. Located in Gurugram, StatusNeo is a Great Place To Work certified organization that values innovation and collaboration. As a GCP Data Engineer at StatusNeo, your primary responsibility will be designing, developing, and maintaining scalable data pipelines and architectures on Google Cloud Platform. Working alongside data scientists, analysts, and other stakeholders, you will ensure that d...

As a Data Engineer at Aptiv, you will play a crucial role in designing, developing, and implementing a cost-effective, scalable, reusable, and secured Ingestion framework. Your primary responsibility will be to work closely with business leaders, stakeholders, and source system Subject Matter Experts (SMEs) to understand and define the business needs, translate them into technical specifications, and ingest data into Google Cloud Platform, specifically BigQuery. You will be involved in designing and implementing processes for data ingestion, transformation, storage, analysis, modeling, reporting, monitoring, availability, governance, and security of high volumes of structured and unstructure...

As a Tech Anchor/Solution Architect within the Industrial System Analytics (ISA) team, you will play a crucial role in providing technical leadership and guidance to the development team, ensuring the design and implementation of cloud analytic solutions using GCP tools and techniques. Your responsibilities will include offering technical guidance, mentorship, and code-level support to the team, as well as collaborating to develop and implement solutions using GCP tools and APIs/Microservices. You will be accountable for driving adherence to security, legal, and Ford standard/policy compliance while focusing on efficient delivery and identifying and mitigating risks. In this role, you will l...

You will be expected to have hands-on project experience with GCP core products and services, including GCP Networking, VPCs, VPCSC, and Google Artefact Registry. It is essential to have extensive experience in Infrastructure as Code, including TF custom Modules and TF module Registry. Moreover, you should possess hands-on experience with GCP Data products such as Bigquery, Dataproc, Dataflow, and Vertex AI. Familiarity with Kubernetes and managing container Infrastructure, specifically GKE, is also required for this role. The role involves automation using programming languages like Python, Groovy, etc. Additionally, having an understanding of Infrastructure security, threat modeling, and G...

As a GCP Data Engineer specialized in Data Migration & Transformation, you will be responsible for designing and constructing robust, scalable data pipelines and architectures on Google Cloud Platform (GCP), particularly focusing on BigQuery. Your primary tasks will involve migrating and transforming large-scale data systems and datasets to GCP while emphasizing performance, scalability, and reliability. It will be crucial for you to automate data lineage extraction and ensure data integrity across various systems and platforms. Collaborating closely with architects and stakeholders, you will play a key role in implementing GCP-native and 3rd-party tools for data ingestion, integration, and ...

Job Description You will work with diverse datasets, from structured logs to unstructured events, to build intelligent systems for event correlation, root cause analysis, predictive maintenance, and autonomous remediation, ultimately driving significant operational efficiencies and improving service availability. This position requires a blend of deep technical expertise in machine learning, a strong understanding of IT operations, and a commitment to operationalizing AI solutions at scale. Responsibilities As a Senior Data Engineer your responsibilities will include, but are not limited to: Machine Learning Solution Development: Design, develop, and implement advanced machine learning model...

2-4 years of experience using Microsoft SQL Server (version 2008 or later). Ability to create and maintain complex T-SQL queries, views, and stored procedures. 0 -1+ year experience performing advanced ETL development including various dataflow transformation tasks. Ability to monitor the performance and improve the performance by optimizing the code and by creating indexes. Proficient with Microsoft Access and Microsoft Excel Knowledge of descriptive statistical modeling methodologies and techniques such as classification, regression, and association activities to support statistical analysis in various healthcare data. Strong knowledge of Data Warehousing concepts Strong written, verbal an...

Job Overview: We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems. Key Responsibilities: Design, develop, test, and maintain scalable ETL data pipelines using Python Work extensively on Google Cloud Platform (GCP) services such as: Dataflow for real-time and batch data...

Are you ready to contribute to Mondelz International's mission of leading the future of snacking with pride As a member of the analytics team, you will play a vital role in supporting the business by developing data models that uncover trends essential for driving long-term business results. In this role, you will work closely with analytics team leaders to execute the business analytics agenda, collaborate with external partners adept in leveraging analytics tools and processes, and utilize models/algorithms to identify signals, patterns, and trends that can enhance long-term business performance. Your methodical approach to executing the business analytics agenda will effectively communica...

You will be responsible for designing and implementing scalable, secure, and cost-effective data architectures using Google Cloud Platform (GCP). Your role will involve leading the design and development of data pipelines utilizing tools such as BigQuery, Dataflow, and Cloud Storage. Additionally, you will architect and implement data lakes, data warehouses, and real-time data processing solutions on GCP while ensuring alignment with business goals, governance, and compliance requirements. Collaboration with stakeholders to define data strategy and roadmap will be a key aspect of your responsibilities. Your expertise in data engineering, specifically with at least 6 years of experience in GC...

o Design and implement data pipelines on the Google Cloud Platform (GCP). o Work with GCP services like BigQuery, Dataflow, and Cloud Storage. Required Candidate profile o Process and analyze large datasets to support business intelligence and reporting. o Ensure data quality, integrity, and security in the GCP data lake.

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. How will you make an impact in this role? Responsible for contacting clients with overdue accounts to secure the settlement of the account. Also they do preventive...

We are looking for a talented Full Stack Developer to contribute to our core product development. You will be involved in the full software development lifecycle, building scalable and user-friendly applications. Responsibilities Develop and maintain backend components. Utilize Node.js for backend development and frameworks like Express.js (Node.js ) or Django. Design and interact with databases such as MySQL, MongoDB, or PostgreSQL. Build and consume RESTful APIs and understand microservices. Work with cloud platforms, preferably AWS. Participate in an Agile/Scrum environment. Requirements Strong proficiency in Node.js or Java. Strong knowledge of backend frameworks (Express.js or Django) a...

Summary Position Summary AI & Data In this age of disruption, organizations need to navigate the future with confidence, embracing decision making with clear, data-driven choices that deliver enterprise value in a dynamic business environment. The AI & Data team leverages the power of data, analytics, robotics, science and cognitive technologies to uncover hidden relationships from vast troves of data, generate insights, and inform decision-making. The portfolio helps clients transform their business by architecting organizational intelligence programs and differentiated strategies to win in their chosen markets. AI & Data will work with our clients to: Implement large-scale data ecosystems ...

Summary Position Summary AI & Data In this age of disruption, organizations need to navigate the future with confidence, embracing decision making with clear, data-driven choices that deliver enterprise value in a dynamic business environment. The AI & Data team leverages the power of data, analytics, robotics, science and cognitive technologies to uncover hidden relationships from vast troves of data, generate insights, and inform decision-making. The portfolio helps clients transform their business by architecting organizational intelligence programs and differentiated strategies to win in their chosen markets. AI & Data will work with our clients to: Implement large-scale data ecosystems ...

Job Description Strong programming skills, particularly in Python, with experience in ML frameworks like TensorFlow or PyTorch. Proven expertise in MLOps best practices including model versioning, monitoring, automated deployment, and infrastructure automation. In-depth knowledge of Google Cloud Platform services including Data Fusion, Dataproc, Dataflow for data processing and pipeline orchestration. Experience working with PostgreSQL databases and data integration tools like Qlik Replicate. Expertise in security and privacy considerations for machine learning systems, including data encryption, access control, and compliance with regulations such as GDPR and HIPAA. Strong communication and...

Position Overview: We are looking for a motivated Integration Developer hands-on expertise or training in Google Cloud Platform (GCP) and practical knowledge in Oracle Fusion support. In this role, you will design, build, and maintain integrations between cloud platforms, on-premise systems, and Oracle Fusion applications. You’ll also play a key role in ensuring data consistency, system reliability, and seamless information flow across enterprise platforms. ShyftLabs is a growing data product company that was founded in early 2020 and works primarily with Fortune 500 companies. We deliver digital solutions built to help accelerate the growth of businesses in various industries, by focusing o...

Data Engineer Job Description Position Overview 🚀 Yesterday is history, tomorrow is a mystery, but today is a gift. That's why we call it the present. - Master Oogway Join CustomerLabs' dynamic data team as a Data Engineer and play a pivotal role in transforming raw marketing data into actionable insights that power our digital marketing platform. As a key member of our data infrastructure team, you will design, develop, and maintain robust data pipelines, data warehouses, and analytics platforms that serve as the backbone of our digital marketing product development. Sometimes the hardest choices require the strongest wills. - Thanos (but we promise, our data decisions are much easier! 😄) I...