1700 Dataflow Jobs - Page 9

About Position: We are hiring for Lead Python engineer with hands on experience with Apache Beam, databricks etc., Role: Lead Python Platform Engineer – Architecture & Performance Location: All PSL Locations Experience: 3 to 7 Years Job Type: Full Time Employment What You'll Do: Architecture and reuse: Design and build a shared component library/SDK for pipelines: ingestion, parsing/OCR, extraction (RegEx now, LLM/SLM later), validation, enrichment, publishing. Define patterns/templates for Apache Beam pipelines and Databricks jobs; standardize configuration, packaging, versioning, CI/CD, and documentation. Create pluggable interfaces so multiple teams can swap extractors (Regex/LLM), OCR pr...

Syncverse Solutions builds production-grade data and AI pipelines on Google Cloud. We help clients turn messy, multi-source data into reliable analytics and ML—fast. Our stack centers on Dataflow (Apache Beam), BigQuery, Pub/Sub, Vertex AI, Cloud Run/Functions, and Composer . Role Overview As a Junior Cloud Engineer , you’ll help design, build, and operate cloud infrastructure and ETL pipelines on GCP . You’ll work with senior engineers to turn requirements into secure, automated, cost-efficient solutions—learning best practices in SRE, DataOps, and MLOps along the way. What you’ll do Implement and maintain GCP resources (Projects, IAM, Service Accounts, GCS, Pub/Sub, BigQuery, VPC, Cloud Ru...

Job description Some careers shine brighter than others. If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to...

If you are looking for a career at a dynamic company with a people-first mindset and a deep culture of growth and autonomy, ACV is the right place for you! Competitive compensation packages and learning and development opportunities, ACV has what you need to advance to the next level in your career. We will continue to raise the bar every day by investing in our people and technology to help our customers succeed. We hire people who share our passion, bring innovative ideas to the table, and enjoy a collaborative atmosphere. Who we are: ACV is a technology company that has revolutionized how dealers buy and sell cars online. We are transforming the automotive industry. ACV Auctions Inc. (ACV...

Strong expertise in Google Cloud Platform (GCP) Hands-on experience with BigQuery, Dataflow, Dataproc, Pub/Sub Proficiency in SQL & Python Experience with ETL pipelines, data modeling, and data warehousing

Job Title: Site Reliability Engineering (SRE) Manager 📍 Location: Hyderabad 🕒 Employment Type: Full-Time 🏢 Work Model: Hybrid (3 Days from Office) About the Role We are looking for an experienced Site Reliability Engineering (SRE) Manager to lead our reliability engineering function, ensuring infrastructure resiliency, operational excellence, and seamless user experiences. This hybrid leadership role blends hands-on technical expertise with strategic team leadership and cross-functional collaboration . Experience Required 10+ years of total IT experience. 3+ years in a leadership role within SRE or Cloud Operations. Technical Knowledge & Skills Mandatory: Kubernetes, GKE, Prometheus, Terrafo...

About AutoZone JOB DESCRIPTION AutoZone is the nation's leading retailer and a leading distributor of automotive replacement parts and accessories with more than 6,000 stores in US, Puerto Rico, Mexico, and Brazil. Each store carries an extensive line for cars, sport utility vehicles, vans and light trucks, including new and remanufactured hard parts, maintenance items and accessories. We also sell automotive diagnostic and repair software through ALLDATA, diagnostic and repair information through ALLDATAdiy.com, automotive accessories through AutoAnything.com and auto and light truck parts and accessories through AutoZone.com. Since opening its first store in Forrest City, Ark. on July 4, 1...

About Position: We are looking for an experienced and talented Python Architect to join our growing data competency team. The ideal candidate will have a strong background in working with Lead Python Platform, Apache Beam + Databricks platform, parsing/OCR, Validation, Implementation, Cloud (AWS/Azure/GCP). We have built the core features, but need a senior engineer to architect. Role: Python Architect Location: All Persistent Locations Experience: 7 to 14 Years Job Type: Full Time Employment What You'll Do: Architecture and reuse: Design and build a shared component library/SDK for pipelines: ingestion, parsing/OCR, extraction (RegEx now, LLM/SLM later), validation, enrichment, publishing. ...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. LUMI is the company’s largest Big Data Platform, purpose-built for computationally and data-intensive processing applications. Whether data is processed in batch, ...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. Purpose of the Role: LUMI is company’s largest Big Data Platform, ideally suited for computationally and/or data intensive processing applications. Whether the dat...

About McDonald’s: One of the world’s largest employers with locations in more than 100 countries, McDonald’s Corporation has corporate opportunities in Hyderabad. Our global offices serve as dynamic innovation and operations hubs, designed to expand McDonald's global talent base and in-house expertise. Our new office in Hyderabad will bring together knowledge across business, technology, analytics, and AI, accelerating our ability to deliver impactful solutions for the business and our customers across the globe. Position Summary: Data Platform Support / Platform Engineer III As a Data Platform Support Engineer, you will design, implement, and maintain scalable and secure platform services t...

Location: Bangalore - Karnataka, India - EOIZ Industrial Area Job Family: Artificial Intelligence & Machine Learning Worker Type Reference: Regular - Permanent Pay Rate Type: Salary Career Level: T3(B) Job ID: R-47974-2025 Description & Requirements Introduction: A Career at HARMAN Automotive We’re a global, multi-disciplinary team that’s putting the innovative power of technology to work and transforming tomorrow. At HARMAN Automotive, we give you the keys to fast-track your career. Engineer audio systems and integrated technology platforms that augment the driving experience Combine ingenuity, in-depth research, and a spirit of collaboration with design and engineering excellence Advance i...

As a data engineer at Enlyft, you will play a vital role in our data platform team, contributing to the development of our cutting-edge data platform. Your main responsibilities will involve constructing robust data pipelines for data acquisition, processing, and implementing optimized data models. You will also be tasked with creating APIs and data products to support our machine learning models, insights engine, and customer-facing applications. Throughout the data platform lifecycle, you will leverage the power of GenAI while ensuring a strong focus on data governance to maintain timely data availability with high accuracy. To excel in this role, we are seeking individuals with a Bachelor...

About The Organisation DataFlow Group is a pioneering global provider of specialized Primary Source Verification (PSV) solutions, and background screening and immigration compliance services that assist public and private organizations in mitigating risks to make informed, cost-effective decisions regarding their Applicants and Registrants. DataFlow with its best practices in this field such as a high level of data security, cutting-edge technology, rigorous processes, qualified research analysts, and a global network of over 100,000 issuing authorities, verifies professionals credentials from the primary issuer of the document - regardless of its nature. We are seeking a highly skilled and ...

This role is for a GCP Data Engineer who can build cloud analytics platforms to meet expanding business requirements with speed and quality using lean Agile practices. You will work on analysing and manipulating large datasets supporting the enterprise by activating data assets to support Enabling Platforms and Analytics in the GCP. You will be responsible for designing the transformation and modernization on GCP. Experience with large scale solutions and operationalizing of data warehouses, data lakes and analytics platforms on Google Cloud Platform or other cloud environment is a must. We are looking for candidates who have a broad set of technology skills across these areas and who can de...

As a qualified candidate for this role, you should have in-depth expertise in Google Cloud Platform (GCP) services such as Pubsub, BigQuery, Airflow, Data Proc, Cloud Composer, and Google Cloud Storage (GCS). Additionally, proficiency in DataFlow and Java is a must for this position. Experience with Kafka would be considered a plus. Your responsibilities will include working with these technologies to design, develop, and maintain scalable and efficient data processing systems. If you meet these requirements and are eager to work in a dynamic and innovative environment, we look forward to reviewing your application.,

6+years of solid hands-on experience as a Data Engineer, Proven experience in designing and implementing data pipelines using GCP BigQuery or cloud platform. Strong SQL and scripting languages like Python Expert in data quality tools and techniques.

Equifax is seeking creative, high-energy and driven software engineers with hands-on development skills to work on a variety of meaningful projects. Our software engineering positions provide you the opportunity to join a team of talented engineers working with leading-edge technology. You are ideal for this position if you are a forward-thinking, committed, and enthusiastic software engineer who is passionate about technology. What You’ll Do Demonstrate a deep understanding of cloud native, distributed micro service based architectures Deliver solutions for complex business problems through software standard SDLC Build strong relationships with both internal and external stakeholders includ...

DataVisualizationEngineer Headquartered in Dublin, Ohio, Cardinal Health, Inc. (NYSE: CAH) is a global, integrated healthcare services and products company connecting patients, providers, payers, pharmacists and manufacturers for integrated care coordination and better patient management. Backed by nearly 100 years of experience, with more than 50,000 employees in nearly 60 countries, Cardinal Health ranks among the top 20 on the Fortune 500. Department Overview augmented Intelligence ( augIntel ) builds automation, analytics and artificial intelligence solutions that drive success for Cardinal Health by creating material savings, efficiencies and revenue growth opportunities. The team drive...

Lead Data Engineer – Python & GCP Job Overview: We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing, architecting the solution, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) & ELT data pipelines. The role involves working with customers directly, gathering requirements, discovery phase, designing, architecting the solution, using various GCP services, implementing data transformations, data ingestion, data quality, and consistency across systems, and post post-de...

7 - 9 Years 1 Opening Trivandrum Role description Role Proficiency: Act creatively to develop applications by selecting appropriate technical options optimizing application development maintenance and performance by employing design patterns and reusing proven solutions. Account for others' developmental activities; assisting Project Manager in day to day project execution. Outcomes: Interpret the application feature and component designs to develop the same in accordance with specifications. Code debug test document and communicate product component and feature development stages. Validate results with user representatives integrating and commissions the overall solution. Select and create ...

You are passionate about quality and how customers experience the products you test. You have the ability to create, maintain and execute test plans in order to verify requirements. As a Quality Engineer at Equifax, you will be a catalyst in both the development and the testing of high priority initiatives. You will develop and test new products to support technology operations while maintaining exemplary standards. As a collaborative member of the team, you will deliver QA services (code quality, testing services, performance engineering, development collaboration and continuous integration). You will conduct quality control tests in order to ensure full compliance with specified standards ...

Job Description You will work with diverse datasets, from structured logs to unstructured events, to build intelligent systems for event correlation, root cause analysis, predictive maintenance, and autonomous remediation, ultimately driving significant operational efficiencies and improving service availability. This position requires a blend of deep technical expertise in machine learning, a strong understanding of IT operations, and a commitment to operationalizing AI solutions at scale. Responsibilities As a Senior Data Scientist, your responsibilities will include, but are not limited to: Machine Learning Solution Development: Design, develop, and implement advanced machine learning mod...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. You Lead the Way. We’ve Got Your Back. With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you be...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. You Lead the Way. We’ve Got Your Back. With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you be...