2551 Dataflow Jobs - Page 48

TCS is Hiring Data Architect For Pune and Chennai location Experience : 8 - 12 years Mode of interview : Virtual Location : Pune / Chennai JOB DESCRIPTION: Must have: Proficiency in SQL, data modeling tools, and pipeline orchestration tools. Familiar with modern data stacks (Snowflake, Databricks, Apache Spark, Kafka). Hands-on experience with at least one major cloud provider: AWS: S3, Glue, Redshift, Lake Formation, Athena, EMR Azure: Synapse, Data Factory, Data Lake Gen2, Databricks, Cosmos DB GCP: BigQuery, Dataflow, Pub/Sub, Cloud Composer, Dataplex Solid understanding of security best practices (IAM, encryption, data masking, tokenization). Strong knowledge of data governance, catalogi...

Join Us At Vodafone, we’re not just shaping the future of connectivity for our customers – we’re shaping the future for everyone who joins our team. When you work with us, you’re part of a global mission to connect people, solve complex challenges, and create a sustainable and more inclusive world. If you want to grow your career whilst finding the perfect balance between work and life, Vodafone offers the opportunities to help you belong and make a real impact. What You’ll Do Build and Operationalize data processing system as per Low level design Should have good knowledge of Spark ,Python and SQL framework and must have hands-on Experience on Dataproc. Data Flow knowledge is good to have ....

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data tra...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Job Description Role & Responsibilities Utilize Google Cloud Platform & Data Services to modernize legacy applications. Understand technical business requirements and define architecture solutions that align to Ford Motor & Credit Companies Patterns and Standards. Collaborate and work with global architecture teams to define analytics cloud platform strategy and build Cloud analytics solutions within enterprise data factory. Provide Architecture leadership in design & delivery of new Unified data platform on GCP. Understand complex data structures in analytics space as well as interfacing application systems. Develop and maintain conceptual, logical & physical data models. Design and guide P...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

We are seeking a skilled GCP AI Data Engineer to design, build, and optimize scalable data solutions on Google Cloud Platform. The role involves developing enterprise-grade data lakes, warehouses, and real-time systems, while leveraging AI/ML services for advanced analytics. The ideal candidate will have expertise in data architecture, pipeline development, infrastructure automation, and cloud-native technologies. Key Responsibilities: Design and implement scalable data architectures on GCP, including data lakes, data warehouses, and real-time processing systems. Develop and optimize ETL/ELT pipelines using Python, SQL, Airflow, and streaming technologies. Utilize Vertex AI and ML services t...

Position : Senior Data Analyst Location : Guindy Salary : 6 LPA to 9 LPA Experience : 5 Years and above ABOUT US Global leader in manufacturing human hair extensions and award winning exporter to USA and UK; DHPL leads the hair industry market in quality goods that are celebrated in hair salons, Hollywood studios, and opera and theater stages. We believe in growth and science by learning and applying advanced business techniques and R&D applications. OUR STORY DHPL is the daughter company to Hair & Compounds, Inc. located in California USA. After more than 20 years, together we have built a reputation for creating and providing human hair products into the high-end hair extension market know...

Role Overview We are seeking a skilled Data Engineer with 3+ years of hands-on experience in building and managing data pipelines, data models, and cloud-based analytics solutions on Google Cloud Platform (GCP) . The ideal candidate will have strong expertise in GCP-native services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Composer , along with proven experience in SQL, Python, and ETL/ELT design. This role requires working closely with data scientists, analysts, and business teams to ensure scalable, reliable, and high-performance data infrastructure. Key Responsibilities Data Pipeline Development Design, build, and optimize scalable ETL/ELT pipelines using GCP services (Dataf...

Through proprietary software and AI, along with a focus on customer delight, Sleek makes the back-office easy for micro SMEs. We give Entrepreneurs time back to focus on what they love doing - growing their business and being with customers. With a surging number of Entrepreneurs globally, we are innovating in a highly lucrative space. We operate 3 business segments: Corporate Secretary : Automating the company incorporation, secretarial, filing, Nominee Director, mailroom and immigration processes via custom online robots and SleekSign. We are the market leaders in Singapore with :5% market share of all new business incorporations Accounting & Bookkeeping : Redefining what it means to do Ac...

The ideal candidate should possess strong programming skills, particularly in Python, along with experience in ML frameworks like TensorFlow or PyTorch. You must have proven expertise in MLOps best practices, which includes model versioning, monitoring, automated deployment, and infrastructure automation. In-depth knowledge of Google Cloud Platform services is essential, specifically in Data Fusion, Dataproc, Dataflow for data processing, and pipeline orchestration. Experience with PostgreSQL databases and data integration tools like Qlik Replicate is also required. You should have expertise in security and privacy considerations for machine learning systems, including data encryption, acces...

Job Description Support the day-to-day operations of these GCP-based data pipelines, ensuring data governance, reliability, and performance optimization. Hands-on experience with GCP data services such as Dataflow, BigQuery, Dataproc, Pub/Sub, and real-time streaming architectures is preferred.The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. This role requires a flexible working schedule, including potential weekend support for critical operations, while maintaining a 40-hour work week.The Data Engineer will support our software developers, database architects, data analysts and data scienti...

The job requires a GCP DevOps professional with a minimum of 5 to 8 years of experience. The position is based in either Pune or Hyderabad and follows a hybrid work mode. The ideal candidate should be able to join within a notice period of immediate to a maximum of 60 days. This is a full-time employment opportunity with LTIMindtree. Key skills required for the role include proficiency in GCP, Kubernetes, Terraform, BigQuery, Dataflow, Cloud Composer, as well as experience with Ansible, Jenkins, or Cloud Build. For any queries or further information, please reach out to Prabal Pandey at Prabal.Pandey@alphacom.in.,

Position Overview Job Title - IT Architect Specialist, AVP Location - Pune, India Role Description This role is for a Senior business functional analyst for Group Architecture. This role will be instrumental in establishing and maintaining bank wide data policies, principles, standards and tool governance. The Senior Business Functional Analyst acts as a link between the business divisions and the data solution providers to align the target data architecture against the enterprise data architecture principles, apply agreed best practices and patterns. Group Architecture partners with each division of the bank to ensure that Architecture is defined, delivered, and managed in alignment with th...

I’m helping Motivity Labs, find a top candidate to join their team full-time for the role of ML Engineer . You'll build and deploy production-ready machine learning models on cloud platforms. Compensation: Provide your expected compensation while applying Location: Magellanic-Cloud, Knowledge City Road, Silpa Gram Craft Village, Rai Durg, Telangana, India Mission of Motivity Labs,: "Our mission is to strengthen the critical success factors of every organization that leverages our IT Services. Due to this Motivity Labs aspires to innovate alongside our clients to ensure value is created at each step. We are highly dedicated to maximizing the happiness and success of every client that chooses ...

Job Description Some careers shine brighter than others. If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to...

Position Overview Job Title: Senior Production Engineer Location: Pune, India Corporate Title: Associate Role Description Technology underpins our entire business. Our Technology, Data and Innovation (TDI) strategy is focused on strengthening engineering expertise, introducing an agile delivery model, as well as modernizing the bank's IT infrastructure. We continue to invest and build a team of visionary tech talent, providing you with the training, freedom and opportunity to do pioneering work. As an Support Engineer you will support Enterprise Data Services (EDS) Prod environment to satisfy complex and diverse business goals. You will engage and partner with the business whilst working wit...

About the Role: We are looking for a highly skilled Data Engineer with strong expertise in Google Cloud Platform (GCP) services, DBT, SQL/Python, and GitLab. The ideal candidate will be responsible for building scalable data pipelines, enabling analytics, and ensuring efficient data integration across platforms. Key Responsibilities: Design, build, and optimize scalable data pipelines and ETL processes on GCP. Develop and manage transformation workflows using DBT with SQL and Python. Ensure best practices in data modeling, governance, and performance optimization. Implement CI/CD pipelines and version control using GitLab. Collaborate with cross-functional teams including Data Scientists, An...

The Senior Software Engineer engineers secure, scalable and reliable technology solutions, with minimal mentoring, to advance CMEG in the global marketplace and serve risk management needs of customers around the world. Key Responsibilities: Provide operational support for our analytics system built on the KDB+ database management system and tooling. This includes monitoring performance, troubleshooting issues, and maintaining data pipelines to ensure system stability. Actively participate in the design, development, and implementation of new analytics solutions on GCP. This will involve refactoring existing workflows and building new capabilities using native GCP services. Utilize GCP's rea...

The Technical Specialist Software Engineering independently engineers secure, scalable and reliable technology solutions to advance CMEG in the global marketplace and serve risk management needs of customers around the world. Key Responsibilities: Provide operational support for our analytics system built on the KDB+ database management system and tooling. This includes monitoring performance, troubleshooting issues, and maintaining data pipelines to ensure system stability. Actively participate in the design, development, and implementation of new analytics solutions on GCP. This will involve refactoring existing workflows and building new capabilities using native GCP services. Utilize GCP...

Job Title: Mid-Level DevOps Engineer Location: Chennai Experience: 3–5 Years Employment Type: Full-time Overview: We’re looking for a Mid-Level DevOps Engineer to join our team and enhance the automation, scalability, and reliability of our infrastructure. You’ll work closely with development, operations, and data platform teams to manage CI/CD pipelines, Kubernetes clusters, and cloud environments on GCP and Azure , with a focus on AI/ML workload deployment . Key Responsibilities: Design and manage CI/CD pipelines (Jenkins, GitLab CI, Azure DevOps, etc.) Manage Kubernetes clusters and containerized microservices Build infrastructure using IaC tools (Terraform, Helm, Ansible) Work with GCP/A...

Role Description Job description Mandatory skills ANSISQL Apache airflow GCP BigQuery GCP Cloud Composer GCP Dataflow GCP Dataform GCP Datafusion GCP DataProc GCP Datastream GCP DMS GCP PubSub GCP Storage GCP Workflows Google Analytics Hub Java Python Scala 5 years Experience in GCP BigQuery Oracle PLSQL Good knowledge of GCP tools such as GCS DataFlow Cloud Composer Cloud Pub Sub Proficient in Big Query DBMS and BQL Able to design end to end batch process in GCP Competent in Linux and python scripting Terraform Scripting for creating the GCP infrastructure Good communication skills Proficient with CICD tools like GitHub Jenkins Nexus Skills Mandatory Skills : GCP Storage,GCP BigQuery,GCP Da...

Job Description: 5–12 years of experience in GCP Airflow, Dataflow, Apache Beam – Mandatory Experience in implementing the data pipeline (ETL) using Dataflow and Apache Beam Experience with GCP Cloud services Experience in continuous integration, delivery, deployment, and build tools such as Docker, Jenkins, SonarQube, JIRA, Nexus, Confluence, Git, Bitbucket, Maven, Gradle, RunDeck – is a plus Experience in API Development using Java, Microservices, Spring Boot – Good to have Extensive understanding of BDD, TDD practices, code review and analysis techniques , and open-source agile testing frameworks Participate in code and design reviews to maintain high development standards Good to know ho...

Company Description Magellanic Cloud Limited is a pioneer in technology innovation and adaptation, focusing on transforming business operations through advanced tech solutions. The organization excels in software development, digital transformation, AI, IoT, e-surveillance, and drone-based applications to address real-world challenges. With a dynamic team of over 1,600 skilled professionals, Magellanic Cloud supports a diverse portfolio of more than 100 clients, including multiple Fortune 1,000 companies. Our strong market presence emphasizes our capability to deliver innovative, technology-driven solutions in a competitive global tech landscape. Role Description This is a full-time on-site ...

Position : Data Manager Location : Guindy Salary : 6 LPA to 9 LPA Experience : 5 Years and above ABOUT US Global leader in manufacturing human hair extensions and award winning exporter to USA and UK; DHPL leads the hair industry market in quality goods that are celebrated in hair salons, Hollywood studios, and opera and theater stages. We believe in growth and science by learning and applying advanced business techniques and R&D applications. OUR STORY DHPL is the daughter company to Hair & Compounds, Inc. located in California USA. After more than 20 years, together we have built a reputation for creating and providing human hair products into the high-end hair extension market known in Ho...