2042 Data Flow Jobs - Page 13

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

GCP Data Engineer We are seeking a skilled GCP Data Engineer with 5 to 10 years of experience in cloud-based data engineering, including minimum 5+ years of hands-on work with GCP services such as BigQuery, Dataflow, Airflow , and Python . Key Responsibilities Design, develop, and deploy scalable IoT data pipelines using GCP services. Build and optimize data workflows using BigQuery , Dataflow , and Airflow . Write clean, reusable, and maintainable Python code for data processing tasks. Monitor and troubleshoot data ingestion and transformation processes to ensure reliability. Collaborate with cross-functional teams to integrate IoT data with analytics and monitoring platforms. Implement sec...

Job description below. 5+ years of experience in the data engineering field is preferred 3+ years of Hands-on experience in GCP cloud data implementation suite such as Big Query, Pub Sub, Data Flow/Apache Beam, Airflow/Composer, Cloud Storage, Strong experience and understanding of very large-scale data architecture, solutioning, and operationalization of data warehouses, data lakes, and analytics platforms. Hands on Strong Experience in the below technology 1. GBQ Query 2. Python 3. Apache Airflow 4. SQL (BigQuery preferred) Extensive hands-on experience working with data using SQL and Python Cloud Functions. Comparable skills in AWS and other cloud Big Data Engineering space is considered....

Software Engineer-II engineers secure, scalable and reliable technology solutions, with minimal mentoring, to advance CMEG in the global marketplace and serve risk management needs of customers around the world. Key Responsibilities: Provide operational support for our analytics system built on the KDB+ database management system and tooling. This includes monitoring performance, troubleshooting issues, and maintaining data pipelines to ensure system stability. Actively participate in the design, development, and implementation of new analytics solutions on GCP. This will involve refactoring existing workflows and building new capabilities using native GCP services. Utilize GCP's real-time a...

Looking for 5+ Years of experience notice period- immediate to 60 days Skill required - GCP - Data Side, Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow

Role : Business Analyst Role Overview We are looking for an experienced Business Analyst with strong expertise in Salesforce and data-driven business systems. The ideal candidate should have a solid understanding of enterprise data processes, functional systems design, and process improvement methodologies to drive efficiency and deliver impactful business solutions. Responsibilities: Must have salesforce experience. Experience designing and implementing functional systems and data in a structured process. Ability to research data definition, usage and flow to gain expertise in existing systems. Ability to create new business processes and data usage to promote efficiency. Ability to multi-t...

Min 2Yrs of exp in React,Redux,React native,JavaScript,ES6,CSS3&Web App Developement Exp building complex features&interfaces for React applications Exp in Version control Git,NPM,Restful APIs Deep understanding of data structures,data flow,Ajax&CRUD

Looking for 5+ Years of experience notice period- immediate to 60 days Skill required - GCP - Data Side, Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow

Company Description- Bigul.co is dedicated to providing investors and traders with the right tools to achieve success in the stock market. We believe that matched with the right strategies, stocks, and tools, everyone has the potential to win in trading. Our mission is to empower every investor to attain their financial goals. Role Overview- We are seeking an experienced Business Analyst (BA) with strong domain knowledge in Capital Markets, BFSI, and Fintech Platforms. The BA will act as a bridge between business stakeholders and technology teams, gathering requirements, analyzing processes, and ensuring delivery of scalable, compliant, and innovative solutions. Key Responsibilities: Work cl...

Greetings from Tata Consultancy Services!! We are hiring GCP Data Engineer ! Position: GCP Data Engineer Job Location: Chennai/Bangalore/Hyderabad/Gurugram/Pune Experience : 10-12 years Interested professionals kindly apply through the link. Must Have: Proficiency in programming languages: Python, Java - Expertise in data processing frameworks: Apache Beam (Data Flow) - Active experience on GCP tools and technologies like Big Query, Dataflow, Cloud Composer, Cloud Spanner, GCS, DBT etc., - Data Engineering skillset using Python, SQL - Experience in ETL (Extract, Transform, Load) processes - Knowledge of DevOps tools like Jenkins, GitHub, Terraform is desirable. Should have good knowledge on ...

Job Title: GCP Data Engineer Location: Pune, India Experience: 3 to 7 Years Job Type: Full-Time Interested candidates can send your your resume on pranitathapa@onixnet.com Job Summary: We are looking for a highly skilled GCP Data Engineer with 3 to 7 years of experience to join our data engineering team in Pune . The ideal candidate should have strong experience working with Google Cloud Platform (GCP) , including Dataproc , Cloud Composer (Apache Airflow) , and must be proficient in Python , SQL , and Apache Spark . The role involves designing, building, and optimizing data pipelines and workflows to support enterprise-grade analytics and data science initiatives. Key Responsibilities: Desi...

Job Description Some careers shine brighter than others. If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to...

Key Responsibilities Design and implement data pipelines using GCP services such as BigQuery , Dataflow , Pub/Sub , Cloud Functions , and Cloud Storage . Develop and maintain ETL workflows leveraging Cloud Composer (Airflow) for orchestration. Migrate on-premise data systems to Google Cloud Platform , ensuring scalability and reliability. Optimize data warehouse solutions in BigQuery for performance and cost efficiency. Implement data quality checks , monitoring, and alerting using GCP tools. Collaborate with cross-functional teams to gather requirements and deliver actionable insights. Ensure compliance with data governance , security, and best practices. Work in Agile environments , managi...

Position: Senior Information Security Operations Analyst / Network Security Engineer Level 7 Location: Pune, India Date: 12th Nov 2025 Time: Indian Standard Time (9AM – 6PM), Extended upto 7:30 PM IST – 8:30 PM IST by Weekly Contract Duration: 1 years No. of Positions: 2 Notice Period: 15 days to Immediate Joiner Interview Round : 3 Rounds Work Mode : 3 Days WFO 2 Days WFH TOP SKILLS Access control Data Flow Design Engineers Customised Tools Network Security Engineer Firewalls Analysing Security assessment skills Any Scripting Language AWS Python Scripting Job Description & Top Skills Required: Strong knowledge of networking (layer 3 & 4 ports and protocols) Expertise in network security con...

Role: Associate Architect - Data Experience Level: 6 to 10 Years Work location: Mumbai, Bangalore or Trivandrum (Hybrid) Notice period: Preferred up to 45 days Role & Responsibilities: 5+ years of experience in building and managing Data Lakes, Data Warehouse, Data Integration, Data Migration and Business Intelligence/Artificial Intelligence solutions on GCP Cloud. Ability to understand business requirements, translate them into functional and non-functional areas, and define non-functional boundaries in terms of Availability, Scalability, Performance, Security, Resilience etc. Experience in architecting, designing, and implementing end-to-end data pipelines and data integration solutions fo...

Were Hiring: Artificial Intelligence Specialist Immediate Joiners Location: Chennai, Sholinganallur, Elcot SEZ 600119 Job Type: Full-time | Permanent Experience: 5+ years in enterprise software & AI/LLM integration About the Role: Are you passionate about AI, LLMs, and Generative AI ? We are looking for a solution-oriented AI Specialist to transform business operations with innovative AI solutions. This is not a traditional ML engineering role —we are seeking someone who can strategically integrate AI capabilities into enterprise systems and deliver real business impact . Immediate joiners welcome! Key Responsibilities: AI Solution Strategy & Innovation Identify opportunities where AI/LLM in...

Skills: Proficiency in SQL is a must. PL/SQL to understand integration SP part. Experience in PostgreSQL is must. Basic knowledge of Google Cloud Composer ( or Apache Airflow). Composer is managed GCP service for Apache Airflow. All pipelines are orchestrated and scheduled through Composer GCP basics-high level understanding of using GCP UI and services like Cloud SQL PostgreSQL Cloud Composer Cloud Storage Dataproc Airlfow DAGs are written in Python basic knowledge of Python code for DAGs Dataproc is Managed Spark in GCP so a bit of PySpark knowledge is also nice to have.

GCP Data Engineer Must have - 5+ Years Experience, Google Cloud Storage, Big Query, Dataflow, PUB/SUB Streaming, Apache beam (Python / Java). Good to have - Airflow, Google data forms. Detailed JD We are seeking a highly skilled GCP Data Engineer to join our team. The ideal candidate will have extensive experience with Google Cloud Platform (GCP) services, particularly Dataflow, BigQuery, Pub/Sub, and related services. Additionally, the candidate should be proficient in provisioning infrastructure on GCP using Infrastructure as Code (IaC) with Terraform. This role will be critical in building and managing data pipelines, ensuring data quality, and optimizing data storage and retrieval proces...

1. GCP Data Engineer Lead :1. GCP Data Engineer :Experience: 10-15 years of experience in data engineering, with a focus on cloud-based solutions. Extensive experience with Google Cloud Platform (GCP) and its data services, including BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer. Proven track record of designing and building scalable data pipelines and architectures. Experience with ETL tools and processes. Design, develop, and maintain robust and scalable data pipelines using GCP services such as Dataflow, Pub/Sub, Cloud Functions, and Cloud Composer. Implement ETL (Extract, Transform, Load) processes to ingest data from various sources into GCP data warehouses like BigQuer...

GCP Data Architect Job Overview: We are seeking a skilled Data Consultant/ Data Architect to design and manage the enterprise data architecture, ensuring the efficient and secure handling of data across the organization. The ideal candidate will possess extensive experience in data modelling, database design, and data management practices. Responsibilities: Data Architecture Design: Drive architecture and design conversations with client Architecture Board Develop and maintain the data architecture, including data models (industry standard Telecom data model), data flow diagrams, and database schemas. Design and implement data integration frameworks, ensuring data consistency and reliability...

Description: Role Description : 2-4 years of hands-on experience with SAP SuccessFactors Onboarding configuration and support. Minimum 1 implementation on SuccessFactors Onboarding or should have worked on support projects as well. Should be certified in SuccessFactors Onboarding 2.0 Should understand how Onboarding is integrated with Recruiting and how data flows into Employee Central. Provide second-level support to HR and end-users addressing inquiries troubleshooting issues and resolving system-related problems. Experience with integrations and data management. Strong communication and interpersonal skills. Good To Have Skills - Experience with SuccessFactors Recruiting or SuccessFactors...

GCP Data Engineer Primary Skill : Big Querry, Data flow, Data Composer, SQL, Python, Pyspark Proven experience as a Data Engineer with a focus on GCP services. Strong proficiency in GCP services such as Dataflow, BigQuery, and Pub/Sub. Hands-on experience with Terraform for provisioning and managing GCP infrastructure. Proficiency in Pyspark, SQL and Python for data manipulation and analysis. Solid understanding of data warehousing concepts and ETL processes. Experience with real-time data processing and streaming analytics. Strong problem-solving skills and attention to detail. Excellent communication and collaboration skills.

Has experience in Guidewire DataHub and InfoCenter Development. Has fundamental understanding of Data Warehouse. Worked on ETL tool SAB BODS Designer Components-Jobs Workflows Data Flows Data Store and Scripts. Extensively used ETL methodology for Data Extraction transformations loading. Experience in writing SQL queries in Oracle. Design Develop Test Debug and Implement DataHub and InfoCenter and SAP BODS and work closely with functional team. Experience on Installations and configure the repositories and establish the data source connections in SAP BODS. Has knowledge of Insurance Business domain. Good to have Guidewire PC/BC data knowledge. Ability to analyze incidents defects and triage ...

Job Title:Information Technology - Java DeveloperLocation :PuneHybrid roleExperience :10+ YearsPosition:2 Role:Design, develop, test, and deploy microservices-based applications using Java, Spring Boot, Kafkaand other relevant technologies. Work in an SRE culture to ensure the availability, scalability, and reliability of our applications. Ensure the application meets quality standards by developing and implementing automated tests,including unit tests, integration tests, and end-to-end tests Participate in code reviews, design reviews, and other team activities to ensure code quality andmaintainability. Continuously monitor and improve the applications performance, reliability, and scalabil...

JD GCP Data Engineer Responsibilities: Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub. Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently. Use Pub/Sub for real time data ingestion and streaming analytics. Provision and manage GCP infrastructure using Terraform, ensuring best practices in IaC are followed. Optimize data storage and retrieval processes to enhance performance and reduce costs. Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability of data services. Ensure data quality and integrity through robust testing and validation processes...