1628 Data Flow Jobs - Page 27

About the Role: We are looking for a skilled Google Cloud Platform (GCP) Engineer who can design, implement, and manage scalable cloud solutions. The ideal candidate will have strong expertise in cloud infrastructure, data engineering, and automation to support business-critical applications and data pipelines. Key Responsibilities: Design, implement, and manage GCP infrastructure services (Compute Engine, Cloud Storage, IAM, VPC, Pub/Sub, etc.). Develop, optimize, and maintain ETL/ELT pipelines using BigQuery, Dataflow, Composer (Airflow), and Cloud Functions . Automate infrastructure provisioning using Terraform, Deployment Manager, or equivalent tools . Ensure security, scalability, and r...

We are looking for an experienced Data Engineer with expertise in Google Cloud Platform (GCP) to design, build, and maintain scalable data pipelines and cloud-native solutions. The ideal candidate should have strong hands-on experience in GCP services, SQL, and data engineering best practices. Key Responsibilities Design and develop ETL/ELT pipelines using Dataflow, Dataproc, and Cloud Composer (Airflow) . Build and optimize data warehouses and data lakes using BigQuery, Cloud Storage, and Pub/Sub . Collaborate with analysts, data scientists, and business stakeholders to deliver reliable data solutions. Implement data quality, governance, and security standards. Automate workflows, improve p...

Role Overview: As an experienced Engineer in the field of Electrical, Computer, or Instrumentation & Control, your primary responsibilities will include carrying out Engineering reviews, Testing, FAT, commissioning, and O&M activities. You will be tasked with providing prompt resolutions and high-quality technical support for the SAS and communication systems of AGEL installations, including Solar, Wind, and Substation projects in greenfield and brownfield settings. In this role, you will be expected to support Substation Automation and Communications, leading and mentoring the SAS & communication team. Your responsibilities will encompass ensuring end-to-end responsibility for value enginee...

As the Principal Data Engineer, you will lead the data engineering team and assist in formulating the organizational data strategy. Your responsibilities will include working with cloud analytics platform owners and business stakeholders to align with business objectives. You will play a vital role in defining the organizational data strategy, ensuring data quality standards, data flow, and data security. Your expertise will be crucial in translating business requirements into technical specifications and creating a blueprint for an integrated framework of accessible, secure data aligned with business strategies. Moreover, you will lead the Data Engineering team in agile delivery, supporting...

Role: GCP Data Engineer Skills: GCP Cloud, Big Query, GCP Cloud, Pyspark, SQL Server, Data flow Location: Hyderabad, Chennai, Bangalore, Pune, Mumbai, Delhi, Kolkata, Indore, Noida, Gurugram Roles and Responsibilities : Experience working in GCP based Big Data deployments Experience in GCP Big Query, air flow, Google Cloud Storage, Data fusion, Data flow, Data Proc Experience in the various services of Google Cloud Platform (GCP) cloud such as Cloud Storage, Data Flow, Data Proc, Big Query, Spanner, Big Table, Composer, Pub/Sub, Hyper-drive Good skills in Linux , Python Language, PYSPARK

Role Overview We are seeking an experienced Senior Python Developer to join the customer solutions engineering team. You will work closely with global customers to design, deploy, and scale customized solutions, ensuring seamless adoption and measurable impact. Key Responsibilities Act as a subject matter expert on customers operational analytics solution for networks, applications, and security workflows. Lead hands-on deployment of solutions to meet complex customer requirements. Collaborate with engineering and integration teams to deliver successful deployments. Own the design, development, and scaling of Proof-of-Concept (POC) deployments, driving them to production completion. Continuo...

Data Engineer with a focus on GCP. Minimum 1 year hands-on experience with Python, SQL, DataFlow, DataStream, Cloud Functions, Cloud Run, Pub/Sub, BigQuery, Cloud Storage & data ingestion, CDC techniques, and real-time/batch pipeline orchestration .

Minimum 5 years of hands-on experience in Power Platform development. Strong expertise in Canvas Apps and Model-Driven Power Apps.

About The Role : Job TitleData Engineer (ETL, Python, SQL, GCP) Corporate TitleAVP LocationPune, India Role Description Engineer is responsible for developing and delivering elements of engineering solutions to accomplish business goals. Awareness is expected of the important engineering principles of the bank. Root cause analysis skills develop through addressing enhancements and fixes 2 products build reliability and resiliency into solutions through early testing peer reviews and automating the delivery life cycle. Successful candidate should be able to work independently on medium to large sized projects with strict deadlines. Successful candidates should be able to work in a cross appli...

About The Role : Job Title GCP Data Engineer, AS LocationPune, India Role Description An Engineer is responsible for designing and developing entire engineering solutions to accomplish business goals. Key responsibilities of this role include ensuring that solutions are well architected, with maintainability and ease of testing built in from the outset, and that they can be integrated successfully into the end-to-end business process flow. They will have gained significant experience through multiple implementations and have begun to develop both depth and breadth in several engineering competencies. They have extensive knowledge of design and architectural patterns. They will provide engine...

About The Role : Job Title - IT Architect Specialist, AVP Location - Pune, India Role Description This role is for a Senior business functional analyst for Group Architecture. This role will be instrumental in establishing and maintaining bank wide data policies, principles, standards and tool governance. The Senior Business Functional Analyst acts as a link between the business divisions and the data solution providers to align the target data architecture against the enterprise data architecture principles, apply agreed best practices and patterns. Group Architecture partners with each division of the bank to ensure that Architecture is defined, delivered, and managed in alignment with the...

If you like improving and impacting the business with a passion for accounting, reporting and analysis and innovation this could be your chance to make your mark in the energy industry. You will grow in a supportive team working for a significant Shell business powering the lives of millions and ensuring decisions are made based on accurate, timely and insightful analysis. Whats the role? The IGU Par Lead is expected to support the delivery of Performance & Appraisal reporting to one of the IGU organization. This role holder will help the organisation plan and manage their spend for maximum return. The role holder will be expected to render operational support to the month close and PAR rela...

Job TitleData Engineer Experience5"“8 Years LocationDelhi, Pune, Bangalore (Hyderabad & Chennai also acceptable) Time ZoneAligned with UK Time Zone Notice PeriodImmediate Joiners Only Role Overview We are seeking experienced Data Engineers to design, develop, and optimize large-scale data processing systems You will play a key role in building scalable, efficient, and reliable data pipelines in a cloud-native environment, leveraging your expertise in GCP, BigQuery, Dataflow, Dataproc, and more Key Responsibilities Design, build, and manage scalable and reliable data pipelines for real-time and batch processing. Implement robust data processing solutions using GCP services and open-source tec...

Location: Bangalore, Mumbai, Mangalore, Udupi, Delhi/ NCR Region About Niveus Solutions: Niveus Solutions is a distinguished Google Cloud Premier Partner, dedicated to empowering businesses with transformative cloud solutions. We pride ourselves on leveraging the comprehensive suite of Google Cloud technologies, spanning from robust infrastructure modernization to cutting-edge AI/ML, advanced analytics, and secure hybrid/multi-cloud strategies. Our team is composed of highly skilled industry experts committed to solving complex business challenges and accelerating digital transformation for our diverse clientele. About the Role: We are seeking an exceptionally accomplished and visionary Prin...

Job Responsibilities. Collaborate with data scientists, software engineers, and business stakeholders to understand data requirements and design efficient data models.. Develop, implement, and maintain robust and scalable data pipelines, ETL processes, and data integration solutions.. Extract, transform, and load data from various sources, ensuring data quality, integrity, and consistency.. Optimize data processing and storage systems to handle large volumes of structured and unstructured data efficiently.. Perform data cleaning, normalization, and enrichment tasks to prepare datasets for analysis and modelling.. Monitor data flows and processes, identify and resolve data-related issues and ...

As a Marketing Technologies Architect, you will play a crucial role in designing and implementing scalable, efficient, and future-proof MarTech solutions that align technology with business goals and deliver personalized, data-driven experiences to customers across digital channels. Your responsibilities will include: - Evaluating, architecting, integrating, and optimizing various marketing technology platforms such as CMS, CRM, CDP, analytics, automation tools, and customer engagement systems. - Defining and maintaining the MarTech architecture strategy and roadmap aligned with business objectives. - Architecting end-to-end solutions across web, mobile, email, social, and paid media platfor...

As an Engineer at our company, you will play a crucial role in various aspects of Engineering review, Testing, FAT, commissioning, and O&M. Your primary focus will be on providing timely and high-quality technical support for the SAS and communication systems of AGEL installations, including Solar, Wind, Substation, etc., across greenfield and brownfield projects. You will also take charge of Substation Automation and Communications, guiding and mentoring the SAS & communication team, and ensuring end-to-end responsibility for value engineering, Factory Acceptance Testing, and commissioning of substation automation (SCADA) systems, FOTE & PLCC systems. Your responsibilities will encompass ta...

Mandatory skill- Advance Python & SQL GCP Services- BigQuery, Dataflow, Dataproc and Pub/Sub. Key Responsibilities Design, develop and optimize scalable data pipelines and ETL workflows using Google Cloud Platform (GCP), particularly leveraging BigQuery, Dataflow, Dataproc and Pub/Sub. Design and manage secure, efficient data integrations involving Snowflake and BigQuery. Write, test and maintain high-quality Python code for data extraction, transformation and loading (ETL), analytics and automation tasks. Use Git for collaborative version control, code reviews and managing data engineering projects. Implement infrastructure-as-code practices using Pulumi for cloud resources management and a...

Hi all, We are hiring for the role GCP DATA ENGINEER Experience: 5+ Years Location: Pune Notice Period: Immediate - 15 days Budget: 18 LPA only Skills: Ideally you will have a background in software engineering along with experience in working in a complex cloud environment ( Google Cloud Platform) Ideally you will have experience working with Python and SQL. You have experience building data pipelines and ETL frameworks both batch and real time using Python and any of the GCP capabilities such Apache Beam, Data Flow, Data Fusion You have Experience with using Terraform to build Infrastructure-as-a-code Experience working with Big Data Technologies (Spark, Cloud SQL, Big Query ) preferably i...

Job Title: GCP Data Engineer Location: Pune, India Experience: 3 to 7 Years Job Type: Full-Time Job Summary: We are looking for a highly skilled GCP Data Engineer with 3 to 7 years of experience to join our data engineering team in Pune . The ideal candidate should have strong experience working with Google Cloud Platform (GCP) , including Dataproc , Cloud Composer (Apache Airflow) , and must be proficient in Python , SQL , and Apache Spark . The role involves designing, building, and optimizing data pipelines and workflows to support enterprise-grade analytics and data science initiatives. Key Responsibilities: Design and implement scalable and efficient data pipelines on GCP , leveraging D...

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

Role & responsibilities Experience : Associate should have 3+ years of IT experience with good exposure into diagnosis and troubleshooting the complex issues . Technologies : IData Ingestion & ETL Pipelines,Dataflow/Dataproc/Pub/Sub,datasets,Vertex AI,BigQuery,Python,CI/CD for ML,Containerization,Proficiency in TensorFlow,Understanding of LLMs/Transformer,Prompt Engineering Must Have : Good communication customer handling skills with good knowledge into Bigquery, TensorFlow and Understanding of LLMs Good to Have : Monitoring and Logging and SQL Skills Certification : Google ACE,Machine Learning or equivalent certification

Design and implement scalable data architectures to optimize data flow and analytics capabilities Develop ETL pipelines, data warehouses, and real-time data processing systems Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery Work closely with data scientists to enhance machine learning models with structured and unstructured data Prior experience in handling large-scale datasets is preferred Keywords python,data warehousing,etl,amazon redshift,bigquery,data engineering,data architecture,aws,machine learning,data flow,etl pipelines,real-time data processing,java,spring boot,microservices,spark,kafka,cassandra,scala,nosql,mongodb,rest,redis,SQL*

8+ years of extensive experience in data engineering, data architecture, or analytics. 3 years in a dedicated data architect or solutions architect role. 5 years of hands-on experience data solutions specifically on Google Cloud Platform.

Job Purpose As a People & Culture Team, we are responsible for fostering a workplace and culture that empowers everyone to do their best work. This role is responsible for managing full product execution for specific product(s) within our HR technology landscape that are aligned to a specific focus area, such as Talent, Compensation & Benefits, CoreHR, Learning, and Recruiting, based on business needs. This role manages multiple project teams and coordinates with multiple stakeholders providing thought leadership and expertise within the HR technology landscape domain We are seeking an experienced and strategic Product Owner to lead our Global Time & Attendance solutions, with strong knowled...