1629 Data Flow Jobs - Page 35

Job Purpose This role is central to managing the airlines operational data, building scalable data pipelines, enabling organization-wide reporting, and driving automation using the Microsoft ecosystem. Key Accountabilities Functional Activities Leading a team of experienced data engineers and analyst Design and maintain end-to-end data pipelines using SQL, Microsoft Fabric, and Python to support operations and planning analytics. Develop and manage centralized databases and reusable data models for seamless integration across Power BI, Power Apps, and other analytics platforms. Build and optimize Power BI dashboards and data models, implementing Row-Level Security (RLS), performance tuning, ...

Consultant- GCP Snowflake: Elevate Your Impact Through Innovation and Learning Evalueserve is a global leader in delivering innovative and sustainable solutions to a diverse range of clients, including over 30% of Fortune 500 companies. With a presence in more than 45 countries across five continents, we excel in leveraging state-of-the-art technology, artificial intelligence, and unparalleled subject matter expertise to elevate our clients' business impact and strategic decision-making. Our team of over 4, 500 talented professionals operates in countries such as India, China, Chile, Romania, the US, and Canada. Our global network also extends to emerging markets like Colombia, the Middle Ea...

Job Title: GCP Data Engineer (3+ Years Experience) Location: Hyderabad & Chennai (Hybrid Mode) Experience: 3+ Years Employment Type: Full-Time Joining Preference: Immediate Joiners (Max 20 Days Notice Period) About the Company Random Trees is a leading Data & AI company, headquartered in Texas, USA, with development centers in Hyderabad and Chennai, India. With a strong team of 500+ professionals and growing 3X year-over-year, we specialize in AI product innovation and enterprise-scale strategic services. We are a proud strategic partner of many global clients across industries such as Pharma, Banking, Oil & Gas, Manufacturing, and Retail. Job Description We are looking for a GCP Data Engine...

Job Description: GCP Data Engineer We are looking for a highly skilled and experienced GCP Data Engineer as a Lead Programmer Analyst. Experience should have 4 to 7 years of data engineering. Should have strong development skills in GCP services like BigQuery, DataProc, Dataflow, Dataform. Should have good knowledge in SQL. Should have good knowledge in Python. Should have good knowledge in Pyspark. Good Experience on Airflow, Git, CI/CD pipelines. Good to have Knowledge in Cloud SQL, Dataplex. Understanding on the SDLC. Understanding on the Agile methodologies. Communication with customer and producing the Daily status report. Should have good oral and written communication. Should be a goo...

Salary: 25 to 40 LPA Exp: 5 to 10 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Da...

Salary: 20 to 35 LPA Exp: 5 to 8 years Location: Gurgaon /Pune/Bangalore Notice: Immediate to 30 days..!! Roles and Responsibilities Design, develop, test, deploy, and maintain large-scale data pipelines using GCP services such as BigQuery, Data Flow, PubSub, Dataproc, and Cloud Storage. Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. Develop complex SQL queries to extract insights from large datasets stored in Google Cloud SQL databases. Troubleshoot issues related to data processing workflows and provide timely resolutions. Desired Candidate Profile 5-9 years of experience in Data Engineering with expertise GCP & Biq que...

About The Role Project Role : Application Support Engineer Project Role Description :Act as software detectives, provide a dynamic service identifying and solving issues within multiple components of critical business systems. Must have skills : IBM Maximo Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Support Engineer, you will act as software detectives, providing a dynamic service that identifies and resolves issues within various components of critical business systems. Your typical day will involve collaborating with team members to troubleshoot software problems, analyzing system pe...

About The Role Project Role : Application Support Engineer Project Role Description :Act as software detectives, provide a dynamic service identifying and solving issues within multiple components of critical business systems. Must have skills : IBM Maximo Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Support Engineer, you will act as software detectives, providing a dynamic service that identifies and resolves issues within various components of critical business systems. Your typical day will involve collaborating with team members to troubleshoot problems, analyzing system performance...

About The Role Project Role : Data Engineer Project Role Description :Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Performance Testing Strategy, Test Automation Strategy Good to have skills : NAMinimum 12 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. A typical day involves creating data pipelines, ...

About The Role Project Role : Data Architect Project Role Description :Define the data requirements and structure for the application. Model and design the application data structure, storage and integration. Must have skills : Microsoft Azure Databricks Good to have skills : AWS Architecture, Snowflake Data Warehouse, PySparkMinimum 15 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Architect, you will define the data requirements and structure for the application. Your typical day will involve modeling and designing the application data structure, storage, and integration, ensuring that the architecture aligns with business need...

Skilled Multiple GCP services - GCS, BigQuery, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer etc. Must have Python and SQL work experience & Proactive, collaborative and ability to respond to critical situation Ability to analyse data for functional business requirements & front face customer Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise 5 to 7 years of relevant experience working as technical analyst with Big Query on GCP platform. Skilled in multiple GCP services - GCS, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer You love colla...

Job Application Link: https://app.fabrichq.ai/jobs/dae4c183-25fe-4d3a-9cb9-fa58048769df Job Summary: The Principal Data Engineer - GCP role involves designing and implementing end-to-end data and analytics solutions on Google Cloud Platform. The position requires expertise in GCP services like BigQuery, Dataflow, and Cloud Storage, along with strong data modeling skills. The role includes mentoring teams, participating in pre-sales activities, and collaborating with leadership on cloud strategy. Key Responsibilities Design and drive end-to-end data and analytics solution architecture from concept to delivery on Google Cloud Platform (GCP) Design, develop, and support conceptual, logical, and...

Job Title: GCP Data Engineer Location: Hyderabad & Chennai (Hybrid mode of working) Experience: 5+ Years Employment Type: Full Time Key Responsibilities Design, build, and optimize scalable data pipelines using GCP services ( Big Query, Dataflow, Airflow, Pub/Sub, Cloud Storage ). Develop and maintain ETL/ELT workflows leveraging Airflow and DBT for data modeling and transformations. Write and optimize complex SQL queries Big Query BigQuery . Implement data integration solutions to ingest structured, semi-structured, and unstructured data from multiple sources. Work closely with data analysts, data scientists, and business stakeholders to ensure reliable and timely data delivery. Apply Pytho...

The GCP Data Engineer will be responsible for designing, developing, and maintaining data pipelines and data infrastructure on Google Cloud Platform (GCP). This role requires expertise in data engineering best practices, cloud architecture, and big data technologies. The ideal candidate will work closely with data scientists, analysts, and other stakeholders to ensure the availability, reliability, and efficiency of data systems, enabling data-driven decision-making across the organization. Key Responsibilities Data Pipeline Development Design, develop, and maintain scalable and efficient ETL/ELT pipelines on GCP. Implement data ingestion processes from various data sources (e.g., APIs, data...

Technical competency in the following: - Experience in SQL and PL/SQL development - Oracle Database - Good understanding of ER Diagrams, Data Flows - Good to have experience on DB design & modelling - Hands-on on performance tuning tools and debugging Ability to perform technical analysis, design and identify impacts (functional/technical) Prior experience in High Volume / Mission critical Systems is a plus Contributing Responsibilities Work in duet with our offshore and in-site technical team to coordinate the database initiatives. Perform detailed technical analysis with impacts (technical/functionally) and prepare Technical specification document. Mentor and carry out database peer code r...

Overview: TekWissen is a global workforce management provider throughout India and many other countries in the world. The below clientis a global company with shared ideals and a deep sense of family. From our earliest days as a pioneer of modern transportation, we have sought to make the world a better place one that benefits lives, communities and the planet Job Title: Data Engineering Engineer II Location: Chennai Work Type: Hybrid Position Description: Employees in this job function are responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and a...

Candidate will be working on the IVP Delivery team on projects directly with clients or with IVP business analysts to customize & integrate IVP products and custom solutions. Candidate would be responsible for configuring & testing workflows, configuring & testing data flows, orchestrating dataflows, configuring reports / dashboards / charts, loading & validating data in IVP products, writing sql stored procedures & custom C# classes for implementing IVP products. In addition to project delivery, the Implementation Associate is also responsible for coordinating product change requests, product feature validations and maintenance requests between the business and the development team. Skills ...

Position Description: Employees in this job function are responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and accurately Key Responsibilities: 1) Collaborate with business and technology stakeholders to understand current and future data requirements 2) Design, build and maintain reliable, efficient and scalable data infrastructure for data collection, storage, transformation, and analysis 3) Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow ...

Position Description: Representing the Ford Credit (FC) Data Engineering Organization as a Google Cloud Platform (GCP) Data Engineer, specializing in migration and transformation, you will be a developer part of a global team to build a complex Datawarehouse in the Google Cloud Platform. This role involves designing, implementing, and optimizing data pipelines, ensuring data integrity during migration, and leveraging GCP services to enhance data transformation processes for scalability and efficiency. This role is for a GCP Data Engineer who can build cloud analytics platforms to meet expanding business requirements with speed and quality using lean Agile practices. You will work on analyzin...

Whats the role The Analyst MICOE role requires an experienced designer of data visualizations and complex reporting with a strong understanding of the Financial metrics and how they influence business performance. This designer will work with an integrated team of developers, business analysts, Interface Managers in creating complex data visualizations using Microsoft Power BI and other tools. Once a solution is live, run and maintain the same, take care of year roll-over and minor changes/enhancements to the solution. What you will be doing Swift understanding of the business model, expectations from business, linking it to the business strategy and the way KPIs are measured. Design and cre...

Act as a Technical Lead with 8 to 12 years of experience in Cloud (GCP) Work within an agile, multidisciplinary devops team Possess Hadoop knowledge and NiFi/Kafka experience Be an expert in Python, Data Flow, Pubsub, and Big Query Have knowledge and experience with GCP components such as GCS, BigQuery, AirFlow, Cloud SQL, PubSub/Kafka, DataFlow and Google Cloud SDK Understand Terraform script and Shell script Have experience working with RDBMS Possess GCP Data Engineer certification (advantageous) Provide technical leadership for a team of engineers Lead and contribute to multiple pods Interface technically with a range of stakeholders Solve complex problems Migrate and re-engineer existing...

Act as a Technical Lead with 8 to 12 years of experience in Cloud (GCP) Work within an agile, multidisciplinary devops team Possess Hadoop knowledge and NiFi/Kafka experience Be an expert in Python, Data Flow, Pubsub, and Big Query Have knowledge and experience with GCP components such as GCS, BigQuery, AirFlow, Cloud SQL, PubSub/Kafka, DataFlow and Google Cloud SDK Understand Terraform script and Shell script Have experience working with RDBMS Possess GCP Data Engineer certification (advantageous) Provide technical leadership for a team of engineers Lead and contribute to multiple pods Interface technically with a range of stakeholders Solve complex problems Migrate and re-engineer existing...

Act as a Technical Lead with 8 to 12 years of experience in Cloud (GCP) Work within an agile, multidisciplinary devops team Possess Hadoop knowledge and NiFi/Kafka experience Be an expert in Python, Data Flow, Pubsub, and Big Query Have knowledge and experience with GCP components such as GCS, BigQuery, AirFlow, Cloud SQL, PubSub/Kafka, DataFlow and Google Cloud SDK Understand Terraform script and Shell script Have experience working with RDBMS Possess GCP Data Engineer certification (advantageous) Provide technical leadership for a team of engineers Lead and contribute to multiple pods Interface technically with a range of stakeholders Solve complex problems Migrate and re-engineer existing...

Possess mandatory Google Cloud Big Query Scripting Skills or Snowflake AWS or Cloud SQL Knowledge Should have knowledge on any one of these ETL Tools: Talend, Datastage, Informatica ISS (Cloud version), Data Fusion, Data Flow, Data Proc Must have SQL PL/SQL Scripting Experience Should possess mandatory Linux/Unix Skills Expertise in Python, Data Flow, Pubsub, Big Query, CICD Must have good experience/knowledge on GCP components like GCS, BigQuery, AirFlow, Cloud SQL, PubSub/Kafka, DataFlow and Google Cloud SDK Should have experience on any of the RDBMS Holding GCP Data Engineer certifications would be an added advantage Must have Hadoop knowledge, NiFi/Kafka experience Strong Scheduler knowl...

Possess mandatory Google Cloud Big Query Scripting Skills or Snowflake AWS or Cloud SQL Knowledge Should have knowledge on any one of these ETL Tools: Talend, Datastage, Informatica ISS (Cloud version), Data Fusion, Data Flow, Data Proc Must have SQL PL/SQL Scripting Experience Should possess mandatory Linux/Unix Skills Expertise in Python, Data Flow, Pubsub, Big Query, CICD Must have good experience/knowledge on GCP components like GCS, BigQuery, AirFlow, Cloud SQL, PubSub/Kafka, DataFlow and Google Cloud SDK Should have experience on any of the RDBMS Holding GCP Data Engineer certifications would be an added advantage Must have Hadoop knowledge, NiFi/Kafka experience Strong Scheduler knowl...