2551 Dataflow Jobs - Page 28

Our technology services client is seeking multiple GCP Data Engineer to join their team on a contract basis. These positions offer a strong potential for conversion to full-time employment upon completion of the initial contract period. Below are further details about the role: Role: GCP Data Engineer Experience: 6- 10 Years Location: Chennai Notice Period: Immediate- 15 Days Mandatory Skills: GCP, Python, Big Query, SQL, Airflow, Data Flow Job Description: Knowledge on Google Cloud Platform Big Query SQL Dataflow with JavaPython Dataproc with PySparkPython Kafka or Pubsub Airflow and Cloud RunCloud function with Python 3 years of GCP experience GCP BQ and Python mandatory Experience on any ...

Hi All, We are hiring for a Permanent role at LTI Mindtree ! Role: GCP Data Engineer Experience: 5+ Years Location: PAN India Notice Period: Immediate to 30 Days 📩 Interested candidates can share their updated CVs at Neha.Ingale@alphacom.in Job Description We are looking for an experienced GCP Data Engineer with strong expertise in Google Cloud Platform services. The ideal candidate should have hands-on experience with GCP data stack components such as BigQuery, DataFlow, DataProc, Cloud Composer, PySpark, and Python. Knowledge of Tableau or MSTR is mandatory. This is a great opportunity to work on innovative data engineering solutions in a fast-paced, collaborative environment. Key Responsi...

As a highly skilled Google Cloud Platform (GCP) Expert, your role will involve designing, implementing, and managing the cloud infrastructure and services for the company. You will be expected to have deep expertise in GCP tools, cloud-native architectures, and modern DevOps practices. Collaborating closely with engineering, security, and product teams, your primary focus will be on ensuring scalability, reliability, and compliance of the cloud environment. Key Responsibilities: - **Architecture & Design:** - Design and implement secure, scalable, and cost-optimized GCP cloud architectures. - Evaluate and recommend GCP services (e.g., BigQuery, Pub/Sub, GKE, Cloud SQL, Vertex AI) for busines...

Role Overview: You will be a Senior Data Engineer responsible for building scalable, reliable, and cutting-edge data solutions on cloud platforms. Your expertise in Google Cloud Platform (GCP), BigQuery, and modern data engineering practices will be crucial in developing end-to-end data pipelines for actionable business intelligence, advanced analytics, and machine learning initiatives. Additionally, you will have the opportunity to work with diverse data ecosystems and influence the future of the company's data infrastructure. Key Responsibilities: - Architect, develop, and maintain robust ETL/ELT data pipelines on GCP, primarily utilizing BigQuery. - Design and implement data ingestion fra...

You are applying for the position of Senior GCP Cloud Administrator for Forbes Advisor, a part of the Forbes Marketplace initiative. As a Senior GCP Cloud Administrator, your role will involve managing and optimizing various aspects of Google Cloud Platform (GCP) to ensure efficient data management and operational practices. **Responsibilities:** - Manage and configure roles/permissions in GCP IAM by following the principle of least privileged access - Optimize Big Query service through slot assignments, SQL Queries, FinOps practices, troubleshooting critical data queries, etc. - Collaborate with various teams for efficient data management and operational practices in GCP - Create automation...

Key Responsibilities: Design, develop, and manage scalable, secure, and efficient data pipelines on Google Cloud Platform (GCP) to process and transform large datasets from multiple sources. Implement and optimize GCP data services such as BigQuery, Cloud Storage, Cloud SQL, Dataflow, Dataproc, Pub/Sub, and Cloud Functions. Architect and maintain ETL/ELT processes to ensure efficient data ingestion, transformation, and storage using Cloud Data Fusion, Dataflow (Apache Beam), or Composer (Airflow). Architect and implement data models on GCP to support efficient data storage and retrieval in BigQuery, Cloud Spanner, or Firestore. Collaborate with data architects to design and implement data la...

GCP Data Engineer Location: ~CHENNAI,TN~ Title: Engineer Skills Required: Digital : Google Data Engineering Required Experience: 6 to 8 Role Description: • We are looking for a Data Engineer with hands on experience in Google Cloud platform (GCP) resources such as BigQuery, Dataflow, PubSub, Cloud Composer, Cloud Run (native) and Cloud Storage (GCS). • Knowledge and setting up of Data Transformation and integration using Data Build Tool (DBT) is also a requirement to support, scheduling, and analytics flows in the GCP envi-ronment Essential Skills: • We are looking for a Data Engineer with hands on experience in Google Cloud platform (GCP) resources such as BigQuery, Dataflow, PubSub, Cloud ...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Google BigQuery Good to have skills : GCP Dataflow, Google Cloud Platform Architecture, Google Cloud Data Services Minimum 5 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will invol...

Key Responsibilities Design, develop, and optimize data pipelines and ETL processes on GCP or Azure. Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms. Implement and manage data warehouses, data lakes, or lakehouse architectures. Develop clean, efficient, and reusable Python scripts for automation, data transformation, and processing. Collaborate with data scientists, analysts, and business teams to deliver high-quality, timely datasets. Monitor, troubleshoot, and enhance data workflows for performance, scalability, and cost efficiency. Ensure data quality, governance, and compliance with organizational and industry standards. Re...

Greetings from UST Who we are: Born digital, UST transforms lives through the power of technology. We walk alongside our clients and partners, embedding innovation and agility into everything they do. We help them create transformative experiences and human-centered solutions for a better world. UST is a mission-driven group of over 38,000+ practical problem solvers and creative thinkers in over 30+ countries. Our entrepreneurial teams are empowered to innovate, act nimbly, and create a lasting and sustainable impact for our clients, their customers, and the communities in which we live. With us, you’ll create a boundless impact that transforms your career—and the lives of people across the ...

9 - 12 Years 1 Opening Trivandrum Role description Role Proficiency: Leverage expertise in a technology area (e.g. Infromatica Transformation Terradata data warehouse Hadoop Analytics) Responsible for Architecture for a small/mid-size projects. Outcomes: Implement either data extract and transformation a data warehouse (ETL Data Extracts Data Load Logic Mapping Work Flows stored procedures data warehouse) data analysis solution data reporting solutions or cloud data tools in any one of the cloud providers(AWS/AZURE/GCP) Understand business workflows and related data flows. Develop design for data acquisitions and data transformation or data modelling; applying business intelligence on data o...

Req ID: 324887 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Systems Integration Specialist to join our team in Hyderabad, Andhra Pradesh (IN-AP), India (IN). Position Functions or Responsibilities Java 11 Spring Boot development and support Skill using Java 11 and above Java Developer with AMQ/MQTT/OpenShift Skill in REST API bases web application development on Redhat Additional Skill required include Microservices on OpenShift, GKE, Cloud Endpoints Skill in using Queue (AMQ, MQTT) Support application for BL, DL,...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Google BigQuery Good to have skills : GCP Dataflow, Google Cloud Platform Architecture, Google Cloud Data Services Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will invol...

Role Description Role Proficiency: Leverage expertise in a technology area (e.g. Infromatica Transformation Terradata data warehouse Hadoop Analytics) Responsible for Architecture for a small/mid-size projects. Outcomes Implement either data extract and transformation a data warehouse (ETL Data Extracts Data Load Logic Mapping Work Flows stored procedures data warehouse) data analysis solution data reporting solutions or cloud data tools in any one of the cloud providers(AWS/AZURE/GCP) Understand business workflows and related data flows. Develop design for data acquisitions and data transformation or data modelling; applying business intelligence on data or design data fetching and dashboar...

Our Client is a leading company in the tech industry, known for its innovation, growth opportunities, and excellent workplace culture. Role Summary Our Client is seeking a Data Engineer (Python + GCP) to join their team in a contract position. This hire is crucial for supporting ongoing growth and innovation within the company. As a Data Engineer, you will play a vital role in driving strategic initiatives and making a significant impact on the data infrastructure. Responsibilities Develop and maintain data pipelines using Python within the Google Cloud Platform (GCP) environment. Collaborate with cross-functional teams to gather requirements and implement efficient data solutions. Design an...

Our technology services client is seeking multiple GCP Data Engineer to join their team on a contract basis. These positions offer a strong potential for conversion to full-time employment upon completion of the initial contract period. Below are further details about the role: Role: GCP Data Engineer Experience: 6- 10 Years Location: Chennai Notice Period: Immediate- 15 Days Mandatory Skills: GCP, Python, Big Query, SQL, Airflow, Data Flow Job Description: Knowledge on Google Cloud Platform Big Query SQL Dataflow with JavaPython Dataproc with PySparkPython Kafka or Pubsub Airflow and Cloud RunCloud function with Python 3 years of GCP experience GCP BQ and Python mandatory Experience on any ...

Job Description: · Proficient in data warehouse concepts and development skills spanning multiple design techniques · Develop and enhance Power BI reports and dashboards · Proficient in data modelling in Power BI, including M-Query and DAX · Experienced in advanced Power BI features like RLS, incremental data load, performance tuning, dataflow, Power BI REST Api etc. · Should have good exposure working with diverse set of visuals and various data sources like SQL Server, Big Query etc. · Extensive experience in T-SQL Job description: · Design, analyze, develop, test and debug Power BI reports and dashboards to satisfy business requirements · Ability to translate business requirements to tech...

We’re Hiring – GCP Data Engineers 🚀 Join our growing team and work on cutting-edge data engineering projects in the cloud! 📍 Work Locations: Chennai / Bangalore / Pune / Hyderabad 💼 Experience: 5+ years 🔑 Skills Required Expertise in GCP ecosystem – BigQuery, Dataflow, Composer, Pub/Sub, DataProc Strong proficiency in Python, PySpark, SQL Knowledge of HDFS, Hadoop and large-scale data migration/engineering 🎯 Responsibilities Design, build, and optimize data pipelines on GCP Lead and deliver end-to-end data engineering & migration projects independently Collaborate with stakeholders to build scalable and reliable cloud data solutions 📩 Apply Now: Shaista@natobotics.com

About The Role We are looking for a highly skilled and motivated Senior Data Engineer to join our team. In this role, you will be responsible for designing, building, and maintaining scalable and robust data pipelines and architectures that support business intelligence, analytics, and machine learning initiatives. You will collaborate closely with data scientists, analysts, and software engineers to ensure the availability, quality, and security of data across the organization. Key Responsibilities Design, develop, and maintain scalable data pipelines and ETL workflows using orchestration tools such as Apache Airflow or dbt. Architect and implement data integration solutions that consolidat...

As a Cloud Platform Engineer, you will be responsible for managing various CP Services such as Cloud Run, Cloud Functions, GKE, Cloud Storage, Cloud SQL, Big Query, Cloud Spanner, VPC, Load Balancing, Cloud NAT, IAM, Secret Manager, Cloud Logging and Monitoring, Vertex AI pipelines, Cloud Build, and Artifact Registry. Your key responsibilities will include: - Experience in Terraform, GitHub, Networking, BigQuery, Bigtable, Dataflow, Cloud Storage, and other GCP Cloud Technology Services - Managing Google Compute Engine (GCE), Google Kubernetes Engine (GKE), Cloud Storage, and other Google Cloud Managed Services - Utilizing monitoring tools like Stackdriver Monitoring, Logging, Debugging, and...

As a Full-Time (FTE) team member in Pune or Chennai, you will be part of a dynamic team focused on GCP technologies. Your role will involve working with a range of tools including Airflow, GCP Composer, DAGs, BigQuery, Dataflow, Pub/Sub, GCS, Terraform, CI/CD, IAM, Networking, Governance, and Security. **Key Responsibilities:** - Work closely with Platform SMEs, Architects, Business Workspaces (Product/BA & Tech), and Platform Engineers (Specialist & Sr. Specialist). - Utilize your expertise in GCP technologies to contribute to the team's success. **Qualifications Required:** - Minimum of 5 years of experience in the field. - Proficiency in Airflow, GCP Composer, DAGs, BigQuery, Dataflow, Pu...

Join us as a Test Automation Engineer at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences. As a part of team of developers, you will deliver technology stack, using strong analytical and problem solving skills to understand the business requirements and deliver quality solutions. To be successful as a Test Automation Engineer you should have experience with: ETL Tools: Proficiency with enterprise ETL platforms like Abinitio primarily, Informatica PowerCenter, IBM DataStage, Talend, SSIS, or Matillion Scripting/Pro...

Experience : 8.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers' client - Forbes Advisor) What do you need for this opportunity? Must have skills required: Google Cloud, Dataflow, GCP, BigQuery, GCP certification, GCP Certificate Forbes Advisor is Looking for: Senior GCP Cloud Administrator Forbes Advisor is a new initiative for consumers under the Forbes Marketplace umbrella that provides journalist- and expert-written insights, news and reviews on all things personal finance, health, business, and everyday life decisions. We do...

Experience : 4.00 + years Salary : INR 1500000-3000000 / year (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: NuStudio.AI) (*Note: This is a requirement for one of Uplers' client - AI-first, API-powered Data Platform) What do you need for this opportunity? Must have skills required: Databricks, dbt, Delta Lake, Spark, Unity catalog, AI, Airflow, Cloud Function, Cloud Storage, Databricks Workflows, Dataflow, ETL/ELT, Functions), GCP (BigQuery, Pub/Sub, PySpark, AWS, Hadoop AI-first, API-powered Data Platform is Looking for: We’re scalin...

Experience : 8.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers' client - Forbes Advisor) What do you need for this opportunity? Must have skills required: Google Cloud, Dataflow, GCP, BigQuery, GCP certification, GCP Certificate Forbes Advisor is Looking for: Senior GCP Cloud Administrator Forbes Advisor is a new initiative for consumers under the Forbes Marketplace umbrella that provides journalist- and expert-written insights, news and reviews on all things personal finance, health, business, and everyday life decisions. We do...