1696 Dataflow Jobs - Page 6

Data Engineer Job Title: Data Engineer Location: Remote Experience: 4-7 years Job Summary: The Data Engineer is responsible for designing and building data models and pipelines on GCP, Azure, Snowflake, BigQuery, utilizing SQL & Python expertise and following coding best practices. Key Responsibilities Design and build data models and pipelines on GCP BigQuery, Azure, Snowflake Develop and execute SQL queries (DML) to extract insights from data. Collaborate with stakeholders to understand data requirements and provide solutions. Ensure data quality and integrity by following data modeling principles and coding best practices. Design, build, and maintain robust, scalable ETL/ELT pipelines usi...

Position Overview Job Title: Technology Service Analyst, AS Location: Bangalore, India Role Description You will be operating within Production services team of Trade Finance and Lending domain which is a subdivision of Corporate Bank Production Services as a Production Support Engineer. In this role, you will be accountable for the following: To resolve user request supports, troubleshooting functional, application, and infrastructure incidents in the production environment. work on identified initiatives to automate manual work, application and infrastructure monitoring improvements and platform hygiene. Eyes on glass monitoring of services and batch. Preparing and fulfilling data requests...

At Solidatus, we are revolutionizing the way organizations comprehend their data. We are an award-winning, venture-backed software company often referred to as the Git for Metadata. Our platform enables businesses to extract, model, and visualize intricate data lineage flows. Through our unique lineage-first approach and active AI development, we offer organizations unparalleled clarity and robust control over their data's journey and significance. As a rapidly growing B2B SaaS business with fewer than 100 employees, your contributions play a pivotal role in shaping our product. Renowned for our innovation and collaborative culture, we invite you to join us as we expand globally and redefine...

As a seasoned professional with extensive experience in machine learning operations (MLOps), you will be responsible for leading a talented team and developing a comprehensive technical strategy. Your expertise in Python programming and ML frameworks such as TensorFlow or PyTorch will be crucial in implementing MLOps best practices, including model versioning, monitoring, automated deployment, and infrastructure automation. Your in-depth knowledge of Google Cloud Platform services, including Data Fusion, Dataproc, and Dataflow, will play a key role in data processing and pipeline orchestration. Experience with PostgreSQL databases and data integration tools like Qlik Replicate will further e...

Title : Python support Engineer Must-have Skills Monitor and maintain the availability and GKE based applications in high-pressure production environment. Respond to and resolve incidents and service requests related to application functionality and performance. Collaborate with development teams to troubleshoot and resolve technical issues in a timely manner. Document support processes , procedures, and troubleshooting steps for future reference. Participate in on-call rotation as well as in off-hours to provide after-hours support as needed. Communicate effectively with stakeholders to provide updates on issue resolution and status. Should have experience with monitoring tools and incident...

Job description: Responsibilities: Design, develop, and maintain data pipelines on GCP. Implement data storage solutions and optimize data processing workflows. Ensure data quality and integrity throughout the data lifecycle. Collaborate with data scientists and analysts to understand data requirements. Monitor and maintain the health of the data infrastructure. Troubleshoot and resolve data-related issues. Stay updated with the latest GCP features and best practices. Qualifications: Bachelor's degree in Computer Science, Engineering, or related field. Proven experience as a Data Engineer with expertise in GCP. Strong understanding of data warehousing concepts and ETL processes. Experience w...

Job Summary A GCP and Big Query Engineer designs, builds, and maintains scalable data infrastructures on Google Cloud Platform, focusing on data warehousing, ETL processes, and data analysis using services like BigQuery, Cloud Dataflow, and Cloud Storage. Key responsibilities include data modeling, data integrity, performance optimization, automating data pipelines, collaborating with stakeholders, and implementing robust security and compliance measure

Job Summary JD GCP Data Engineer Responsibilities: ¿ Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub. ¿ Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently. ¿ Use Pub/Sub for real time data ingestion and streaming analytics. ¿ Provision and manage GCP infrastructure using Terraform, ensuring best practices in IaC are followed. ¿ Optimize data storage and retrieval processes to enhance performance and reduce costs. ¿ Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability of data services. ¿ Ensure data quality and integrity through robust testin...

Sonatype is the software supply chain security company. We provide the world’s best end-to-end software supply chain security solution, combining the only proactive protection against malicious open source, the only enterprise grade SBOM management and the leading open source dependency management platform. This empowers enterprises to create and maintain secure, quality, and innovative software at scale. As founders of Nexus Repository and stewards of Maven Central, the world’s largest repository of Java open-source software, we are software pioneers and our open source expertise is unmatched. We empower innovation with an unparalleled commitment to build faster, safer software and harness ...

Job description Some careers shine brighter than others. If you’re looking for a career that will help you stand out, join HSBC, and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organizations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realize their ambitions. We are currently seeking an experienced professional t...

1. Experience specifically in defining solution, performing POCs, Application design and development, integration migration. 2. Understanding of Google Cloud Platform technologies in the big data and data warehousing space BigQuery, pub-sub, Dataflow, Data Catalog, Composer Airflow, Complex SQL, Stored Procedures) with experience on delivering data architect solutions using BigQuery, Google data flow, Google pub sub, google cloud SQL, google compute engine, etc. Should have at least 5+ year of experience in GCP Google Cloud Platform or similar Cloud Technologies. 3. Experience in Looker with design, development, configuration setup, dashboarding and reporting techniques. 4. Experience in Dev...

Key Responsibilities Design, build, and maintain scalable data pipelines for batch and real-time processing using tools like Apache Airflow, dbt, or Apache Spark. Develop robust ETL/ELT workflows to ingest, clean, transform, and load data from diverse sources (APIs, databases, files, streams). Work with stakeholders to understand data needs and translate business requirements into technical solutions. Ensure data is accurate, timely, and accessible to downstream users (BI tools, ML models, applications). Collaborate with data architects and engineers to build a modern data stack leveraging cloud-native platforms (e.g., AWS, GCP, Azure). Monitor and optimize data pipeline performance, scalabi...

Key Responsibilities Design, build, and maintain scalable data pipelines for batch and real-time processing using tools like Apache Airflow, dbt, or Apache Spark. Develop robust ETL/ELT workflows to ingest, clean, transform, and load data from diverse sources (APIs, databases, files, streams). Work with stakeholders to understand data needs and translate business requirements into technical solutions. Ensure data is accurate, timely, and accessible to downstream users (BI tools, ML models, applications). Collaborate with data architects and engineers to build a modern data stack leveraging cloud-native platforms (e.g., AWS, GCP, Azure). Monitor and optimize data pipeline performance, scalabi...

We are seeking an experienced and results-driven GCP Data Engineer with 5+ years of hands-on experience in designing, developing, and managing scalable data pipelines and analytics solutions using Google Cloud Platform. The ideal candidate will have deep expertise in BigQuery , Dataflow , and other GCP data services to support our enterprise-level data initiatives. Key Responsibilities: Design and implement scalable and efficient data pipelines using GCP services , especially BigQuery , Dataflow , Cloud Storage , and Pub/Sub . Develop data ingestion frameworks to handle structured and semi-structured data from various sources in batch and real-time modes. Transform raw data into clean, curat...

Role: L3 BI Consultant Required Technical Skill Set: SQL, GCP, Power BI Desired Experience Range: 6-8 yrs Location of Requirement: Bangalore/Hyderabad Notice period: Immediate joiner only Job Description: Data Visualization (Data & Analytics): Data specific Hands-on experience in at least one GCP Data Services like Big Query, Cloud SQL, Dataflow etc. Hands-on experience in implementing data pipelines that move data from source systems/databases to target datastores/databases Professional cloud certification with any CSP including AWS, GCP or Azure. "Expert in Databases Cloud SQL, Alloy DB, Spanner etc. Design and implement data migration strategies for various database types (PostgreSQL, Ora...

Position : Senior Data Analyst Location : Guindy Salary : 6 LPA to 9 LPA Experience : 5 Years and above ABOUT US Global leader in manufacturing human hair extensions and award winning exporter to USA and UK; DHPL leads the hair industry market in quality goods that are celebrated in hair salons, Hollywood studios, and opera and theater stages. We believe in growth and science by learning and applying advanced business techniques and R&D applications. OUR STORY DHPL is the daughter company to Hair & Compounds, Inc. located in California USA. After more than 20 years, together we have built a reputation for creating and providing human hair products into the high-end hair extension market know...

Sonatype is the software supply chain security company. We provide the world’s best end-to-end software supply chain security solution, combining the only proactive protection against malicious open source, the only enterprise grade SBOM management and the leading open source dependency management platform. This empowers enterprises to create and maintain secure, quality, and innovative software at scale. As founders of Nexus Repository and stewards of Maven Central, the world’s largest repository of Java open-source software, we are software pioneers and our open source expertise is unmatched. We empower innovation with an unparalleled commitment to build faster, safer software and harness ...

Job Title: Technical GCP Data Architect/Lead Location: Madurai/Chennai/Remote Experience: 12+ Years Notice Period: Immediate Job Summary We are seeking a hands-on Technical GCP Data Architect/Lead with deep expertise in real-time streaming data architectures to help design, build, and optimize data pipelines in our Google Cloud Platform (GCP) environment. The ideal candidate will have strong architectural vision and be comfortable rolling up their sleeves to build scalable, low-latency streaming data pipelines using Pub/Sub, Dataflow (Apache Beam) , and BigQuery . Key Responsibilities Architect and implement end-to-end streaming data solutions on GCP using Pub/Sub , Dataflow , and BigQuery ....

Role: GCP Data Architect Total years of experience: 12+ Years Location: Noida, Bangalore, Chennai, Pune, Hyderabad Relevant experience for engagement: 10 Years Relevant skillset: Maintain architecture principles, guidelines and standards Data Warehousing Programming Language: Python/Java Big Data Data Analytics GCP Services Relevant technology domains: Experience in designing & implementing solution in mentioned areas: Strong Google Cloud Platform Data Components – BigQuery, BigTable, CloudSQL, Dataproc, Data Flow, Data Fusion, Etc Professional Summary Strong Experience in Big Data- Data Modelling, Design, Architecting & Solutioning Understands programming language like SQL, Python, R-Scala....

Job Description A Cloud Integration Architect, to help drive the modernization of legacy mainframe applications into cloud and hybrid environments (GCP preferred). Ability to design and implement end-to-end integration solutions—leveraging both proven and cutting-edge patterns—to connect legacy systems, SaaS platforms, microservices and event-driven architectures. Ability to work closely with business to shape solution proposals, manage stakeholders, and negotiate technical and commercial decisions. Responsibilities Key Responsibilities Lead application modernization initiatives: assess legacy mainframes, define roadmaps, and orchestrate phased workloads to GCP and hybrid clouds Architect in...

Position Overview Job Title: DevOps and Full Stack Engineer, AS Location: Pune, India Role Description The Infra & DevOps team within DWS India, sits horizontally over the project delivery, committed to provide best in class shared services across build, release and QA Automation space. Its’ main functional areas encompass Environment build, Integration of QA Automation suite, Release and Deployment Automation Management, Technology Management and Compliance Management. This role will be key to our programme delivery and include working closely with stakeholders including client Product Owners, Digital Design Organisation, Business Analysts, Developers and QA to advise and contribute from In...

Are you passionate about shaping an organization's cloud and data future This is a center of excellence leadership position at Mastech Digital, where you will be responsible for defining the GCP practice vision and roadmap. We are looking for a Practice Leader - GCP with a minimum of 15 years of experience to drive capability growth, innovation, and practice leadership across Cloud Data Engineering, Analytics, and AI/ML solutions. In this role, you will have the opportunity to build and mentor a high-performing in-house GCP talent pool, develop accelerators, frameworks, and reusable assets for cloud-native solutions, and partner with delivery, sales, and clients as a subject matter authority...

Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using GCP services such as BigQuery, Cloud Data Fusion, Dataflow, Pub/Sub, Cloud Storage, Composer ,Cloud Function, Cloud RUN Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions. Implement data integration solutions to ingest, process, and store large volumes of structured and unstructured data from various sources. Optimize and tune data pipelines for performance, reliability, and cost-efficiency. Ensure data quality and integrity through data validation, cleansing, and transformation processes. Develop and maint...

Position: Registered Nurse (Dental Hospital) 🔹 Job Title: B.Sc Nurse – Dental Hospital Location: Kuwait Industry: Healthcare (Dental) Experience: Minimum 2–3 years (Dental/Clinical experience preferred) Education: B.Sc Nursing (Valid license – Kuwait MOH or eligibility to obtain) Salary: 420 KWD/Month ( ₹1,13,820 INR - approx) Job Responsibilities Assist dentists during clinical and surgical dental procedures. Prepare patients for examination and ensure their comfort. Sterilize, arrange, and maintain dental instruments and equipment. Administer medications and injections as directed by the dentist. Maintain accurate patient records, reports, and treatment charts. Monitor patients’ vital sign...

Position: Registered Nurse (Dental Hospital) 🔹 Job Title: B.Sc Nurse – Dental Hospital Location: Kuwait Industry: Healthcare (Dental) Experience: Minimum 2–3 years (Dental/Clinical experience preferred) Education: B.Sc Nursing (Valid license – Kuwait MOH or eligibility to obtain) Salary: 420 KWD/Month ( ₹1,13,820 INR - approx) Job Responsibilities Assist dentists during clinical and surgical dental procedures. Prepare patients for examination and ensure their comfort. Sterilize, arrange, and maintain dental instruments and equipment. Administer medications and injections as directed by the dentist. Maintain accurate patient records, reports, and treatment charts. Monitor patients’ vital sign...