1709 Dataflow Jobs - Page 15

Position Overview Job Title: Senior Production Engineer Location: Pune, India Corporate Title: Associate Role Description Technology underpins our entire business. Our Technology, Data and Innovation (TDI) strategy is focused on strengthening engineering expertise, introducing an agile delivery model, as well as modernizing the bank's IT infrastructure. We continue to invest and build a team of visionary tech talent, providing you with the training, freedom and opportunity to do pioneering work. As an Support Engineer you will support Enterprise Data Services (EDS) Prod environment to satisfy complex and diverse business goals. You will engage and partner with the business whilst working wit...

About the Role: We are looking for a highly skilled Data Engineer with strong expertise in Google Cloud Platform (GCP) services, DBT, SQL/Python, and GitLab. The ideal candidate will be responsible for building scalable data pipelines, enabling analytics, and ensuring efficient data integration across platforms. Key Responsibilities: Design, build, and optimize scalable data pipelines and ETL processes on GCP. Develop and manage transformation workflows using DBT with SQL and Python. Ensure best practices in data modeling, governance, and performance optimization. Implement CI/CD pipelines and version control using GitLab. Collaborate with cross-functional teams including Data Scientists, An...

The Senior Software Engineer engineers secure, scalable and reliable technology solutions, with minimal mentoring, to advance CMEG in the global marketplace and serve risk management needs of customers around the world. Key Responsibilities: Provide operational support for our analytics system built on the KDB+ database management system and tooling. This includes monitoring performance, troubleshooting issues, and maintaining data pipelines to ensure system stability. Actively participate in the design, development, and implementation of new analytics solutions on GCP. This will involve refactoring existing workflows and building new capabilities using native GCP services. Utilize GCP's rea...

The Technical Specialist Software Engineering independently engineers secure, scalable and reliable technology solutions to advance CMEG in the global marketplace and serve risk management needs of customers around the world. Key Responsibilities: Provide operational support for our analytics system built on the KDB+ database management system and tooling. This includes monitoring performance, troubleshooting issues, and maintaining data pipelines to ensure system stability. Actively participate in the design, development, and implementation of new analytics solutions on GCP. This will involve refactoring existing workflows and building new capabilities using native GCP services. Utilize GCP...

Job Title: Mid-Level DevOps Engineer Location: Chennai Experience: 3–5 Years Employment Type: Full-time Overview: We’re looking for a Mid-Level DevOps Engineer to join our team and enhance the automation, scalability, and reliability of our infrastructure. You’ll work closely with development, operations, and data platform teams to manage CI/CD pipelines, Kubernetes clusters, and cloud environments on GCP and Azure , with a focus on AI/ML workload deployment . Key Responsibilities: Design and manage CI/CD pipelines (Jenkins, GitLab CI, Azure DevOps, etc.) Manage Kubernetes clusters and containerized microservices Build infrastructure using IaC tools (Terraform, Helm, Ansible) Work with GCP/A...

Role Description Job description Mandatory skills ANSISQL Apache airflow GCP BigQuery GCP Cloud Composer GCP Dataflow GCP Dataform GCP Datafusion GCP DataProc GCP Datastream GCP DMS GCP PubSub GCP Storage GCP Workflows Google Analytics Hub Java Python Scala 5 years Experience in GCP BigQuery Oracle PLSQL Good knowledge of GCP tools such as GCS DataFlow Cloud Composer Cloud Pub Sub Proficient in Big Query DBMS and BQL Able to design end to end batch process in GCP Competent in Linux and python scripting Terraform Scripting for creating the GCP infrastructure Good communication skills Proficient with CICD tools like GitHub Jenkins Nexus Skills Mandatory Skills : GCP Storage,GCP BigQuery,GCP Da...

Job Description: 5–12 years of experience in GCP Airflow, Dataflow, Apache Beam – Mandatory Experience in implementing the data pipeline (ETL) using Dataflow and Apache Beam Experience with GCP Cloud services Experience in continuous integration, delivery, deployment, and build tools such as Docker, Jenkins, SonarQube, JIRA, Nexus, Confluence, Git, Bitbucket, Maven, Gradle, RunDeck – is a plus Experience in API Development using Java, Microservices, Spring Boot – Good to have Extensive understanding of BDD, TDD practices, code review and analysis techniques , and open-source agile testing frameworks Participate in code and design reviews to maintain high development standards Good to know ho...

Company Description Magellanic Cloud Limited is a pioneer in technology innovation and adaptation, focusing on transforming business operations through advanced tech solutions. The organization excels in software development, digital transformation, AI, IoT, e-surveillance, and drone-based applications to address real-world challenges. With a dynamic team of over 1,600 skilled professionals, Magellanic Cloud supports a diverse portfolio of more than 100 clients, including multiple Fortune 1,000 companies. Our strong market presence emphasizes our capability to deliver innovative, technology-driven solutions in a competitive global tech landscape. Role Description This is a full-time on-site ...

Position : Data Manager Location : Guindy Salary : 6 LPA to 9 LPA Experience : 5 Years and above ABOUT US Global leader in manufacturing human hair extensions and award winning exporter to USA and UK; DHPL leads the hair industry market in quality goods that are celebrated in hair salons, Hollywood studios, and opera and theater stages. We believe in growth and science by learning and applying advanced business techniques and R&D applications. OUR STORY DHPL is the daughter company to Hair & Compounds, Inc. located in California USA. After more than 20 years, together we have built a reputation for creating and providing human hair products into the high-end hair extension market known in Ho...

Role - Data Engineer Location - Bangalore Experience - 2-4 Yrs Key Responsibilities Design, build, and optimize scalable data pipelines for batch and real-time data processing. Develop and maintain ETL (Extract, Transform, Load) processes to integrate data from multiple sources. Manage and optimize data storage solutions (data warehouses, data lakes, relational and NoSQL databases). Ensure data quality, integrity, governance, and security across all systems. Collaborate with cross-functional teams to understand data requirements and deliver solutions. Monitor, troubleshoot, and improve data workflows and infrastructure performance. Implement automation for data ingestion, transformation, and...

Senior GCP Data Engineer We are seeking a highly experienced and motivated Senior GCP Data Engineer with 8-10 years of overall experience and a minimum of 5 years of hands-on expertise with cloud platforms. The ideal candidate will be a master of the Google Cloud Platform (GCP) ecosystem, responsible for designing, building, and maintaining scalable and robust data pipelines that drive critical business insights. Responsibilities: Architect, build, and maintain end-to-end data processing pipelines using the full suite of GCP products, including BigQuery, Data Fusion, Dataproc, Dataflow, Cloud Composer, and Pub/Sub. Design and develop scalable and reliable data solutions for both batch and st...

Data Engineering Expert / Specialist India (Remote) A skilled Data Engineer with 5 years of experience in GCP BigQuery and Oracle PL/SQL , with strong expertise in designing and implementing end-to-end batch processes on GCP . Proficient in GCP tools including GCS, DataFlow, Cloud Composer, and Cloud Pub/Sub, with hands-on experience in BigQuery DBMS and BQL . Adept in Linux and Python scripting for automation, as well as Terraform scripting for creating and managing GCP infrastructure. Experienced in CI/CD pipelines with GitHub, Jenkins, and Nexus, ensuring efficient and reliable deployments. Strong communication skills with the ability to collaborate effectively across teams. Qualification...

Job Role: Senior Data Engineer Job Location: Hyderabad, Kochi, Trivandrum Notice Period: Immediate to 45 days Primary Skill: Python, Scala, PySpark Role Proficiency The role requires strong expertise in developing and optimizing data pipelines including coding, testing, and transforming/joining data from multiple sources. The candidate should be proficient in ETL tools (Informatica, AWS Glue, Databricks, DataProc) and have strong coding skills in Python, PySpark, Scala, and SQL . Expertise in data warehousing solutions (Snowflake, BigQuery, Delta Lake, Lakehouse) is essential, along with the ability to optimize performance, calculate processing costs, and manage infrastructure needs. A solid...

Job Role: Senior Data Engineer Job Location: Hyderabad, Kochi, Trivandrum Notice Period: Immediate to 45 days Primary Skill: Python, Scala, PySpark Role Proficiency The role requires strong expertise in developing and optimizing data pipelines including coding, testing, and transforming/joining data from multiple sources. The candidate should be proficient in ETL tools (Informatica, AWS Glue, Databricks, DataProc) and have strong coding skills in Python, PySpark, Scala, and SQL . Expertise in data warehousing solutions (Snowflake, BigQuery, Delta Lake, Lakehouse) is essential, along with the ability to optimize performance, calculate processing costs, and manage infrastructure needs. A solid...

Role Description Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be skilled in ETL tools such as Informatica Glue Databricks and DataProc with coding expertise in Python PySpark and SQL. Works independently and has a deep understanding of data warehousing solutions including Snowflake BigQuery Lakehouse and Delta Lake. Capable of calculating costs and understanding performance issues related to data solutions. Outcomes Act creatively to develop pipelines and applications by selecting appropriate technical options optimizing application dev...

5 - 7 Years 1 Opening Chennai, Trivandrum Role description Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be skilled in ETL tools such as Informatica Glue Databricks and DataProc with coding expertise in Python PySpark and SQL. Works independently and has a deep understanding of data warehousing solutions including Snowflake BigQuery Lakehouse and Delta Lake. Capable of calculating costs and understanding performance issues related to data solutions. Outcomes: Act creatively to develop pipelines and applications by selecting appropriate t...

About TechMango: Founded in 2014, TechMango Technology Services is a leading software development company with a strong focus on emerging technologies. Our primary goal is to deliver strategic solutions that align with our business partners' technological needs. We specialize in providing custom software solutions using the best available technologies, ensuring quality delivery within defined timelines. Our services include analysis, design, architecture, programming, testing, and long-term technical support, all aimed at achieving ultimate customer satisfaction. Recognized as the Best Offshore Software Development Company in India, TechMango is driven by the mantra, "Clients' Vision is our ...

About the Organization- Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth. Founded in 1991, we are cloud and data engineering leaders providing solutions to fortune 100 enterprises, headquartered in Los Gatos, California, with development centers in NOIDA, Indore, Gurugram, Bengaluru, Pune, and Hyderabad with over 3000 global team members. We also have offices in Canada and Australia and collaborate with a number of established companies, including American Express, Bank of Ame...

We are seeking an experienced and results-driven GCP Data Engineer with 4+ years of hands-on experience in designing, developing, and managing scalable data pipelines and analytics solutions using Google Cloud Platform. The ideal candidate will have deep expertise in BigQuery , Dataflow , and other GCP data services to support our enterprise-level data initiatives. Key Responsibilities: Design and implement scalable and efficient data pipelines using GCP services , especially BigQuery , Dataflow , Cloud Storage , and Pub/Sub . Develop data ingestion frameworks to handle structured and semi-structured data from various sources in batch and real-time modes. Transform raw data into clean, curat...

About TechMango: Founded in 2014, TechMango Technology Services is a leading software development company with a strong focus on emerging technologies. Our primary goal is to deliver strategic solutions that align with our business partners' technological needs. We specialize in providing custom software solutions using the best available technologies, ensuring quality delivery within defined timelines. Our services include analysis, design, architecture, programming, testing, and long-term technical support, all aimed at achieving ultimate customer satisfaction. Recognized as the Best Offshore Software Development Company in India, TechMango is driven by the mantra, "Clients' Vision is our ...

EXP: 10+ years Banagalore/Noida Responsibilities : ∙Design, implement, and maintain infrastructure-as-code on GCP using Terraform. ∙Develop and maintain robust CI/CD pipelines for automated infrastructure provisioning and application deployments on GCP. ∙Manage and administer GCP services, including Compute Engine, Cloud Storage, Cloud Networking, Cloud SQL, and Kubernetes Engine (GKE). ∙Implement and enforce infrastructure security best practices on GCP, leveraging services like Cloud IAM, Security Command Center, and VPC Service Controls. ∙Monitor GCP infrastructure performance using Cloud Monitoring and proactively identify and resolve issues. ∙Collaborate with development teams to unders...

About Company:- Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations. The company is committed to unleashing human energy through technology for an inclusive and sustainable future, helping organizations accelerate their transition to a digital and sustainable world. They provide a variety of services, including consulting, technology, professional, and outsourcing services. Job Title: GCP Data Engineer Location: Hyderabad...

About Company:- Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations. The company is committed to unleashing human energy through technology for an inclusive and sustainable future, helping organizations accelerate their transition to a digital and sustainable world. They provide a variety of services, including consulting, technology, professional, and outsourcing services. Job Title: GCP Data Engineer Location: Hyderabad...

About The Organisation DataFlow Group is a pioneering global provider of specialized Primary Source Verification (PSV) solutions, and background screening and immigration compliance services that assist public and private organizations in mitigating risks to make informed, cost-effective decisions regarding their Applicants and Registrants. DataFlow with its best practices in this field such as a high level of data security, cutting-edge technology, rigorous processes, qualified research analysts, and a global network of over 100,000 issuing authorities, verifies professionals credentials from the primary issuer of the document - regardless of its nature. We are seeking a highly skilled and ...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : GCP Dataflow Good to have skills : NA Minimum 5 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL proce...