665 Dataproc Jobs - Page 9

GA4 & Digital Data Integration: Design, build, and deploy robust ETL and data management processes specifically for ingesting, transforming, and loading high-volume digital analytics data from Google Analytics 4 (GA4) into BigQuery. BigQuery Data Architecture: Develop and optimize BigQuery datasets, tables, and views to support various analytical needs, ensuring efficient querying and data integrity. Data Pipeline Development: Design, build, and deploy ETL job workflows with reliable error/exception handling and rollback frameworks, primarily utilizing GCP services. GCP Resource Management: Monitoring and optimizing data processing and storage resources on GCP, with a focus on BigQuery perfo...

Role & responsibilities Develop, construct, test and maintain data acquisition pipelines for large volumes of structed and unstructured data. This includes batch and real-time processing (in google cloud). Build large and complex datasets based on business requirements. Construct big data’ pipeline architecture. Identify opportunities for data acquisition via working with stakeholders and business clients. Translate business needs to technical requirements. Leverage a variety of tools in the Google Cloud Ecosystem such as Python, Data Flow, DataStream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub Sub, BigQuery, Cloud Storage to integrate systems and data pipelines. Use logs & a...

Role & responsibilities Job Description : Sr. GCP Data Engineer Experience : 6 to 13 Years Work location : Chennai, Bangalore, Hyderabad, Pune-Hybrid Shift Timing : 2 to 11 PM I nterview proces s : L1 and L2 round Job description: 6+ years experience Should have experience in GCP BigQuery, DataProc(PySpark) Good to have experience on Informatica Preferred candidate profile Share your update resume on Nikita.solunke@ascendion.com and Do revert with below mentioned details. 1) Total year of experience- 2) Relevant year of experience- 3) Current CTC- 4) Expected CTC- 5) Notice Period- 6) Current Location- 7) Preferred Location-

Role Overview: You will be responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing, and analyzing large volumes of data efficiently and accurately. Collaborating with business and technology stakeholders to understand current and future data requirements will be a key aspect of your role. Key Responsibilities: - Collaborate with business and technology stakeholders to understand current and future data requirements - Design, build, and maintain reliable, efficient, and scalable data infrastructure for data collection, storage, transformation, and analysis - Plan, design, build, and maintain scalabl...

Role : GCP Architect Job Description Role & responsibilities : We have an urgent requirement for a GCP Architect, as per below JD. We are open for either contract or permanent position with us: Overall 8-10 years of experience in data engineering and AI stack 4-6 years of experience in architecting modern data warehousing solutions on Google Hands-on proficiency : Google BQ, Google Looker, Google GCS, Cloud run, Vertex Working knowledge of Databricks and Databricks Unity Catalog (GCP experience preferred) Experience in design and build solution on Vertex AI RAG, Evaluation, Agent builder for LLM apps ML flow ops with vertex AI pipelines, Model registry, CI/CD overview Experience in working w...

About The Role Data engineers are responsible for building reliable and scalable data infrastructure that enables organizations to derive meaningful insights, make data-driven decisions, and unlock the value of their data assets. About The Role - Grade Specific The involves leading and managing a team of data engineers, overseeing data engineering projects, ensuring technical excellence, and fostering collaboration with stakeholders. They play a critical role in driving the success of data engineering initiatives and ensuring the delivery of reliable and high-quality data solutions to support the organization"s data-driven objectives. Skills (competencies) Ab Initio Agile (Software Developme...

GCP Dataflow, GCP Cloud Composer, GCP BigQuery, GCP Cloud Storage, Dataproc. Java, Python, Scala. ETL/ELT, Big Data Hadoop Ecosystem, ANSI-SQL. DevOps, CI/CD, API, Agile GCP Datastream, Dataform, Datafusion, Workflows, Pub/Sub, and DMS

At Sogeti, we believe the best is inside every one of us. Whether you are early in your career or at the top of your game, well encourage you to fulfill your potentialto be better. Through our shared passion for technology, our entrepreneurial culture , and our focus on continuous learning, well provide everything you need to doyour best work and become the best you can be. Part of the Capgemini Group, Sogeti makes business value through technology for organizations that need to implement innovation at speed and want a localpartner with global scale. With a hands-on culture and close proximity to its clients, Sogeti implements solutions that will help organizations work faster, better, andsm...

Locations: Gurgaon, Noida, Pune, Mumbai, Chennai, Bangalore Experience : 5-13 Years Mandatory Skills : BigQuery, Airflow, GCS, Python, SQL, Pyspark (Optional) Skill Requirements: Essential Skills and experience: Excellent Programming skills in Python with object-oriented design Excellent knowledge in current computing trends and technologies Knowledge or working experience in Generative AI (GenAI) technologies is preferred. Experience in designing and implementing cloud infrastructure, platforms, and applications Hands-On Experience on Infrastructure as a Code using terraform /pulumi /typescript in GCP Hands-On Experience with Google Cloud platform & product deployment and automation Hands-O...

Before you apply to a job, select your language preference from the options available at the top right of this page. Explore your next opportunity at a Fortune Global 500 organization. Envision innovative possibilities, experience our rewarding culture, and work with talented teams that help you become better every day. We know what it takes to lead UPS into tomorrowpeople with a unique combination of skill + passion. If you have the qualities and drive to lead yourself or teams, there are roles ready to cultivate your skills and take you to the next level. About The Role : Google Cloud Infrastructure Support Engineer will be responsible for ensuring the reliability, performance, and securit...

Req ID: 332236 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Business Consulting-Technical analyst with ETL,GCP using Pyspark to join our team in Pune, Mahrshtra (IN-MH), India (IN). Key Responsibilities: Data Pipeline Development: Designing, implementing, and optimizing data pipelines on GCP using PySpark for efficient and scalable data processing. ETL Workflow Development: Building and maintaining ETL workflows for extracting, transforming, and loading data into various GCP services. GCP Service Utilization: Leve...

About the Role: We are looking for a skilled Google Cloud Platform (GCP) Engineer who can design, implement, and manage scalable cloud solutions. The ideal candidate will have strong expertise in cloud infrastructure, data engineering, and automation to support business-critical applications and data pipelines. Key Responsibilities: Design, implement, and manage GCP infrastructure services (Compute Engine, Cloud Storage, IAM, VPC, Pub/Sub, etc.). Develop, optimize, and maintain ETL/ELT pipelines using BigQuery, Dataflow, Composer (Airflow), and Cloud Functions . Automate infrastructure provisioning using Terraform, Deployment Manager, or equivalent tools . Ensure security, scalability, and r...

We are looking for an experienced Data Engineer with expertise in Google Cloud Platform (GCP) to design, build, and maintain scalable data pipelines and cloud-native solutions. The ideal candidate should have strong hands-on experience in GCP services, SQL, and data engineering best practices. Key Responsibilities Design and develop ETL/ELT pipelines using Dataflow, Dataproc, and Cloud Composer (Airflow) . Build and optimize data warehouses and data lakes using BigQuery, Cloud Storage, and Pub/Sub . Collaborate with analysts, data scientists, and business stakeholders to deliver reliable data solutions. Implement data quality, governance, and security standards. Automate workflows, improve p...

MLOps Engineer Location: Hyderabad & Chennai Workplace Type: Hybrid About the Rol eWe are seeking a highly skilled and motivated MLOps Engineer to join our growing data science team In this role, you will be responsible for building, deploying, and maintaining machine learning models in production using Google Cloud Platform (GCP) You will work closely with data scientists and engineers to ensure the reliability, scalability, and performance of our ML systems The ideal candidate has a strong background in software engineering, data engineering, and machine learning, with hands-on experience using GCP services such as BigQuery, Airflow, and Dataproc You will be instrumental in automating our ...

About The Role : Job TitleData Engineer (ETL, Python, SQL, GCP) Corporate TitleAVP LocationPune, India Role Description Engineer is responsible for developing and delivering elements of engineering solutions to accomplish business goals. Awareness is expected of the important engineering principles of the bank. Root cause analysis skills develop through addressing enhancements and fixes 2 products build reliability and resiliency into solutions through early testing peer reviews and automating the delivery life cycle. Successful candidate should be able to work independently on medium to large sized projects with strict deadlines. Successful candidates should be able to work in a cross appli...

Job TitleData Engineer Experience5"“8 Years LocationDelhi, Pune, Bangalore (Hyderabad & Chennai also acceptable) Time ZoneAligned with UK Time Zone Notice PeriodImmediate Joiners Only Role Overview We are seeking experienced Data Engineers to design, develop, and optimize large-scale data processing systems You will play a key role in building scalable, efficient, and reliable data pipelines in a cloud-native environment, leveraging your expertise in GCP, BigQuery, Dataflow, Dataproc, and more Key Responsibilities Design, build, and manage scalable and reliable data pipelines for real-time and batch processing. Implement robust data processing solutions using GCP services and open-source tec...

Location: Bangalore, Mumbai, Mangalore, Udupi, Delhi/ NCR Region About Niveus Solutions: Niveus Solutions is a distinguished Google Cloud Premier Partner, dedicated to empowering businesses with transformative cloud solutions. We pride ourselves on leveraging the comprehensive suite of Google Cloud technologies, spanning from robust infrastructure modernization to cutting-edge AI/ML, advanced analytics, and secure hybrid/multi-cloud strategies. Our team is composed of highly skilled industry experts committed to solving complex business challenges and accelerating digital transformation for our diverse clientele. About the Role: We are seeking an exceptionally accomplished and visionary Prin...

Role Data Engineer Required Technical Skill Set on at least one of them (Broad Skills mentioned here not all of them are required) Very good experience in implementing data platform modernization using GCP data services. Good data modelling skills on SQL/NoSQL based data platforms. Must-Have • Google Data Engineer (Overall 5+ Years with 2 years relevant experience) • Experience working in GCP based Big Data deployments (Batch/Realtime) leveraging components like GCP Big Query, air flow, Google Cloud Storage, Data fusion, Data flow, Data Proc etc. • Good skills in Python Language, PYSPARK • Good Skills in Linux • Exposure to creation of CI-CD pipelines for promoting big data release deploymen...

As a Business Consulting-Technical Analyst at NTT DATA in Pune, Maharashtra, India, your role will involve designing, implementing, and optimizing data pipelines on Google Cloud Platform (GCP) using PySpark for efficient and scalable data processing. You will also be responsible for building and maintaining ETL workflows for extracting, transforming, and loading data into various GCP services. Key Responsibilities: - Design, implement, and optimize data pipelines on GCP using PySpark - Build and maintain ETL workflows for data extraction, transformation, and loading on GCP - Leverage GCP services like BigQuery, Cloud Storage, Dataflow, and Dataproc for data storage and processing - Utilize P...

Mandatory skill- Advance Python & SQL GCP Services- BigQuery, Dataflow, Dataproc and Pub/Sub. Key Responsibilities Design, develop and optimize scalable data pipelines and ETL workflows using Google Cloud Platform (GCP), particularly leveraging BigQuery, Dataflow, Dataproc and Pub/Sub. Design and manage secure, efficient data integrations involving Snowflake and BigQuery. Write, test and maintain high-quality Python code for data extraction, transformation and loading (ETL), analytics and automation tasks. Use Git for collaborative version control, code reviews and managing data engineering projects. Implement infrastructure-as-code practices using Pulumi for cloud resources management and a...

Hi all, We are hiring for the role Python & GCP engineer Experience: 5+ Years Location: Bangalore Notice Period: Immediate - 15 days Skills: Technical Expertise: Languages: Python, SQL, Shell scripting Big Data: Kafka, PySpark, data warehousing, data lakes Cloud Platforms: GCP: GCS, BigQuery, Pub/Sub, Dataproc, Dataflow, Cloud Functions Database: Schema design, optimization, stored procedures DevOps: CI/CD pipeline implementation, multi-cloud deployment automation Development: Parallel processing, streaming, low-level design If you are interested drop your resume at mojesh.p@acesoftlabs.com Call: 9701971793

Job Title: GCP Data Engineer Location: Pune, India Experience: 3 to 7 Years Job Type: Full-Time Job Summary: We are looking for a highly skilled GCP Data Engineer with 3 to 7 years of experience to join our data engineering team in Pune . The ideal candidate should have strong experience working with Google Cloud Platform (GCP) , including Dataproc , Cloud Composer (Apache Airflow) , and must be proficient in Python , SQL , and Apache Spark . The role involves designing, building, and optimizing data pipelines and workflows to support enterprise-grade analytics and data science initiatives. Key Responsibilities: Design and implement scalable and efficient data pipelines on GCP , leveraging D...

Role & responsibilities Experience : Associate should have 3+ years of IT experience with good exposure into diagnosis and troubleshooting the complex issues . Technologies : IData Ingestion & ETL Pipelines,Dataflow/Dataproc/Pub/Sub,datasets,Vertex AI,BigQuery,Python,CI/CD for ML,Containerization,Proficiency in TensorFlow,Understanding of LLMs/Transformer,Prompt Engineering Must Have : Good communication customer handling skills with good knowledge into Bigquery, TensorFlow and Understanding of LLMs Good to Have : Monitoring and Logging and SQL Skills Certification : Google ACE,Machine Learning or equivalent certification

Job Description: Python Developer / Data Engineer Talend to Python Migration About the Role We are seeking experienced Python Developers/Data Engineers to join our team for a strategic migration project, moving enterprise ETL workloads from Talend to a modern Python-based ingestion framework on Google Cloud Platform (GCP). You will work closely with architects, platform engineers, and automation teams to design, build, and optimize scalable data pipelines, leveraging Airflow, Cloud Run, Dataproc, and BigQuery. Key Responsibilities 3+ years of experience in Python development, with a focus on data engineering and ETL pipeline design. ETL Migration & Development Analyze existing Talend jobs/mo...

8+ years of extensive experience in data engineering, data architecture, or analytics. 3 years in a dedicated data architect or solutions architect role. 5 years of hands-on experience data solutions specifically on Google Cloud Platform.